max planck institut
mpii logoMinerva of the Max Planck Society

Lecture: Perception for Computer Graphics (Myszkowski/Serrano)

Perception for Computer Graphics (Lecture, Winter Semester 2020/2021)

Specialized Lecture for Computer Graphics/Visual Computing

Karol Myszkowski     Ana Serrano


As computer graphics is producing images and videos that are ultimately perceived by a human, it's mandatory to account for how the human visual system (HVS) is processing this information. The HVS is complex, exhibiting many non-linearities as well as feedback and is only partially understood. While this poses a challenge, it can also be seen as an opportunity which can be exploited in image compression, watermarking, denoising, enhancement, upsampling, etc. Computational models which can predict the human response to the distortion of visual content are important when this opportunity is taken. To this end, our course covers the basic theory of perception research, including

and the practical applications in computer graphics, including

The target audience are students in computer science or related fields. This course covers topics from psychology and physiology that are relevant to computer graphics, and novel perception research and applications in computer graphics and vision. The objective is to transfer knowledge, experience and competencies that are required for doing research in perceptual computer graphics, and that are useful in many related fields, such as experimental psychology, or usability studies in human-computer interaction.

Prerequisites: Computer graphics and image processing, and the related math.
Language: English.
Evaluation: Final exam and Re-exam dates will be announced later.

Lecture time: Wednesday, 10:00-12:00
First lecture: Wednesday, 04.11.2020
Room: remote Zoom lecture


Lecture 01: Introduction, Course Overview (04.11.2020) (VIDEO, 150 MB)

Lecture 02: What is Perception? (11.11.2020) (VIDEO, 613 MB)

Lecture 03: The Eye: Optics, Spatial Acuity and Temporal Integration, (18.11.2020) (VIDEO, 121 MB)

Lecture 04: Designing Experiments, Part 1 (25.11.2020)

Lecture 05: Designing Experiments, Part 2 (02.12.2020)

Lecture 06: Statistics (09.12.2020) (VIDEO, 49 MB)

Lecture 07: Material Perception (16.12.2020)

-- Winter Break --

Lecture 08: Luminance, Contrast, Lightness, and Tone Mapping (06.01.2021)

Lecture 09: Image Quality Evaluation (13.01.2021)

Lecture 10: Depth and Shape Perception (20.01.2021) (VIDEO, 77.6 MB)

Lecture 11: Stereo 3D (27.01.2021) (VIDEO, 87.2 MB)

Lecture 12: Eye Motion, Perception in VR/AR (03.02.2021)

Course resources: Send an email to Ana Serrano for the password. No password required if you're on the campus network. If you cannot play videos on your web browser, please try downloading the file and opening it with a media player on your computer. You may use free and open-source VLC media player.

The following list contains the most relevant books for this lecture:

Further literature will be announced during the course.

Search MPII (type ? for help)