Lecture: Perception for Computer Graphics (Myszkowski/Tursun)

Perception for Computer Graphics (Lecture, Winter Semester 2018/2019)

Specialized Lecture for Computer Graphics/Visual Computing

Karol Myszkowski Okan Tarhan Tursun

(c) xkcd.com

As computer graphics is producing images and videos that are ultimately perceived by a human, it's mandatory to account for how the human visual system (HVS) is processing this information. The HVS is complex, exhibiting many non-linearities as well as feedback and is only partially understood. While this poses a challenge, it can also be seen as an opportunity which can be exploited in image compression, watermarking, denoising, enhancement, upsampling, etc. Computational models which can predict the human response to the distortion of visual content are important when this opportunity is taken. To this end, our course covers the basic theory of perception research, including

What is perception?
Designing experiments
Analysis and statistics

and the practical applications in computer graphics, including

Eye physiology and image formation
Brightness and contrast
Color
High dynamic range and tone reproduction
Image compression and image quality
Depth and shape perception
Material perception

The target audience are students in computer science or related fields. This course covers topics from psychology and physiology that are relevant to computer graphics, and novel perception research and applications in computer graphics and vision. The objective is to transfer knowledge, experience and competencies that are required for doing research in perceptual computer graphics, and that are useful in many related fields, such as experimental psychology, or usability studies in human-computer interaction.

Prerequisites:	Computer graphics and image processing, and the related math.
Language:	English.
Evaluation:	Final exam (written) Thursday, 21.02.2019. Time: 14:15-15:45. Place: lecture hall 001 in E1 3 (CS). Re-exam Wednesday, 20.03.2019. Time: 12:15-13:45. Place: lecture hall 001 in E1 3 (CS).

Lecture time:	Wednesday, 12:00-14:00
First lecture:	Wednesday, 17.10.2018
Room:	Building E1 4 (Max-Planck-Institut für Informatik), Room 019 Please note that Room 019 is reserved for a workshop on 16.01.2019. Therefore, we are going to have our lecture in Room 021 instead of Room 019 on that day.
HISPOS: The examination number is 10572.

Schedule:

Lecture 01: Introduction, Course Overview (17.10.2018) (VIDEO, 150 MB)

Lecture 02: What is Perception? (24.10.2018) (VIDEO, 613 MB)

Lecture 03: Designing Experiments, Part 1 (31.10.2018)

Lecture 04: Designing Experiments, Part 2 (7.11.2018)

Lecture 05: Statistics, (14.11.2018) (VIDEO, 49 MB)

Lecture 06: The Eye: Optics, Spatial Acuity and Temporal Integration, (21.11.2018) (VIDEO, 121 MB)

Lecture 07: Eye Movements (28.11.2018) (VIDEO, 221 MB)

Lecture 08: Luminance, Contrast and Lightness (5.12.2018)

Lecture 09: Tone Mapping (12.12.2018)

Lecture 10: Color (19.12.2018)

-- Winter Break --

Lecture 11: Image Quality Evaluation (9.01.2019)

Lecture 12: Depth and Shape Perception (16.01.2019) (VIDEO, 77.6 MB)

Lecture 13: Stereo 3D (23.01.2019) (VIDEO, 87.2 MB)

Lecture 14: Advanced Displays (Dr. Hyeonseung Yu) (30.01.2019)

Lab Tour and Exam Question Examples

Course resources: Send an email to Okan Tarhan Tursun for the password. No password required if you're on the campus network. If you cannot play videos on your web browser, please try downloading the file and opening it with a media player on your computer. You may use free and open-source VLC media player.

The following list contains the most relevant books for this lecture:

Vision Science: Photons to Phenomenology, Stephen E. Palmer, The MIT Press, 2002.
Foundations of Vision, Brian A. Wandell, Sinauer Associates, Inc., 1995.
Seeing: The Computational Approach to Biological Vision, John P. Frisby and James V. Stone, The MIT Press, 2010.
Experimental Design: From User Studies to Psychophysics, Douglas W. Cunningham and Christian Wallraven, A K Peters/CRC Press, 2011.
Seeing in Depth: Basic Mechanics (Vol. 1) and Seeing in Depth: Depth Perception (Vol. 2), Ian P. Howard and Brian J. Rogers, Oxford Psychology Series, 2012.
Visual Perception from a Computer Graphics Perspective, William Thompson, Roland Fleming, Sarah Creem-Regehr and Jeanine Kelly Stefanucci, A K Peters/CRC Press, 2011.
High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting, Erik Reinhard, Greg Ward, Paul Debevec, Sumanta Pattanaik, Wolfgang Heidrich and Karol Myszkowski, Morgan Kaufmann Publishers, 2nd edition, 2010.
High Dynamic Range Video, Karol Myszkowski, Rafal Mantiuk and Grzegorz Krawczyk. Synthesis Digital Library of Engineering and Computer Science. Morgan & Claypool Publishers, San Rafael, USA, 2008.
Color Imaging: Fundamentals and Applications Erik Reinhard, Erum Arif Khan, Ahmet Oguz Akyuz and Garrett M. Johnson, A K Peters, 2007.
High Dynamic Range Imaging: an article in Wiley Encyclopedia of Electrical and Electronics Engineering 2015

Further literature will be announced during the course.