Deco
max planck institut
informatik
mpii logoMinerva of the Max Planck Society
 

Computational Photography

Sommersemester 2007

A cutaway view showing some of the optical and electronic components in a Canon 5D - one of the most capable prosumer digital cameras (image from Canon USA). By inserting a microlens array into a conventional handheld camera, one can create a plenoptic camera, which can record a light field in a single snapshot. The photographs produced by a plenoptic camera can be refocused after they are captured, and the viewpoint can be moved. Click above for an example of digital refocusing. Combining multiple images from different viewpoints under different lighting conditions allows for re-rendering and re-lighting a human face. Dual photography lets us read a hidden playing card from its reflection in the page of a book. The card's face is shown at lower-right.

Time
Summer term, 2007, Fri 9:15-10:45
Übungen, 2std. (6CP)
Place
Raum 024 (MPI)
Instructor
Hendrik Lensch
Office hours
Mon/Wed 1:30 - 2:00 (MPI - 228)

Content

Although the digital photography industry is expanding rapidly, most digital cameras still look and feel like film cameras, and they offer roughly the same set of features and controls. However, as sensors and in-camera processing systems improve, these cameras will begin to offer capabilities that film cameras never had. Among these will be the ability to refocus photographs after they are taken (see the example above), or to combine views taken with different camera settings, aim, or placement. Equally exciting are new technologies for creating efficient, controllable illumination. Future "flashbulbs" may be pulsed LEDs or video projectors, with the ability to selectively illuminate objects, recolor the scene, or extract shape information. These developments force us to relax our notion of what constitutes "a photograph." They also blur the distinction between photography and scene modeling. These changes will lead to new photographic techniques, new scientific tools, and possibly new art forms.

In this course, which I have co-taught in very similar form at Stanford University last year, we will survey the converging technologies of digital photography, computational imaging, and image-based rendering, and we will explore the new imaging modalities that they enable. Here is a tentative schedule of lectures.

Course requirements

This is an advanced course for students with background in computer graphics or computer vision. The content is reflecting our conviction that successful researchers in this area must understand both the algorithms and the underlying technologies. The lectures may be accompanied by readings from textbooks or the research literature. These readings will be handed out in class or placed on the course web site. Students are expected to:

  1. read the assigned papers, attend the lectures, and participate in class discussions and the scheduled debate
  2. do a major project of their own design.


Course material

Related Material


© 2007 Hendrik Lensch
July 20, 2007 09:13:45 AM