High Dynamic Range Image and Video Processing

Tremendous progress in the development and accessibility of high dynamic range (HDR) technology that we witness in recent years creates many interesting opportunities and challenges in computer vision, image processing and graphics.

The goal of this web page is to provide information on a complete pipeline for HDR image and video processing from acquisition, through compression and quality evaluation, to display. We include links to relevant papers and project pages.

We also provide source code of tools useful for HDR image and video manipulation. Finally, we give successful examples of the use of HDR technology in research setups and industrial applications.

Image Acquisition

• Photometric Calibration of HDR and LDR Cameras
• Dynamic Range Improvement Through Multiple Exposures

Image and Video Compression

• Backward Compatible High Dynamic Range MPEG Video Compression
• HDR Extension for MPEG-4
• DCT-based Lossy HDR Compression for the OpenEXR Format (work in progress)
• Wavelet-based Subband Encoding

Image and Video Enhancement

• Temporal Glare: Real-Time Dynamic Simulation of the Scattering in the Human Eye
• Contrast Domain Image Processing
• Beyond Tone Mapping: Enhanced Depiction of Tone Mapped HDR Images
• Contrast Restoration by Adaptive Countershading
• Enhancement of Bright Video Features for HDR Displays
• Video Filtering (Spatio-temporal Bilateral Filtering, Spatio-temporal Box Filtering)

Tone Mapping

• Visual Maladaptation in Contrast Domain (SPIE'10)
• Display Adaptive Tone Mapping (SIGGRAPH'08)
• Tone Mapping Operators and Their Perceptual Evaluation
• Lightness Perception in Tone Reproduction for High Dynamic Range Images
• Perceptual Effects in Real-time Tone Mapping

Image and Video Quality Evaluation

• Image and Video Quality Metrics Online
• Learning to Predict Localized Distortions in Rendered Images (PG'13)
• New Measurements Reveal Weaknesses of Image Quality Metrics in Evaluating Graphics Artifacts (SIGGRAPH Asia'12)
• NoRM: No-Reference Image Quality Metric for Realistic Image Synthesis (EG'12)
• On Evaluation of Video Quality Metrics: an HDR Dataset for Computer Graphics Applications (SPIE'11)
• Dynamic Range Independent Video Quality Assessment (SIGGRAPH ASIA'10)
• Dynamic Range Independent Image Quality Assessment (SIGGRAPH'08)
• Extending Quality Metrics to Full Luminance Range Images
• High Dynamic Range Visual Difference Predictor (HDR-VDP)
• Visible Differences Predictor (VDP): Applications to Global Illumination Problems
• Animation Quality Metric: an Extension of VDP for Dynamic Sequences

Applications

• Interactive System for Dynamic Scene Lighting using Captured Video Environment Maps
• A CAVE System for Car Interrior Relighting (pdf, ppt)

Software Packages

• PFStools: Library and a set of command line tools (and a viewer) for reading, writing, manipulating, and viewing HDR images and video frames.
• PFStmo: Implementation of state-of-the-art tone mapping operators.
• PFScalibration: Photometric calibration of HDR and LDR cameras.
• High Dynamic Range Visible Differences Predictor (HDR-VDP)

Resources

• HDR Source Image Gallery
• Reference Tone Mapped Images
• HDR Video Environment Maps Samples
• HDR Video Video Samples
• Hyperfocal Design: host for a growing HDRI & CG community

Educational Materials

• Eurographics 2005 tutorial:
  High Dynamic Range Techniques in Graphics: from Acquisition to Display (pdf, 16.9 MB)

People

• Tunç Aydın
• Martin Čadík
• Michael Goesele
• Vlastimil Havran
• Grzegorz Krawczyk
• Rafał Mantiuk
• Karol Myszkowski
• Akiko Yoshida

Copyright 2018 by Max-Planck-Institut Informatik | Imprint/Impressum | Data Protection
Last modified: Wednesday, 16-May-2018 09:58:56 CEST

• HDR Projects:
  
• Image Acquisition
  
• Image and Video Compression
• Image and Video Enhancement
  
• Tone Mapping
• Image Quality Evaluation
• Applications
• Software Packages
• Resources
• Educational Materials
• People