max planck institut informatik
mpii logo Minerva of the Max Planck Society

Perceptually-motivated Real-time Temporal Upsampling of 3D Content for High-refresh-rate Displays, Eurographics 2010


Perceptually-motivated Real-time Temporal Upsampling of 3D Content for High-refresh-rate Displays

Piotr Didyk1     Elmar Eisemann1,2     Tobias Ritschel1     Karol Myszkowski1     Hans-Peter Seidel1

1 MPI Informatik     2 Saarland University


Abstract

High-refresh-rate displays (e. g., 120 Hz) have recently become available on the consumer market and quickly gain on popularity. One of their aims is to reduce the perceived blur created by moving objects that are tracked by the human eye. However, an improvement is only achieved if the video stream is produced at the same high refresh rate (i. e. 120 Hz). Some devices, such as LCD TVs, solve this problem by converting low-refresh-rate content (i. e. 50 Hz PAL) into a higher temporal resolution (i. e. 200 Hz) based on two-dimensional optical flow. In our approach, we will show how rendered three-dimensional images produced by recent graphics hardware can be up-sampled more efficiently resulting in higher quality at the same time. Our algorithm relies on several perceptual findings and preserves the naturalness of the original sequence. A psychophysical study validates our approach and illustrates that temporally up-sampled video streams are preferred over the standard low-rate input by the majority of users. We show that our solution improves task performance on high-refresh-rate displays.

Materials for Download

The paper (Adobe Acrobat PDF, 1.2 MB).
The supplemental (Adobe Acrobat PDF, 0.1 MB).
The final video (Windows AVI, Xvid, 102 MB).
The BibTeX.
The binary, which shows the influence of the framerate
on the hold-type blur (Windows EXE, 0.1 MB).


    Eurographics 2010 talk slides:

Keynote (291 MB)
Adobe Acrobat PDF (12.9 MB)
Quick Time (HQ, 322 MB)
Please note: YouTube only gives a preview of the effect but doesn't reproduce it in professional
quality. For full quality, please download the supplemental material .AVI video (102 MB).

Related Publications

Adaptive Image-space Stereo View Synthesis
Piotr Didyk, Tobias Ritschel, Elmar Eisemann, Karol Myszkowski, Hans-Peter Seidel
Proceedings of Vision, Modeling and Visualization Workshop, 15-17 November 2010, Siegen, Germany.
Paper
Video
BibTeX
Project Page

Citation

Piotr Didyk, Elmar Eisemann, Tobias Ritschel, Karol Myszkowski, Hans-Peter Seidel
Perceptually-motivated Real-time Temporal Upsampling of 3D Content for High-refresh-rate Displays
Computer Graphics Forum (Proceedings Eurographics 2010, Norrköpping, Sweden) 29 (2): 713-722, 2010

  @article{DidykERMS2010,
	author = { Piotr Didyk and
	           Elmar Eisemann and
	           Tobias Ritschel and
	           Karol Myszkowski and
	           Hans-Peter Seidel
	         },
	title = {Perceptually-motivated Real-time Temporal Upsampling of {3D} Content for High-refresh-rate Displays},
	journal = {Computer Graphics Forum (Proceedings Eurographics 2010, Norrk\"opping, Sweden)},
	year = {2010},
	volume = {29},
	number = {2},
	pages = {713-722}
  }

Acknowledgements


We thank

  • all reviewers for their helpful suggestions,
  • internal review
  • Mesh animations from Robert W. Sumner, Jovan Popovic. Deformation Transfer for Triangle Meshes. ACM Trans. Graph. 23(3) (Proc. SIGGRAPH) August 2004