Real-time Novel-view Synthesis for Volume Rendering Using a Piecewise-analytic Representation VMV 2016

Real-time Novel-view Synthesis for Volume Rendering Using a Piecewise-analytic Representation

Gerrit Lochmann¹     Bernhard Reinert²     Arend Buchacher¹     Tobias Ritschel³    

Univertität Koblenz-Landau¹, MPI Informatik², University College London³

Starting from an original volume rendering (left) our approach generates novel views in milliseconds (right).

Abstract

Novel-view synthesis can be used to hide latency in a real-time remote rendering setup, to increase frame rate or to produce advanced visual effects such as depth-of-field or motion blur in volumes or stereo and light field imagery. Regrettably, existing real-time solutions are limited to opaque surfaces. Prior art has circumvented the challenge by making volumes opaque i. e., projecting the volume onto representative surfaces for reprojection, omitting correct volumetric effects. This paper proposes a layered image representation which is re-composed for the novel view with a special reconstruction filter. We propose a view-dependent approximation to the volume allowing to produce a typical novel view of 1024x1024 pixels in ca. 25 ms on a current GPU. At the heart of our approach is the idea to compress the complex view-dependent emission-absorption function along original view rays into a layered piecewise-analytic emission-absorption representation that can be efficiently ray-cast from a novel view. It does not assume opaque surfaces or approximate color and opacity, can be re-evaluated very efficiently, results in an image identical to the reference from the original view, has correct volumetric shading for novel views and works on a low and fixed number of layers per pixel that fits modern GPU architectures.

Video / Talk

Downloads

Citation

Gerrit Lochmann, Bernhard Reinert, Arend Buchacher, Tobias Ritschel
Real-time Novel-view Synthesis for Volume Rendering Using a Piecewise-analytic Representation
VMV 2016.

@inproceedings{Lochmann:2016:vmv,
  booktitle = {Vision, Modeling & Visualization},
  editor = {Matthias Hullin and Marc Stamminger and Tino Weinkauf},
  title = {{Real-time Novel-view Synthesis for Volume Rendering Using a Piecewise-analytic Representation}},
  author = {Lochmann, Gerrit and Reinert, Bernhard and Buchacher, Arend and Ritschel, Tobias},
  year = {2016},
  publisher = {The Eurographics Association},
  ISBN = {978-3-03868-025-3}
}

Acknowledgements

We would like to thank the anonymous reviewers for helpful comments. Volume datasets courtesy of The University of Texas High-Resolution CT Facility: UTCT.