max planck institut informatik
mpii logo Minerva of the Max Planck Society

3D Material Style Transfer, Eurographics 2012


3D Material Style Transfer

Chuong H. Nguyen1     Tobias Ritschel2     Karol Myszkowski1     Elmar Eisemann2     Hans-Peter Seidel1

1 MPI Informatik     2 Telecom ParisTech / CNRS-LTCI    



Paper Abstract

This work proposes a technique to transfer the material style or mood from a guide source such as an image or video onto a target 3D scene. It formulates the problem as a combinatorial optimization of assigning discrete materials extracted from the guide source to discrete objects in the target 3D scene. The assignment is optimized to fulfill multiple goals: overall image mood based on several image statistics; spatial material organization and grouping as well as geometric similarity between objects that were assigned to similar materials. To be able to use common uncalibrated images and videos with unknown geometry and lighting as guides, a material estimation derives perceptually plausible reflectance, specularity, glossiness, and texture. Finally, results produced by our method are compared to manual material assignments in a perceptual study.

Materials for Download

The paper (Adobe Acrobat PDF, 2.3 MB).
The additional materials (ZIP, 20.2 MB).
EG presentation slides (PPTX, 10.6 MB).

Addditional Materials

Related Publications

Material Editing in Complex Scenes by Surface Light Field Manipulation and Reflectance Optimization
Chuong H. Nguyen, Daniel Scherzer, Tobias Ritschel, Hans-Peter Seidel
Computer Graphics Forum 32(2) (Proc. Eurographics, Girona / Spain, 6th–10th May 2013).
Paper
Video
Project Page

Citation


Chuong H. Nguyen, Tobias Ritschel, Karol Myszkowski, Elmar Eisemann, Hans-Peter Seidel
3D Material Style Transfer
Computer Graphics Forum 31(2) (Proc. EUROGRAPHICS 2012), 2012.

  @article{nguyen:2012:3DMaterialStyle,
   author  = {Chuong H. Nguyen and
              Tobias Ritschel and
              Karol Myszkowski and
              Elmar Eisemann and              
              Hans-Peter Seidel},
   title   = {{3D Material Style Transfer}},
   journal = {Computer Graphics Forum (Proc. EUROGRAPHICS 2012)},
   volume  = 2,
   number  = 31,
   year    = {2012}
  }