MovieReshape: Tracking and Reshaping of Humans in Videos, SIGGRAPH Asia 2010

MovieReshape: Tracking and Reshaping of Humans in Videos

Arjun Jain Thorsten Thormählen Hans-Peter Seidel Christian Theobalt

MPI Informatik

Abstract

We present a system for quick and easy manipulation of the body shape and proportions of a human actor in arbitrary video footage. The approach is based on a morphable model of 3D human shape and pose that was learned from laser scans of real people. The algorithm commences by spatio-temporally fitting the pose and shape of this model to the actor in either single-view or multi-view video footage. Once the model has been fitted, semantically meaningful attributes of body shape, such as height, weight or waist girth, can be interactively modified by the user. The changed proportions of the virtual human model are then applied to the actor in all video frames by performing an image-based warping. By this means, we can now conveniently perform spatio-temporal reshaping of human actors in video footage which we show on a variety of video sequences.

Materials for Download


	The paper (Adobe Acrobat PDF, 6.6 MB).
	The supplemental video (Windows AVI, Xvid, 89.3 MB).

For full quality, please download the supplemental video (Windows AVI, Xvid, 89.3 MB).

Citation

Arjun Jain, Thorsten Thormählen, Hans-Peter Seidel, Christian Theobalt
MovieReshape: Tracking and Reshaping of Humans in Videos
ACM Trans. Graph. 29 (5) (Proc. SIGGRAPH Asia 2010)

  @article{Jain:2010:MovieReshape,
   author    = {Arjun Jain and
                Thorsten Thorm\"{a}hlen and
                Hans-Peter Seidel and
                Christian Theobalt
               },
   title     = {MovieReshape: Tracking and Reshaping of Humans in Videos},
   journal   = {ACM Trans. Graph. (Proc. SIGGRAPH Asia 2010)},
   year      = {2010},
   volume    = {29},
   number    = {5}
  }

Acknowledgements

We thank

the Max Planck Center for Visual Computing and Communication (BMBF-KZ 01IM10001) for partially funding this project,
all reviewers for their helpful suggestions,
Ben Galehouse for the voice-over,
Betafilm and FremantleMedia Ltd for the permission to use the Baywatch footage
University of Surrey [Gkalelis et al. 2009] as well as [Hasler et al. 2009] for making their data available,
and all participants of the user studies.

Media Coverage

The project is currently getting quite a lot of coverage on all sorts of media. Here is a (random) subset of the outlets that have featured MovieReshape:

NewScientist
Engadget
Gizmodo
Daily Mail Online
Vizworld
The Hollywood Reporter
Focus Online (German)
Saarländischer Rundfunk, (German), Aktueller Bericht, Nov 10, 2010
Frankfurter Allgemeine Sonntagszeitung, (German), Nov 18, 2010, no. 45, page 78
Welt am Sonntag, (German), Nov 18, 2010, no. 46, page 71
Deutschlandradio Wissen, (German)
Technology Review, (German), Dec 2010, page 16
Sonntag Express, (German), January 23, 2011, page 8
The Telegraph, India, July 1, 2011, page 1
Max Planck Research Magazine, issue 03/2011, page 62-69 (English version ) (German version )

3sat Nano, (German), Dec 1, 2011
De Ingenieur, (Dutsch), Nov 15, 2012