|
ICT
GL
| Dynamic Shape Capture using Multi-View Photometric Stereo | ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2009) |
| Daniel Vlasic1 Pieter Peers2 Ilya Baran1 Paul Debevec2 Jovan Popovic1 3 4 Szymon Rusinkiewicz3 5 Wojciech Matusik3 |
| CSAIL, Massachusetts Institute of Technology1 University of Southern California, Institute for Creative Technologies2 Adobe Systems, Inc.3 University of Washington4 Princeton University5 |
Five different dynamic geometries shown from a novel viewpoint. Each meash contains over 1,000,000 polygons, and exhibits approximately a 2mm resolution. Each shape was captured from 8 cameras, running at a modest 240Hrz, using only 4 illumination conditions, yielding an effective 60Hrz temporal mesh resolution.
Abstract:
We describe a system for high-resolution capture of moving 3D geometry, beginning with dynamic normal maps from multiple views. The normal maps are captured using active shape-from-shading (photometric stereo), with a large lighting dome providing a series of novel spherical lighting configurations. To compensate for low-frequency deformation, we perform multi-view matching and thin-plate spline deformation on the initial surfaces obtained by integrating the normal maps. Next, the corrected meshes are merged into a single mesh using a volumetric method. The final output is a set of meshes, which were impossible to produce with previous methods. The meshes exhibit details on the order of a few millimeters, and represent the performance over human-size working volumes at a temporal resolution of 60Hz.
Material:
SIGGRAPH Asia 2009 Paper:
- SIGGRAPHAsia2009_DynamicShape.pdf, 21.1 MB. ( Adobe Acrobat )
SIGGRAPH Asia 2009 Video (4:02 min):
- SIGGRAPHAsia2009_DynamicShape.mp4, 30.5 MB.
Related Projects:
- Photometric Stereo for Archeological Inscriptions, SIGGRAPH 2004 Sketch
- Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Illumination, EGSR 2009
- Facial Performance Synthesis using Deformation-Driven Polynomial Displacement Maps, ACM SIGGRAPH Asia 2008
- High Resolution Face Scanning for "Digital Emily"
- Acquiring the Reflectance Field of a Human Face, SIGGRAPH 2000
- Facial Reflectance Field Demo, SIGGRAPH 2000 Creative Applications Laboratory
- Realistic Human Face Scanning and Rendering, ICT Graphics Lab 2001
- A Photometric Approach to Digitizing Cultural Artifacts, VAST 2001
- Animatable Facial Reflectance Fields, EGSR 2004
- Reflectance Field Rendering of Human Faces for "Spider-Man 2", SIGGRAPH 2004 Sketch
- Postproduction Re-Illumination of Live Action Using Interleaved Lighting, SIGGRAPH 2004 Poster
- Performance Geometry Capture for Spatially Varying Relighting, SIGGRAPH 2005 Sketch