ICT

GL

Multiview Face Capture using Polarized Spherical Gradient Illumination

ACM Trans. on Graphics (Proc. SIGGRAPH Asia) 2011

Abhijeet Ghosh Graham Fyffe Borom Tunwattanapong Jay Busch Xueming Yu Paul Debevec

USC Institute for Creative Technologies

Abstract:

We present a novel process for acquiring detailed facial geometry with high resolution diffuse and specular photometric information from multiple viewpoints using polarized spherical gradient illumination. Key to our method is a new pair of linearly polarized lighting patterns which enables multiview diffuse-specular separation under a given spherical illumination condition from just two photographs. The patterns - one following lines of latitude and one following lines of longitude - allow the use of fixed linear polarizers in front of the cameras, enabling more efficient acquisition of diffuse and specular albedo and normal maps from multiple viewpoints. In a second step, we employ these albedo and normal maps as input to a novel multi-resolution adaptive domain message passing stereo reconstruction algorithm to create high resolution facial geometry. To do this, we formulate the stereo reconstruction from multiple cameras in a commonly parameterized domain for multiview reconstruction. We show competitive results consisting of high-resolution facial geometry with relightable reflectance maps using five DSLR cameras. Our technique scales well for multiview acquisition without requiring specialized camera systems for sensing multiple polarization states.

Material:

SIGGRAPH Asia 2011 Paper:

Multiview_SIGGRAPHAsia_2011.pdf, 32.0 MB. ( Adobe Acrobat )

SIGGRAPH Asia 2011 Video:

Multiview_video_800x600.mov, 21.3 MB. ( Quicktime )

Related Projects:

Light Stage Face Scanning:
- Circularly Polarized Spherical Illumination Reflectometry, ACM SIGGRAPH Asia 2010
- Specular Roughness and Anisotropy from Second Order Gradients, Eurographics Symposium on Rendering 2009
- Practical Modeling and Acquisition of Layered Facial Reflectance , ACM SIGGRAPH Asia 2008
- High-Resolution Face Scanning, Eurographics Symposium on Rendering 2007

Light Stage 1:
- Acquiring the Reflectance Field of a Human Face, SIGGRAPH 2000
- Facial Reflectance Field Demo, SIGGRAPH 2000 Creative Applications Laboratory
- Realistic Human Face Scanning and Rendering, ICT Graphics Lab 2001