Practical Image-Based Relighting and Editing with Spherical-Harmonics and Local Lights
CVMP 2011
Borom Tunwattanapong    Abhijeet Ghosh    Paul Debevec   
USC Institute for Creative Technologies

Face relighting comparison under the Grace cathedral environment (a). (b) 20 SH lights. (c) 20 local lights. (d) Our proposed technique for combining SH lighting with local lights (20 lighting conditions). (e) Ground truth image-based relighting consisting of 156 lights.
Abstract

We present a practical technique for image-based relighting under environmental illumination which greatly reduces the number of required photographs compared to traditional techniques, while still achieving high quality editable relighting results. The proposed method employs an optimization procedure to combine spherical harmonics, a global lighting basis, with a set of local lights. Our choice of lighting basis captures both low and high frequency components of typical surface reflectance functions while generating close approximations to the ground truth with an order of magnitude less data. This technique benefits the acquisition process by reducing the number of required photographs, while simplifying the modification of reflectance data and enabling artistic lighting edits for post-production effects. Here, we demonstrate two desirable lighting edits, modifying light intensity and angular width, employing the proposed lighting basis.

Downloads

CVMP 2011 Paper
SHLocalLights_CVMP_2011_2011.pdf, (4.23MB)

CVMP 2011 Video
SHLocalLights_864x486_H264.mov, (7.92MB)

Related Projects

Light Stage Face Scanning
Specular Roughness and Anisotropy from Second Order Gradients, Eurographics Symposium on Rendering 2009
High-Resolution Face Scanning, Eurographics Symposium on Rendering 2007

Light Stage 1
Acquiring the Reflectance Field of a Human Face, SIGGRAPH 2000
Facial Reflectance Field Demo, SIGGRAPH 2000 Creative Applications Laboratory
Realistic Human Face Scanning and Rendering, ICT Graphics Lab 2001

Light Stage 2
A Photometric Approach to Digitizing Cultural Artifacts, VAST 2001
Animatable Facial Reflectance Fields, EGSR 2004
Reflectance Field Rendering of Human Faces for "Spider-Man 2", SIGGRAPH 2004 Sketch

Light Stage 5
Postproduction Re-Illumination of Live Action Using Interleaved Lighting, SIGGRAPH 2004 Poster
Performance Geometry Capture for Spatially Varying Relighting, SIGGRAPH 2005 Sketch

Light Stage 6
Relighting Human Locomotion with Flowed Reflectance Fields, EGSR 2006 Paper
Relighting Human Locomotion with Flowed Reflectance Fields, SIGGRAPH 2006 Sketch
Light Stage Data Gallery.