Compressive Light Transport Sensing

ACM Transactions on Graphics, Volume 28, Issue 1 (January 2009)

ICT Technical Report, ICT-TR-05-2008, May 2008

Pieter Peers1   Dhruv K. Mahajan2  Bruce Lamond1  Abhijeet Ghosh1 
Wojciech Matusik4   Ravi Ramamoorthi2,3  Paul Debevec1
University of Southern California, Institute for Creative Technologies1
Columbia University2
University of Berkely3
Adobe Inc.4

 

Three scenes captured using only 1000 non-adaptive compressive measurements, and relit using a novel conditions. The 128x128 reflectance functions of each camera pixel is reconstructed using our hierarhical reconstruction algorithm using 128 Haar wavelet coefficients per function from the observed compressive measurements.

Abstract:

In this paper we propose a new framework for capturing light transport data of a real scene, based on the recently developed theory of compressive sensing. Compressive sensing offers a solid mathematical framework to infer a sparse signal from a limited number of non-adaptive measurements. Besides introducing compressive sensing for fast acquisition of light transport to computer graphics, we develop several innovations that address specific challenges for image-based relighting, and which may have broader implications. We develop a novel hierarchical decoding algorithm that improves reconstruction quality by exploiting inter-pixel coherency relations. Additionally, we design new non-adaptive illumination patterns that minimize measurement noise and further improve reconstruction quality. We illustrate our framework by capturing detailed highresolution reflectance fields for image-based relighting.

Material:

ACM Transactions on Graphics Paper

ICT Technical Report (May 2008)