USC

ICT

VGL

Time-Offset Conversations on a Life-Sized Automultiscopic Projector Array
Time-Offset Conversations on a Life-Sized Automultiscopic Projector Array
CVPR workshop on Computational Cameras and Displays 2016
Andrew Jones     Koki Nagano     Jay Busch     Xueming Yu     Hsuan-Yueh Peng     Joseph Barreto     Oleg Alexander     Mark Bolas     Paul Debevec    
USC Institute for Creative Technologies


Figure 1: Photograph of subject shown on the automultiscopic projector array.

 


Abstract:

We present a system for which enables a participant to interactively converse with a life-sized, automultiscopic 3D projection of a person based on prerecorded interviews. We use an array of cameras and an extensive list of questions to record a large set of responses, which users access through a natural conversation interface that mimics face-to-face interaction. Recordings of answers, listening and idle behaviors are linked together to create a persistent visual image of the person throughout the interaction. Subjects are rendered using flowed light fields and shown life-size on a special rear-projection screen with an array of 216 video projectors. The display allows multiple users to see different 3D perspectives of the subject in proper relation to their viewpoints. The display is effective for interactive conversations since it provides 3D cues such as eye gaze and spatial hand gestures.


TEDxUCLA talk, Andrew Jones:


Material:

CVPR workshop on Computational Cameras and Displays 2016:

TEDxUCLA talk, Andrew Jones):


Related Projects: