Time-Offset Conversations on a Life-Sized Automultiscopic Projector Array
CVPR workshop on Computational Cameras and Displays 2016
Andrew Jones    Koki Nagano    Jay Busch    Xueming Yu    Hsuan-Yueh Peng   
Joseph Barreto    Oleg Alexander    Mark Bolas    Paul Debevec   
USC Institute for Creative Technologies
Abstract

We present a system for which enables a participant to interactively converse with a life-sized, automultiscopic 3D projection of a person based on prerecorded interviews. We use an array of cameras and an extensive list of questions to record a large set of responses, which users access through a natural conversation interface that mimics face-to-face interaction. Recordings of answers, listening and idle behaviors are linked together to create a persistent visual image of the person throughout the interaction. Subjects are rendered using flowed light fields and shown life-size on a special rear-projection screen with an array of 216 video projectors. The display allows multiple users to see different 3D perspectives of the subject in proper relation to their viewpoints. The display is effective for interactive conversations since it provides 3D cues such as eye gaze and spatial hand gestures.


Photograph of subject shown on the automultiscopic projector array.

Downloads

CVPR workshop on Computational Cameras and Displays 2016
jones_timeoffset3D_CCD.pdf (4.3MB)
Computer Vision Foundation
Related Projects

Autostereoscopic Projector Array
An Autostereoscopic Projector Array Optimized for 3D Facial Display, SIGGRAPH 2013 Emerging Technologies
Creating a life-sized automultiscopic Morgan Spurlock for CNNs "Inside Man", SIGGRAPH 2015 Emerging Technologies