Immersive Teleconferencing with Natural 3D Stereoscopic Eye Contact Using GPU Computing

Abstract

This paper presents an overview of our work in creating a practical prototype for natural 3D stereoscopic eye contact in teleconferencing. The two main pillars of our system are to 'immerse' the participants and to create as much as possible a natural feel to the communication. This is mainly realized by synthesizing virtual camera viewpoints to restore the eye contact, and by creating a sense of depth perception though feeding correctly generated stereo images directly to the user's eyes. Furthermore, we present an overview of GPU computing techniques that are used to maintain the real-time processing and transmission constraints of the system.