Interactive view point transition on synchronised video streams

Abstract

In this paper, we present a system to interactively enhance the viewing experience of synchronized video streams in 3D space. Our system automatically computes the relative positions of all cameras and enables smooth transition between videos in 3D space. We are proposing a new approach to transition between videos. Other methods in viewpoint navigation demand a lot of computation for estimating depth and color information of each pixel and are not fit for wide baseline camera arrangements in real-time. Our method relies on mesh based interpolation, computes robust 3D points for all matching feature points in the subsequent camera frames and enables mesh based view transition from one camera to another similar to Microsoft Photosynth and also works on sparse feature matches. With a collection of synchronous video streams as input, our system computes the pose of each camera and the sparse geometry of the underlying scene in the subsequent camera frames during viewpoint transition.