Multimodal interaction in a collaborative virtual brainstorming environment

Abstract

In this paper we present our work in setting up a collaborative virtual environment (CVE) framework which is built to support collaborative creative meetings for geographically dispersed participants. Similar to real life, we rely on the use of quick drawings or sketches as a means of communication to convey new ideas, thoughts or other meta-data to other individuals. Furthermore, we concentrate on facilitating the (collaborative) interaction process through the use of four modalities. The first modality is direct manipulation, which is suitable for direct interaction with the networked environment. Secondly, we look at interaction through gesturing symbols in order not to distract the user's attention from the meeting. As a third modality we consider interaction through menu and widget manipulation. A fourth modality is established by a camera interface. We expect that the combination of the intuitive interface and the real-time visualisation of the virtual environment leads to a better understanding and realisation of one's ideas in an early phase of the cooperation.