An optical tracking system for the integration of input devices into head-mounted virtual reality environments using commodity hardware

Abstract

The aim of this thesis is to provide a tracking method for the user to track their input device while using a head-mounted virtual reality display. Most currently available tracking solutions use expensive hardware unavailable to the average consumer, are specific to a single input device or are incapable of keeping up with the higher refresh rate required of virtual reality applications. The LeapTrack tracking system developed in this thesis seeks to remedy this with an inside-looking-out infra-red stereo tracking solution using commodity hardware, allowing the users to find their input device without breaking immersion. This thesis first presents a brief introduction on virtual reality and its benefits, and then examines previous work that is related to the problem caused by the lack of vision while using a head-mounted virtual reality display. Following this, an overview of the techniques and hardware used in the LeapTrack tracking system is provided before presenting an implementation of said techniques in the Unity game engine. Finally a user study is conducted to evaluate the impact of LeapTrack on the ability to locate a peripheral device and the level of immersion of the user. The results of this user study show that users respond positively to the presence of LeapTrack, increasing their accuracy when attempting to pick up the tracked peripheral while minimizing the negative impact on immersion.