Accurate infrared tracking system for immersive virtual environments

Abstract

In large-scale immersive virtual reality VR environments, such as a CAVE, one of the most common problems is tracking the position of the user's head while he or she is immersed in this environment to reflect perspective changes in the synthetic stereoscopic images. In this paper, the authors describe the theoretical foundations and engineering approach adopted in the development of an infrared-optical tracking system designed for large scale immersive Virtual Environments VE or Augmented Reality AR settings. The system is capable of tracking independent retro-reflective markers arranged in a 3D structure in real time, recovering all possible 6DOF. These artefacts can be adjusted to the user's stereo glasses to track his or her head while immersed or used as a 3D input device for rich human-computer interaction HCI. The hardware configuration consists of 4 shutter-synchronized cameras attached with band-pass infrared filters and illuminated by infrared array-emitters. Pilot lab results have shown a latency of 40 ms when simultaneously tracking the pose of two artefacts with 4 infrared markers, achieving a frame-rate of 24.80 fps and showing a mean accuracy of 0.93mm/0.51ﾺ and a mean precision of 0.19mm/0.04ﾺ, respectively, in overall translation/rotation, fulfilling the requirements initially defined.