Using hand gesture and speech in a multimodal augmented reality environment

Abstract

In this work we describe a 3D authoring tool which takes advantage of multimodal interfaces such as gestures and speech. This tool allows real-time Augmented Reality aimed to aid the tasks of interior architects and designers. This approach intends to be an alternative to traditional techniques. The main benefit of using a multimodal-based augmented reality system is the provision of a more transparent, flexible, efficient and expressive means of human-computer interaction.