Please use this identifier to cite or link to this item:
http://hdl.handle.net/10071/16329
Author(s): | Pascoal, R. Ribeiro, R. Batista, F. de Almeida, A. |
Date: | 2017 |
Title: | Adapting speech recognition in augmented reality for mobile devices in outdoor environments |
Volume: | 56 |
ISSN: | 2190-6807 |
ISBN: | 978-3-95977-056-9 |
DOI (Digital Object Identifier): | 10.4230/OASIcs.SLATE.2017.21 |
Keywords: | Speech recognition Natural language processing Sphinx for mobile devices Augmented reality Outdoor environments |
Abstract: | This paper describes the process of integrating automatic speech recognition (ASR) into a mobile application and explores the benefits and challenges of integrating speech with augmented reality (AR) in outdoor environments. The augmented reality allows end-users to interact with the information displayed and perform tasks, while increasing the user’s perception about the real world by adding virtual information to it. Speech is the most natural way of communication: it allows hands-free interaction and may allow end-users to quickly and easily access a range of features available. Speech recognition technology is often available in most of the current mobile devices, but it often uses Internet to receive the corresponding transcript from remote servers, e.g., Google speech recognition. However, in some outdoor environments, Internet is not always available or may be offered at poor quality. We integrated an off-line automatic speech recognition module into an AR application for outdoor usage that does not require Internet. Currently, speech interaction is used within the application to access five different features, namely: to take a photo, shoot a film, communicate, messaging related tasks, and to request information, either geographic, biometric, or climatic. The application makes available solutions to manage and interact with the mobile device, offering good usability. We have compared the online and off-line speech recognition systems in order to assess their adequacy to the tasks. Both systems were tested under different conditions, commonly found in outdoor environments, such as: Internet access quality, presence of noise, and distractions. |
Peerreviewed: | yes |
Access type: | Open Access |
Appears in Collections: | ISTAR-CRI - Comunicações a conferências internacionais |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Pascoal 2017 - Adapting Speech Recognition in Augmented Reality.pdf | 1,76 MB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.