Skip navigation
Logo
User training | Reference and search service

Library catalog

Retrievo
EDS
b-on
More
resources
Content aggregators
Please use this identifier to cite or link to this item:

acessibilidade

http://hdl.handle.net/10071/17048
acessibilidade
Title: A study on dialog act recognition using character-level tokenization
Authors: Ribeiro, E.
Ribeiro, R.
de Matos, D. M.
Editors: Gennady Agre, Josef van Genabith, Thierry Declerck
Keywords: Dialog act recognition
Character-level
Switchboard dialog act corpus
DIHANA corpus
Multilinguality
Issue Date: 2018
Publisher: Springer
Abstract: Dialog act recognition is an important step for dialog systems since it reveals the intention behind the uttered words. Most approaches on the task use word-level tokenization. In contrast, this paper explores the use of character-level tokenization. This is relevant since there is information at the sub-word level that is related to the function of the words and, thus, their intention. We also explore the use of different context windows around each token, which are able to capture important elements, such as affixes. Furthermore, we assess the importance of punctuation and capitalization. We performed experiments on both the Switchboard Dialog Act Corpus and the DIHANA Corpus. In both cases, the experiments not only show that character-level tokenization leads to better performance than the typical word-level approaches, but also that both approaches are able to capture complementary information. Thus, the best results are achieved by combining tokenization at both levels.
Peer reviewed: yes
URI: https://ciencia.iscte-iul.pt/id/ci-pub-52995
http://hdl.handle.net/10071/17048
DOI: 10.1007/978-3-319-99344-7_9
ISBN: 978-3-319-99343-0
ISSN: 0302-9743
Appears in Collections:CTI-CRI - Comunicações a conferências internacionais

Files in This Item:
acessibilidade
File Description SizeFormat 
1805.07231.pdfPós-print399.24 kBAdobe PDFView/Open


FacebookTwitterDeliciousLinkedInDiggGoogle BookmarksMySpace
Formato BibTex MendeleyEndnote Currículo DeGóis 

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.