Utilize este identificador para referenciar este registo:
http://hdl.handle.net/10071/17048
Autoria: | Ribeiro, E. Ribeiro, R. de Matos, D. M. |
Editor: | Gennady Agre, Josef van Genabith, Thierry Declerck |
Data: | 2018 |
Título próprio: | A study on dialog act recognition using character-level tokenization |
Volume: | 11089 |
Paginação: | 93 - 103 |
ISSN: | 0302-9743 |
ISBN: | 978-3-319-99343-0 |
DOI (Digital Object Identifier): | 10.1007/978-3-319-99344-7_9 |
Palavras-chave: | Dialog act recognition Character-level Switchboard dialog act corpus DIHANA corpus Multilinguality |
Resumo: | Dialog act recognition is an important step for dialog systems since it reveals the intention behind the uttered words. Most approaches on the task use word-level tokenization. In contrast, this paper explores the use of character-level tokenization. This is relevant since there is information at the sub-word level that is related to the function of the words and, thus, their intention. We also explore the use of different context windows around each token, which are able to capture important elements, such as affixes. Furthermore, we assess the importance of punctuation and capitalization. We performed experiments on both the Switchboard Dialog Act Corpus and the DIHANA Corpus. In both cases, the experiments not only show that character-level tokenization leads to better performance than the typical word-level approaches, but also that both approaches are able to capture complementary information. Thus, the best results are achieved by combining tokenization at both levels. |
Arbitragem científica: | yes |
Acesso: | Acesso Aberto |
Aparece nas coleções: | CTI-CRI - Comunicações a conferências internacionais |
Ficheiros deste registo:
Ficheiro | Descrição | Tamanho | Formato | |
---|---|---|---|---|
1805.07231.pdf | Pós-print | 399,24 kB | Adobe PDF | Ver/Abrir |
Todos os registos no repositório estão protegidos por leis de copyright, com todos os direitos reservados.