The 3rd Workshop on NLP for Conversational AI co-located with EMNLP 2021 にて,東中研究室から研究員の郭が発表を行いました.
Ao Guo, Atsumoto Ohashi, Ryu Hirai, Yuya Chiba, Yuiko Tsunomori, Ryuichiro Higashinaka
Influence of user personality on dialogue task performance: A case study using a rule-based dialogue system Proceedings Article
In: 3rd Workshop on NLP for ConvAI, pp. 263–270, 2021.
@inproceedings{2021guoinfluence,
title = {Influence of user personality on dialogue task performance: A case study using a rule-based dialogue system},
author = {Ao Guo and Atsumoto Ohashi and Ryu Hirai and Yuya Chiba and Yuiko Tsunomori and Ryuichiro Higashinaka},
url = {https://aclanthology.org/2021.nlp4convai-1.25.pdf},
year = {2021},
date = {2021-11-10},
urldate = {2021-11-05},
booktitle = {3rd Workshop on NLP for ConvAI},
pages = {263–270},
abstract = {Endowing a task-oriented dialogue system with adaptiveness to user personality can greatly help improve the performance of a dialogue task. However, such a dialogue system can be practically challenging to implement, because it is unclear how user personality influences dialogue task performance. To explore the relationship between user personality and dialogue task performance, we enrolled participants via crowdsourcing to first answer specified personality questionnaires and then chat with a dialogue system to accomplish assigned tasks. A rule-based dialogue system on the prevalent Multi-Domain Wizard-of-Oz (MultiWOZ) task was used. A total of 211 participants’ personalities and their 633 dialogues were collected and analyzed. The results revealed that sociable and extroverted people tended to fail the task, whereas neurotic people were more likely to succeed. We extracted features related to user dialogue behaviors and performed further analysis to determine which kind of behavior influences task performance. As a result, we identified that average utterance length and slots per utterance are the key features of dialogue behavior that are highly correlated with both task performance and user personality.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Endowing a task-oriented dialogue system with adaptiveness to user personality can greatly help improve the performance of a dialogue task. However, such a dialogue system can be practically challenging to implement, because it is unclear how user personality influences dialogue task performance. To explore the relationship between user personality and dialogue task performance, we enrolled participants via crowdsourcing to first answer specified personality questionnaires and then chat with a dialogue system to accomplish assigned tasks. A rule-based dialogue system on the prevalent Multi-Domain Wizard-of-Oz (MultiWOZ) task was used. A total of 211 participants’ personalities and their 633 dialogues were collected and analyzed. The results revealed that sociable and extroverted people tended to fail the task, whereas neurotic people were more likely to succeed. We extracted features related to user dialogue behaviors and performed further analysis to determine which kind of behavior influences task performance. As a result, we identified that average utterance length and slots per utterance are the key features of dialogue behavior that are highly correlated with both task performance and user personality.