Information
論文タイトル：Analysis of Relation between Facial Emotions and Comprehension Level in Listening
著者：Yoko Nishihara, Seina Hiramichi, and Junjie Shan
概要：
Speaking in a way others can comprehend is essential when communicating with others. If people realize that the other does not understand what they say by observing their expressions, they can use easier words and give examples, which achieves good communication. The authors argue that people can tell whether they are being comprehended by looking at the other’s face. Therefore, this study focuses on facial emotions and explores whether there is a relation between facial emotions and comprehension level while listening to other. In this study, the authors implemented a user interface that estimates human emotions from facial images using FER (Facial Emotion Recognition). The implemented user interface detects facial area of a frame and outputted the distribution of likelihoods of seven emotions. The authors examined the above assumption, conducted experiments with participants and analyzed the experimental data. The experiment measured participants’ facial emotions while taking English listening tests of two difficulty levels (easy and hard). The distributions of seven emotion likelihoods were analyzed. Experimental results showed that when they had the easy listening test, they expressed neutral emotion if they comprehended it. However, they expressed other emotion (sad) if they could not comprehend it. In contrast, when they had the difficult listening test, they expressed the emotion sad if they did not comprehended it. However, they expressed neutral emotion if they gave up comprehension.
書誌情報：HCII2024
発表日：2024年7月2日