Study on Text-based and Voice-based Dialogue Interfaces for Human-Computer Interactions in a Blocks World

Design Thinking for Gesture-based Human Computer Interactions

International Journal of Computer Sciences and Engineering ◽

10.26438/ijcse/v7i3.919925 ◽

2019 ◽

Vol 7 (3) ◽

pp. 919-925

Author(s):

Kelvin Wambani Siovi ◽

Cheruiyot Willison Kipruto ◽

Agnes Mindila

Keyword(s):

Design Thinking ◽

Human Computer Interactions ◽

Computer Interactions

Download Full-text

Detection of User Escalation in Human-Computer Interactions

10.21437/interspeech.2016-535 ◽

2016 ◽

Cited By ~ 1

Author(s):

Ian Beaver ◽

Cynthia Freeman

Keyword(s):

Human Computer Interactions ◽

Computer Interactions

Download Full-text

Multimodal emotion recognition with hierarchical memory networks

Intelligent Data Analysis ◽

10.3233/ida-205183 ◽

2021 ◽

Vol 25 (4) ◽

pp. 1031-1045

Author(s):

Helang Lai ◽

Keke Wu ◽

Lingli Li

Keyword(s):

Emotion Recognition ◽

The Self ◽

Global Memory ◽

Human Computer Interactions ◽

Accuracy Improvement ◽

Local Memory ◽

Hierarchical Memory ◽

Multimodal Emotion Recognition ◽

Novel Model ◽

Computer Interactions

Emotion recognition in conversations is crucial as there is an urgent need to improve the overall experience of human-computer interactions. A promising improvement in this field is to develop a model that can effectively extract adequate contexts of a test utterance. We introduce a novel model, termed hierarchical memory networks (HMN), to address the issues of recognizing utterance level emotions. HMN divides the contexts into different aspects and employs different step lengths to represent the weights of these aspects. To model the self dependencies, HMN takes independent local memory networks to model these aspects. Further, to capture the interpersonal dependencies, HMN employs global memory networks to integrate the local outputs into global storages. Such storages can generate contextual summaries and help to find the emotional dependent utterance that is most relevant to the test utterance. With an attention-based multi-hops scheme, these storages are then merged with the test utterance using an addition operation in the iterations. Experiments on the IEMOCAP dataset show our model outperforms the compared methods with accuracy improvement.

Download Full-text

Building an Emotionally Responsive Avatar with Dynamic Facial Expressions in Human—Computer Interactions

Multimodal Technologies and Interaction ◽

10.3390/mti5030013 ◽

2021 ◽

Vol 5 (3) ◽

pp. 13

Author(s):

Heting Wang ◽

Vidya Gaddy ◽

James Ross Beveridge ◽

Francisco R. Ortega

Keyword(s):

Facial Expressions ◽

Descriptive Analysis ◽

Uncanny Valley ◽

Human Computer Interactions ◽

Basic Emotions ◽

Subjective Responses ◽

Dynamic Facial Expressions ◽

Nasa Tlx ◽

Computer Interactions

The role of affect has been long studied in human–computer interactions. Unlike previous studies that focused on seven basic emotions, an avatar named Diana was introduced who expresses a higher level of emotional intelligence. To adapt to the users various affects during interaction, Diana simulates emotions with dynamic facial expressions. When two people collaborated to build blocks, their affects were recognized and labeled using the Affdex SDK and a descriptive analysis was provided. When participants turned to collaborate with Diana, their subjective responses were collected and the length of completion was recorded. Three modes of Diana were involved: a flat-faced Diana, a Diana that used mimicry facial expressions, and a Diana that used emotionally responsive facial expressions. Twenty-one responses were collected through a five-point Likert scale questionnaire and the NASA TLX. Results from questionnaires were not statistically different. However, the emotionally responsive Diana obtained more positive responses, and people spent the longest time with the mimicry Diana. In post-study comments, most participants perceived facial expressions on Diana’s face as natural, four mentioned uncomfortable feelings caused by the Uncanny Valley effect.

Download Full-text