scholarly journals Use Learnable Knowledge Graph in Dialogue System for Visually Impaired Macro Navigation

2021 ◽  
Vol 11 (13) ◽  
pp. 6057
Author(s):  
Ching-Han Chen ◽  
Ming-Fang Shiu ◽  
Shu-Hui Chen
Keyword(s):  
Natural Language ◽  
Human Computer Interaction ◽  
Navigation System ◽  
Visually Impaired ◽  
Knowledge Graph ◽  
Dialogue System ◽  
Natural Language Dialogue ◽  
Communication Method ◽  
Main Subsystem ◽  
Computer Interaction

Dialogue in natural language is the most important communication method for the visually impaired. Therefore, the dialogue system is the main subsystem in the visually impaired navigation system. The purpose of the dialogue system is to understand the user’s intention, gradually establish context through multiple conversations, and finally provide an accurate destination for the navigation system. We use the knowledge graph as the basis of reasoning in the dialogue system, and then update the knowledge graph so that the system gradually conforms to the user’s background. Based on the experience of using the knowledge graph in the navigation system of the visually impaired, we expect that the same framework can be applied to more fields in order to improve the practicality of natural language dialogue in human–computer interaction.

Human-computer interaction through natural language and hypermedia in AlFresco

1996 ◽  
Vol 28 (3) ◽  
pp. 102-107 ◽  
Author(s):  
Oliviero Stock ◽  
Carlo Strapparava ◽  
Massimo Zancanaro
Keyword(s):  
Natural Language ◽  
Human Computer Interaction ◽  
Computer Interaction

scholarly journals End-to-End Knowledge-Routed Relational Dialogue System for Automatic Diagnosis

2019 ◽  
Vol 33 ◽  
pp. 7346-7353
Author(s):  
Lin Xu ◽  
Qixian Zhou ◽  
Ke Gong ◽  
Xiaodan Liang ◽  
Jianheng Tang ◽  
...  
Keyword(s):  
Natural Language ◽  
Medical Diagnosis ◽  
Expert Knowledge ◽  
Medical Knowledge ◽  
Knowledge Graph ◽  
Dialogue Systems ◽  
Dialogue System ◽  
Self Reports ◽  
Medical Dialogue ◽  
End To End

Beyond current conversational chatbots or task-oriented dialogue systems that have attracted increasing attention, we move forward to develop a dialogue system for automatic medical diagnosis that converses with patients to collect additional symptoms beyond their self-reports and automatically makes a diagnosis. Besides the challenges for conversational dialogue systems (e.g. topic transition coherency and question understanding), automatic medical diagnosis further poses more critical requirements for the dialogue rationality in the context of medical knowledge and symptom-disease relations. Existing dialogue systems (Madotto, Wu, and Fung 2018; Wei et al. 2018; Li et al. 2017) mostly rely on datadriven learning and cannot be able to encode extra expert knowledge graph. In this work, we propose an End-to-End Knowledge-routed Relational Dialogue System (KR-DS) that seamlessly incorporates rich medical knowledge graph into the topic transition in dialogue management, and makes it cooperative with natural language understanding and natural language generation. A novel Knowledge-routed Deep Q-network (KR-DQN) is introduced to manage topic transitions, which integrates a relational refinement branch for encoding relations among different symptoms and symptomdisease pairs, and a knowledge-routed graph branch for topic decision-making. Extensive experiments on a public medical dialogue dataset show our KR-DS significantly beats stateof-the-art methods (by more than 8% in diagnosis accuracy). We further show the superiority of our KR-DS on a newly collected medical dialogue system dataset, which is more challenging retaining original self-reports and conversational data between patients and doctors.

Sign in / Sign up

Export Citation Format

Share Document