Designing gaze-supported multimodal interactions for the exploration of large image collections

2011 ◽  
Author(s):  
Sophie Stellmach ◽  
Sebastian Stober ◽  
Andreas Nürnberger ◽  
Raimund Dachselt
Keyword(s):  
Multimodal Interactions

scholarly journals EREBOTS: Privacy-Compliant Agent-Based Platform for Multi-Scenario Personalized Health-Assistant Chatbots

Electronics ◽  
2021 ◽  
Vol 10 (6) ◽  
pp. 666
Author(s):  
Davide Calvaresi ◽  
Jean-Paul Calbimonte ◽  
Enrico Siboni ◽  
Stefan Eggenschwiler ◽  
Gaetano Manzo ◽  
...  
Keyword(s):  
Breast Cancer Survivors ◽  
Physical Conditioning ◽  
Privacy Management ◽  
Web Interface ◽  
Agent Based ◽  
Multimodal Interactions ◽  
Physical Exercises ◽  
Health Related ◽  
Health Assistant ◽  
Personalized Health

Context. Asynchronous messaging is increasingly used to support human–machine interactions, generally implemented through chatbots. Such virtual entities assist the users in activities of different kinds (e.g., work, leisure, and health-related) and are becoming ingrained into humans’ habits due to factors including (i) the availability of mobile devices such as smartphones and tablets, (ii) the increasingly engaging nature of chatbot interactions, (iii) the release of dedicated APIs from messaging platforms, and (iv) increasingly complex AI-based mechanisms to power the bots’ behaviors. Nevertheless, most of the modern chatbots rely on state machines (implementing conversational rules) and one-fits-all approaches, neglecting personalization, data-stream privacy management, multi-topic management/interconnection, and multimodal interactions. Objective. This work addresses the challenges above through an agent-based framework for chatbot development named EREBOTS. Methods. The foundations of the framework are based on the implementation of (i) multi-front-end connectors and interfaces (i.e., Telegram, dedicated App, and web interface), (ii) enabling the configuration of multi-scenario behaviors (i.e., preventive physical conditioning, smoking cessation, and support for breast-cancer survivors), (iii) online learning, (iv) personalized conversations and recommendations (i.e., mood boost, anti-craving persuasion, and balance-preserving physical exercises), and (v) responsive multi-device monitoring interface (i.e., doctor and admin). Results. EREBOTS has been tested in the context of physical balance preservation in social confinement times (due to the ongoing pandemic). Thirteen individuals characterized by diverse age, gender, and country distribution have actively participated in the experimentation, reporting advancements in the physical balance and overall satisfaction of the interaction and exercises’ variety they have been proposed.

scholarly journals Self-Assembly of a Designed Nucleoprotein Architecture through Multimodal Interactions

2018 ◽  
Vol 4 (11) ◽  
pp. 1578-1586 ◽  
Author(s):  
Rohit H. Subramanian ◽  
Sarah J. Smith ◽  
Robert G. Alberstein ◽  
Jake B. Bailey ◽  
Ling Zhang ◽  
...  
Keyword(s):  
Self Assembly ◽  
Multimodal Interactions

scholarly journals THE ROLE OF VIDEO CONFERENCING IN FOREIGN LANGUAGE LEARNING AMONG YOUNG STUDENTS

2021 ◽  
Vol 9 (1) ◽  
pp. 493-497
Author(s):  
Branko Medic
Keyword(s):  
Foreign Language ◽  
Language Learning ◽  
Language Learners ◽  
Resistance To Change ◽  
Video Conferencing ◽  
Foreign Language Learning ◽  
Language Education ◽  
Foreign Language Education ◽  
Philip Pullman ◽  
Multimodal Interactions

During the coronavirus pandemic research on video conferencing effects on young language learners is more than ever relevant. During the sharp transition, educators need to fully understand the benefits and possible pitfalls of video conferencing, but also overcome resistance to change through knowledge. As author Philip Pullman rightly points out, “You cannot change what you are, only what you do.” This article summarised key research and provided evidence for and against the use of video conferencing in foreign language education. Thus, it gives food for thought and reflection, as well as directions for possible interventions.  However, the research was limited in terms of time and available literature, and the topic certainly requires more attention. In future, it is recommended to further research the use of multimodal interactions (sound, audio, text) in video conferencing, as well as coping strategies for dealing with the lack of interaction in the video conferencing-enabled classroom.

Voice-Enabled User Interfaces for Mobile Devices

2009 ◽  
pp. 3494-3510
Author(s):  
Louise E. Moser ◽  
P. M. Melliar-Smith
Keyword(s):  
Mobile Device ◽  
User Interfaces ◽  
Prototype System ◽  
Voice Input ◽  
Voice Mail ◽  
Weather Information ◽  
Multimodal Interactions ◽  
Program Manager ◽  
Voice Interaction ◽  
Client Side

The use of a voice interface; along with textual; graphical; video; tactile; and audio interfaces; can improve the experience of the user of a mobile device. Many applications can benefit from voice input and output on a mobile device; including applications that provide travel directions; weather information; restaurant and hotel reservations; appointments and reminders; voice mail; and e-mail. We have developed a prototype system for a mobile device that supports client-side; voice-enabled applications. In fact; the prototype supports multimodal interactions but; here; we focus on voice interaction. The prototype includes six voice-enabled applications and a program manager that manages the applications. In this chapter we describe the prototype; including design issues that we faced; and evaluation methods that we employed in developing a voice-enabled user interface for a mobile device.

Sign in / Sign up

Export Citation Format

Share Document