Image-based gesture recognition for user interaction with mobile companion-based assistance systems

Author(s):  
Frerk Saxen ◽  
Omer Rashid ◽  
Ayoub Al-Hamadi ◽  
Simon Adler ◽  
Alexa Kernchen ◽  
...  
Author(s):  
Jeffrey Breugelmans ◽  
Yingzi Lin ◽  
Hua Cai

In recent years, the human-in-the-loop principle has been an emerging topic throughout the field of dynamic systems and control. Within this field, Human Assistance Systems (HAS) have become increasingly important and the driving environment, in particular, tends to play a distinctive role. Previous studies mainly aimed at making assistance systems as efficient as possible, reducing the possibility for errors (collisions) to a great extent. Due to this performance-oriented approach, however, former systems tend to take up the role of a strict supervisor, rather than that of a guide-like operator assistant. This research focuses on expanding the HAS’ contribution to the control loop by incorporating both the operator state and an additional assistance level into the system’s output behavior, thereby aiming to advance the systems in terms of user interaction and satisfaction. As a result, system efficiency will be maintained, while simultaneously sustaining the operator’s perceived level of control.


2013 ◽  
Vol 28 (2) ◽  
pp. 114-126 ◽  
Author(s):  
Heekyung Lee ◽  
Seong Yong Lim ◽  
Injae Lee ◽  
Jihun Cha ◽  
Dong-Chan Cho ◽  
...  

Author(s):  
Lei Wang ◽  
Xiang Zhang ◽  
Yuanshuang Jiang ◽  
Yong Zhang ◽  
Chenren Xu ◽  
...  

Gesture recognition on the back surface of mobile phone, not limited to the touch screen, is an enabling Human-Computer Interaction (HCI) mechanism which enriches the user interaction experiences. However, there are two main limitations in the existing Back-of-Device (BoD) gesture recognition systems. They can only handle coarse-grained gesture recognition such as tap detection and cannot avoid the air-borne propagation suffering from the interference in the air. In this paper, we propose StruGesture, a fine-grained gesture recognition system using the back of mobile phones with ultrasonic signals. The key technique is to use the structure-borne sounds (i.e., sound propagation via structure of the device) to recognize sliding gestures on the back of mobile phones. StruGesture can fully extract the structure-borne component from the hybrid Channel Impulse Response (CIR) based on Peak Selection Algorithm. We develop a deep adversarial learning architecture to learn the gesture-specific representation for robust and effective recognition. Extensive experiments are designed to evaluate the robustness over nine deployment scenarios. The results show that StruGesture outperforms the competitive state-of-the-art classifiers by achieving an average recognition accuracy of 99.5% over 10 gestures.


2016 ◽  
Vol 3 (2) ◽  
pp. 1
Author(s):  
Seong Jeong ◽  
HongJun Ju ◽  
Hyo-Rim Choi ◽  
TaeYong Kim

2017 ◽  
pp. 030-050
Author(s):  
J.V. Rogushina ◽  

Problems associated with the improve ment of information retrieval for open environment are considered and the need for it’s semantization is grounded. Thecurrent state and prospects of development of semantic search engines that are focused on the Web information resources processing are analysed, the criteria for the classification of such systems are reviewed. In this analysis the significant attention is paid to the semantic search use of ontologies that contain knowledge about the subject area and the search users. The sources of ontological knowledge and methods of their processing for the improvement of the search procedures are considered. Examples of semantic search systems that use structured query languages (eg, SPARQL), lists of keywords and queries in natural language are proposed. Such criteria for the classification of semantic search engines like architecture, coupling, transparency, user context, modification requests, ontology structure, etc. are considered. Different ways of support of semantic and otology based modification of user queries that improve the completeness and accuracy of the search are analyzed. On base of analysis of the properties of existing semantic search engines in terms of these criteria, the areas for further improvement of these systems are selected: the development of metasearch systems, semantic modification of user requests, the determination of an user-acceptable transparency level of the search procedures, flexibility of domain knowledge management tools, increasing productivity and scalability. In addition, the development of means of semantic Web search needs in use of some external knowledge base which contains knowledge about the domain of user information needs, and in providing the users with the ability to independent selection of knowledge that is used in the search process. There is necessary to take into account the history of user interaction with the retrieval system and the search context for personalization of the query results and their ordering in accordance with the user information needs. All these aspects were taken into account in the design and implementation of semantic search engine "MAIPS" that is based on an ontological model of users and resources cooperation into the Web.


2020 ◽  
Vol 79 (1) ◽  
pp. 47-57
Author(s):  
O. G. Viunytskyi ◽  
A. V. Totsky ◽  
Karen O. Egiazarian

Sign in / Sign up

Export Citation Format

Share Document