scholarly journals Semantic Fusion for Natural Multimodal Interfaces using Concurrent Augmented Transition Networks

2018 ◽  
Vol 2 (4) ◽  
pp. 81 ◽  
Author(s):  
Chris Zimmerer ◽  
Martin Fischbach ◽  
Marc Latoschik
Keyword(s):  
User Interfaces ◽  
Rapid Development ◽  
Multimodal Interfaces ◽  
Learning Approaches ◽  
Lexical Information ◽  
Require Time ◽  
Finite State ◽  
Reference Implementation ◽  
Transition Network ◽  
Transition Networks

Semantic fusion is a central requirement of many multimodal interfaces. Procedural methods like finite-state transducers and augmented transition networks have proven to be beneficial to implement semantic fusion. They are compliant with rapid development cycles that are common for the development of user interfaces, in contrast to machine-learning approaches that require time-costly training and optimization. We identify seven fundamental requirements for the implementation of semantic fusion: Action derivation, continuous feedback, context-sensitivity, temporal relation support, access to the interaction context, as well as the support of chronologically unsorted and probabilistic input. A subsequent analysis reveals, however, that there is currently no solution for fulfilling the latter two requirements. As the main contribution of this article, we thus present the Concurrent Cursor concept to compensate these shortcomings. In addition, we showcase a reference implementation, the Concurrent Augmented Transition Network (cATN), that validates the concept’s feasibility in a series of proof of concept demonstrations as well as through a comparative benchmark. The cATN fulfills all identified requirements and fills the lack amongst previous solutions. It supports the rapid prototyping of multimodal interfaces by means of five concrete traits: Its declarative nature, the recursiveness of the underlying transition network, the network abstraction constructs of its description language, the utilized semantic queries, and an abstraction layer for lexical information. Our reference implementation was and is used in various student projects, theses, as well as master-level courses. It is openly available and showcases that non-experts can effectively implement multimodal interfaces, even for non-trivial applications in mixed and virtual reality.

scholarly journals An Intelligent Task Scheduling Mechanism for Autonomous Vehicles via Deep Learning

Energies ◽  
2021 ◽  
Vol 14 (6) ◽  
pp. 1788
Author(s):  
Gomatheeshwari Balasekaran ◽  
Selvakumar Jayakumar ◽  
Rocío Pérez de Prado
Keyword(s):  
Execution Time ◽  
Autonomous Vehicles ◽  
Rapid Development ◽  
Single Layer ◽  
Battery Life ◽  
Learning Approaches ◽  
Task Management ◽  
Inference System ◽  
Safe Driving ◽  
Self Driving Cars

With the rapid development of the Internet of Things (IoT) and artificial intelligence, autonomous vehicles have received much attention in recent years. Safe driving is one of the essential concerns of self-driving cars. The main problem in providing better safe driving requires an efficient inference system for real-time task management and autonomous control. Due to limited battery life and computing power, reducing execution time and resource consumption can be a daunting process. This paper addressed these challenges and developed an intelligent task management system for IoT-based autonomous vehicles. For each task processing, a supervised resource predictor is invoked for optimal hardware cluster selection. Tasks are executed based on the earliest hyper period first (EHF) scheduler to achieve optimal task error rate and schedule length performance. The single-layer feedforward neural network (SLFN) and lightweight learning approaches are designed to distribute each task to the appropriate processor based on their emergency and CPU utilization. We developed this intelligent task management module in python and experimentally tested it on multicore SoCs (Odroid Xu4 and NVIDIA Jetson embedded platforms).Connected Autonomous Vehicles (CAV) and Internet of Medical Things (IoMT) benchmarks are used for training and testing purposes. The proposed modules are validated by observing the task miss rate, resource utilization, and energy consumption metrics compared with state-of-art heuristics. SLFN-EHF task scheduler achieved better results in an average of 98% accuracy, and in an average of 20–27% reduced in execution time and 32–45% in task miss rate metric than conventional methods.

A framework for programmatically designing user interfaces in JavaScript

2015 ◽  
Vol 11 (3) ◽  
pp. 254-269
Author(s):  
Henry Larkin
Keyword(s):  
User Interface ◽  
User Interfaces ◽  
Design Methodology ◽  
Rapid Development ◽  
Program Code ◽  
Web Based ◽  
Content Type ◽  
Mobile Web ◽  
Mobile Interfaces ◽  
New Framework

Purpose – The purpose of this paper is to investigate the feasibility of creating a declarative user interface language suitable for rapid prototyping of mobile and Web apps. Moreover, this paper presents a new framework for creating responsive user interfaces using JavaScript. Design/methodology/approach – Very little existing research has been done in JavaScript-specific declarative user interface (UI) languages for mobile Web apps. This paper introduces a new framework, along with several case studies that create modern responsive designs programmatically. Findings – The fully implemented prototype verifies the feasibility of a JavaScript-based declarative user interface library. This paper demonstrates that existing solutions are unwieldy and cumbersome to dynamically create and adjust nodes within a visual syntax of program code. Originality/value – This paper presents the Guix.js platform, a declarative UI library for rapid development of Web-based mobile interfaces in JavaScript.

The Rapid Development of User Interfaces: Experience with the Wizard of OZ Method

1985 ◽  
Vol 29 (5) ◽  
pp. 470-474 ◽  
Author(s):  
Paul Green ◽  
Lisa Wei-Haas
Keyword(s):  
Personal Computer ◽  
User Interfaces ◽  
Rapid Development ◽  
User Interaction ◽  
Wizard Of Oz ◽  
Iterative Development ◽  
The Subject ◽  
Two Machines ◽  
User Queries

The Wizard of Oz technique is an efficient way to examine user interaction with computers and facilitate rapid iterative development of dialog wording and logic. The technique requires two machines linked together, one for the subject and one for the experimenter. In this implementation the experimenter (the “Wizard”), pretending to be a computer, types in complete replies to user queries or presses function keys to which common messages have been assigned (e.g., Fl=“Help is not available”). The software automatically records the dialog and its timing. This paper provides a detailed description of the first implementation of the Oz paradigm for the IBM Personal Computer. It also includes application guidelines, information which is currently missing from the literature.

scholarly journals Graph Learning based Recommender Systems: A Review

2021 ◽  
Author(s):  
Shoujin Wang ◽  
Liang Hu ◽  
Yan Wang ◽  
Xiangnan He ◽  
Quan Z. Sheng ◽  
...  
Keyword(s):  
Systematic Review ◽  
Recommender Systems ◽  
Rapid Development ◽  
Research Area ◽  
Learning Approaches ◽  
Graph Learning ◽  
Promising Direction ◽  
Learning Techniques ◽  
Fast Development ◽  
Content Based Filtering

Recent years have witnessed the fast development of the emerging topic of Graph Learning based Recommender Systems (GLRS). GLRS mainly employ advanced graph learning approaches to model users’ preferences and intentions as well as items’ characteristics and popularity for Recommender Systems (RS). Differently from other approaches, including content based filtering and collaborative filtering, GLRS are built on graphs where the important objects, e.g., users, items, and attributes, are either explicitly or implicitly connected. With the rapid development of graph learning techniques, exploring and exploiting homogeneous or heterogeneous relations in graphs is a promising direction for building more effective RS. In this paper, we provide a systematic review of GLRS, by discussing how they extract knowledge from graphs to improve the accuracy, reliability and explainability of the recommendations. First, we characterize and formalize GLRS, and then summarize and categorize the key challenges and main progress in this novel research area.

scholarly journals Peran Kepemimpinan Kiai di Pendidikan Pesantren dalam Menghadapi Revolusi Industri 4.0

2020 ◽  
Vol 11 (1) ◽  
pp. 21-34
Author(s):  
Sulaiman Sulaiman ◽  
Asnawan Asnawan
Keyword(s):  
Information Technology ◽  
Industrial Revolution ◽  
Technology Development ◽  
Rapid Development ◽  
National Character ◽  
Learning Approaches ◽  
Religious Knowledge ◽  
Information Technology Development ◽  
The Times

This paper discusses the role of the kiai's leadership in pesantren education in an effort to strengthen the Industrial Revolution 4.0 industry. Pesantren is an ideal education system that attempts to provide education to the community to develop the existing potential, because pesantren santri in pesantren are not only given religious knowledge, santri are also taught to live independently, have character and innovate through pesantren activities. The pesantren is one of the institutions of Islamic education that will produce a generation of Indonesians into 'ulama', Muslim scholars and generations who have national character and morality. In the current era of information technology development, learning approaches have experienced rapid development that can change people's mindsets. The availability of information technology that is connected to the internet makes it easy for everyone to access science. So that pesantren must also be able to actualize these developments by developing pesantren curricula that are in accordance with the needs of the times. Then what is the role of pesantren in facing the development of globalization, what strategies are suitable in dealing with generations of the millennial era.

scholarly journals Adapting the unified software development process for user interface development

2006 ◽  
Vol 3 (1) ◽  
pp. 33-52 ◽  
Author(s):  
Zeljko Obrenovic ◽  
Dusan Starcevic
Keyword(s):  
User Interface ◽  
Human Computer Interaction ◽  
User Interfaces ◽  
Multimodal Interfaces ◽  
Software Developers ◽  
Software Engineers ◽  
Unified Process ◽  
Uml Models ◽  
Computer Interaction

In this paper we describe how existing software developing processes, such as Rational Unified Process, can be adapted in order to allow disciplined and more efficient development of user interfaces. The main objective of this paper is to demonstrate that standard modeling environments, based on the UML, can be adapted and efficiently used for user interfaces development. We have integrated the HCI knowledge into developing processes by semantically enriching the models created in each of the process activities of the process. By using UML, we can make easier use of HCI knowledge for ordinary software engineers who, usually, are not familiar with results of HCI researches, so these results can have broader and more practical effects. By providing a standard means for representing human computer interaction, we can seamlessly transfer UML models of multimodal interfaces between design and specialized analysis tools. Standardization provides a significant driving force for further progress because it codifies best practices enables and encourages reuse, and facilitates inter working between complementary tools. Proposed solutions can be valuable for software developers, who can improve quality of user interfaces and their communication with user interface designers, as well as for human computer interaction researchers, who can use standard methods to include their results into software developing processes.

scholarly journals Comparing Deep-Learning Architectures and Traditional Machine-Learning Approaches for Satire Identification in Spanish Tweets

Mathematics ◽  
2020 ◽  
Vol 8 (11) ◽  
pp. 2075
Author(s):  
Óscar Apolinario-Arzube ◽  
José Antonio García-Díaz ◽  
José Medina-Moreira ◽  
Harry Luna-Aveiga ◽  
Rafael Valencia-García
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
User Interfaces ◽  
State Of The Art ◽  
Learning Approaches ◽  
Word Embeddings ◽  
Linguistic Features ◽  
Intended Meaning ◽  
Language User ◽  
Learning Architectures

Automatic satire identification can help to identify texts in which the intended meaning differs from the literal meaning, improving tasks such as sentiment analysis, fake news detection or natural-language user interfaces. Typically, satire identification is performed by training a supervised classifier for finding linguistic clues that can determine whether a text is satirical or not. For this, the state-of-the-art relies on neural networks fed with word embeddings that are capable of learning interesting characteristics regarding the way humans communicate. However, as far as our knowledge goes, there are no comprehensive studies that evaluate these techniques in Spanish in the satire identification domain. Consequently, in this work we evaluate several deep-learning architectures with Spanish pre-trained word-embeddings and compare the results with strong baselines based on term-counting features. This evaluation is performed with two datasets that contain satirical and non-satirical tweets written in two Spanish variants: European Spanish and Mexican Spanish. Our experimentation revealed that term-counting features achieved similar results to deep-learning approaches based on word-embeddings, both outperforming previous results based on linguistic features. Our results suggest that term-counting features and traditional machine learning models provide competitive results regarding automatic satire identification, slightly outperforming state-of-the-art models.

Clustering of Web Application and Testing of Asynchronous Communication

2019 ◽  
Vol 10 (3) ◽  
pp. 33-59
Author(s):  
Sonali Pradhan ◽  
Mitrabinda Ray ◽  
Srikanta Patnaik
Keyword(s):  
User Interfaces ◽  
Web Application ◽  
Asynchronous Communication ◽  
Web Pages ◽  
Test Cases ◽  
Input Output ◽  
Model Based Testing ◽  
Finite State ◽  
Asynchronous Javascript And Xml ◽  
Logical Functions

In model-based testing, testing is done using Input Output Transition System (IOTS) or Finite State Machine (FSM). In synchronous testing, it is easy to know the proper sequence of input output of the system under testing, whereas, in asynchronous communication, it is tough to trace the sequences of inputs and outputs. A web application is an example of asynchronous processing, in which input/output queue management is a common issue for testing in asynchronous JavaScript and XML user interfaces. This article discusses asynchronous testing of web application by taking a Gmail account as a case study. In this article, the web application is partitioned into clusters by determining logical web pages that implement logical functions. The clusters of page objects are represented using finite state machines. From the FSMs, test scenarios are generated. The size of the test cases covering longer paths is decreased by making clusters of states. The authors conduct a queue analysis using a test architecture to investigate the behavior of the system under testing. Finally, the test cases are generated using the Selenium tool.

Gender Differences in User Satisfaction of Mobile Touch Screen Interfaces: University Students’ Service Sites

2018 ◽  
Vol 15 (06) ◽  
pp. 1950003
Author(s):  
Ayman N. Alkhaldi ◽  
Ahmed Al-Sa’di
Keyword(s):  
User Interfaces ◽  
User Satisfaction ◽  
Quantitative Research ◽  
Service Providers ◽  
Rapid Development ◽  
Mobile User ◽  
Learning System ◽  
Mobile Service ◽  
Online Help ◽  
Future Work

The rapid development of mobile user interfaces for students’ websites and the constant utilization of such interfaces by students have witnessed a significant upsurge in growth. However, mobile service providers may lack valuable feedback on user satisfaction, particularly for Arabic users, because the sites are designed and implemented without students’ participation. This paper empirically investigates the user satisfaction of a mobile banner system for the University of Ha’il in Saudi Arabia. Users’ satisfaction was evaluated across six scales: overall reactions, screens, terminology and system information, learning, system capabilities, and technical manuals and online help. A quantitative research method was utilized, involving a questionnaire survey of 235 students. We found that female students have significant concerns about user satisfaction. The paper proposes theoretical and practical implications for future work.

Research on the GUI Testing Based on the Bayesian Network Model

2014 ◽  
Vol 602-605 ◽  
pp. 1946-1949
Author(s):  
Zhi Fang Yang ◽  
San Xing Yang ◽  
Bei Bei Yin ◽  
Cheng Gang Bai
Keyword(s):  
User Interfaces ◽  
Bayesian Model ◽  
Rapid Development ◽  
Graphical User Interfaces ◽  
Bayesian Network Model ◽  
Gui Testing ◽  
Testing Method ◽  
Modeling Process ◽  
Key Issues ◽  
Model Topology

Graphical User Interfaces (GUI) is becoming increasingly important in the software field, while GUI testing is becoming the key issues restricting GUI rapid development. GUI testing mainly serves two goals: to establish confidence in assessment of GUI and find more software defects in GUI testing. For this purpose, any testing method must be better at detecting defects. However, GUI testing is faced with many challenges due to the immense number of event interactions. In this paper, it introduces a Bayesian model guiding the process of GUI testing, discusses the Bayesian model topology and its issues encountered in the modeling process. In the end, a case reveals the validity of the GUI testing model.

Sign in / Sign up

Export Citation Format

Share Document