scholarly journals How Many Participants Are Required for Validation of Automated Vehicle Interfaces in User Studies?

Information ◽  
2021 ◽  
Vol 12 (10) ◽  
pp. 410
Author(s):  
Yannick Forster ◽  
Frederik Naujoks ◽  
Andreas Keinath
Keyword(s):  
User Study ◽  
Standardized Test ◽  
User Studies ◽  
Sample Sizes ◽  
Automated Driving ◽  
Test Protocol ◽  
Human Machine Interaction ◽  
Validation And Verification ◽  
Machine Interaction ◽  
Respective Number

Empirical validation and verification procedures require the sophisticated development of research methodology. Therefore, researchers and practitioners in human–machine interaction and the automotive domain have developed standardized test protocols for user studies. These protocols are used to evaluate human–machine interfaces (HMI) for driver distraction or automated driving. A system or HMI is validated in regard to certain criteria that it can either pass or fail. One important aspect is the number of participants to include in the study and the respective number of potential failures concerning the pass/fail criteria of the test protocol. By applying binomial tests, the present work provides recommendations on how many participants should be included in a user study. It sheds light on the degree to which inferences from a sample with specific pass/fail ratios to a population is permitted. The calculations take into account different sample sizes and different numbers of observations within a sample that fail the criterion of interest. The analyses show that required sample sizes increase to high numbers with a rising degree of controllability that is assumed for a population. The required sample sizes for a specific controllability verification (e.g., 85%) also increase if there are observed cases of fails in regard to the safety criteria. In conclusion, the present work outlines potential sample sizes and valid inferences about populations and the number of observed failures in a user study.

The More You Know: Trust Dynamics and Calibration in Highly Automated Driving and the Effects of Take-Overs, System Malfunction, and System Transparency

2019 ◽  
Vol 62 (5) ◽  
pp. 718-736 ◽  
Author(s):  
Johannes Kraus ◽  
David Scholz ◽  
Dina Stiegemeier ◽  
Martin Baumann
Keyword(s):  
Design System ◽  
Full Potential ◽  
Positive Outcomes ◽  
Automated Vehicles ◽  
Automated Driving ◽  
Human Machine Interaction ◽  
Temporary Decrease ◽  
Free Interaction ◽  
Machine Interaction ◽  
Transparency Condition

Objective This paper presents a theoretical model and two simulator studies on the psychological processes during early trust calibration in automated vehicles. Background The positive outcomes of automation can only reach their full potential if a calibrated level of trust is achieved. In this process, information on system capabilities and limitations plays a crucial role. Method In two simulator experiments, trust was repeatedly measured during an automated drive. In Study 1, all participants in a two-group experiment experienced a system-initiated take-over, and the occurrence of a system malfunction was manipulated. In Study 2 in a 2 × 2 between-subject design, system transparency was manipulated as an additional factor. Results Trust was found to increase during the first interactions progressively. In Study 1, take-overs led to a temporary decrease in trust, as did malfunctions in both studies. Interestingly, trust was reestablished in the course of interaction for take-overs and malfunctions. In Study 2, the high transparency condition did not show a temporary decline in trust after a malfunction. Conclusion Trust is calibrated along provided information prior to and during the initial drive with an automated vehicle. The experience of take-overs and malfunctions leads to a temporary decline in trust that was recovered in the course of error-free interaction. The temporary decrease can be prevented by providing transparent information prior to system interaction. Application Transparency, also about potential limitations of the system, plays an important role in this process and should be considered in the design of tutorials and human-machine interaction (HMI) concepts of automated vehicles.

scholarly journals Calibration of Trust in Automated Driving: A Matter of Initial Level of Trust and Automation Driving Style?

2021 ◽  
Author(s):  
J. B. Manchon ◽  
Mercedes Bueno ◽  
Jordan Navarro
Keyword(s):  
Initial Level ◽  
Automated Driving ◽  
Human Machine Interaction ◽  
Driving Style ◽  
Automated Vehicle ◽  
Visual Behaviors ◽  
Trust In Automation ◽  
Machine Interaction ◽  
Over Time ◽  
Highly Automated Driving

Automated driving is becoming a reality, such technology raises new concerns about human-machine interaction on-road. Sixty-one drivers participated in an experiment aiming to better understand the influence of initial level of trust (Trustful vs Distrustful) on drivers’ behaviors and trust calibration during simulated Highly Automated Driving (HAD). The automated driving style was manipulated as positive (smooth) or negative (abrupt) to investigate human-machine early interactions. Trust was assessed over time through questionnaires. Drivers’ visual behaviors and take-over performances during an unplanned take-over request were also investigated. Results showed an increase of trust in automation over time, for both Trustful and Distrustful drivers regardless the automated driving style. Trust was also found to fluctuate over time depending on the specific events handled by the automated vehicle. Take-over performances were not influenced by the initial level of trust nor automated driving style.

scholarly journals Standardized Test Procedure for External Human–Machine Interfaces of Automated Vehicles

Information ◽  
2020 ◽  
Vol 11 (3) ◽  
pp. 173 ◽  
Author(s):  
Christina Kaß ◽  
Stefanie Schoch ◽  
Frederik Naujoks ◽  
Sebastian Hergeth ◽  
Andreas Keinath ◽  
...  
Keyword(s):  
Standardized Test ◽  
Methodological Approach ◽  
Test Procedure ◽  
Empirical Evaluation ◽  
Automated Vehicles ◽  
Automated Driving ◽  
Test Procedures ◽  
Test Protocol ◽  
Area Of Interest ◽  
Human Machine Interfaces

Research on external human–machine interfaces (eHMIs) has recently become a major area of interest in the field of human factors research on automated driving. The broad variety of methodological approaches renders the current state of research inconclusive and comparisons between interface designs impossible. To date, there are no standardized test procedures to evaluate and compare different design variants of eHMIs with each other and with interactions without eHMIs. This article presents a standardized test procedure that enables the effective usability evaluation of eHMI design solutions. First, the test procedure provides a methodological approach to deduce relevant use cases for the evaluation of an eHMI. In addition, we define specific usability requirements that must be fulfilled by an eHMI to be effective, efficient, and satisfying. To prove whether an eHMI meets the defined requirements, we have developed a test protocol for the empirical evaluation of an eHMI with a participant study. The article elucidates underlying considerations and details of the test protocol that serves as framework to measure the behavior and subjective evaluations of non-automated road users when interacting with automated vehicles in an experimental setting. The standardized test procedure provides a useful framework for researchers and practitioners.

Automation, Expert Systems Calibration of Trust in Automated Driving: A Matter of Initial Level of Trust and Automated Driving Style?

2021 ◽  
pp. 001872082110528
Author(s):  
J. B. Manchon ◽  
Mercedes Bueno ◽  
Jordan Navarro
Keyword(s):  
Road Safety ◽  
Initial Level ◽  
Automated Driving ◽  
Human Machine Interaction ◽  
Driving Style ◽  
Automated Vehicle ◽  
Visual Behaviors ◽  
Machine Interaction ◽  
Over Time

Objective Automated driving is becoming a reality, and such technology raises new concerns about human–machine interaction on road. This paper aims to investigate factors influencing trust calibration and evolution over time. Background Numerous studies showed trust was a determinant in automation use and misuse, particularly in the automated driving context. Method Sixty-one drivers participated in an experiment aiming to better understand the influence of initial level of trust (Trustful vs. Distrustful) on drivers’ behaviors and trust calibration during two sessions of simulated automated driving. The automated driving style was manipulated as positive (smooth) or negative (abrupt) to investigate human–machine early interactions. Trust was assessed over time through questionnaires. Drivers’ visual behaviors and take-over performances during an unplanned take-over request were also investigated. Results Results showed an increase of trust over time, for both Trustful and Distrustful drivers regardless the automated driving style. Trust was also found to fluctuate over time depending on the specific events handled by the automated vehicle. Take-over performances were not influenced by the initial level of trust nor automated driving style. Conclusion Trust in automated driving increases rapidly when drivers’ experience such a system. Initial level of trust seems to be crucial in further trust calibration and modulate the effect of automation performance. Long-term trust evolutions suggest that experience modify drivers’ mental model about automated driving systems. Application In the automated driving context, trust calibration is a decisive question to guide such systems’ proper utilization, and road safety.

Concise CNN model for face expression recognition

2021 ◽  
pp. 1-9
Author(s):  
Harshadkumar B. Prajapati ◽  
Ankit S. Vyas ◽  
Vipul K. Dabhi
Keyword(s):  
Network Architecture ◽  
Expression Recognition ◽  
Human Machine Interaction ◽  
Face Expression ◽  
Computational Overhead ◽  
Average Accuracy ◽  
Proposed Model ◽  
Face Expression Recognition ◽  
Expression Classification ◽  
Machine Interaction

Face expression recognition (FER) has gained very much attraction to researchers in the field of computer vision because of its major usefulness in security, robotics, and HMI (Human-Machine Interaction) systems. We propose a CNN (Convolutional Neural Network) architecture to address FER. To show the effectiveness of the proposed model, we evaluate the performance of the model on JAFFE dataset. We derive a concise CNN architecture to address the issue of expression classification. Objective of various experiments is to achieve convincing performance by reducing computational overhead. The proposed CNN model is very compact as compared to other state-of-the-art models. We could achieve highest accuracy of 97.10% and average accuracy of 90.43% for top 10 best runs without any pre-processing methods applied, which justifies the effectiveness of our model. Furthermore, we have also included visualization of CNN layers to observe the learning of CNN.

scholarly journals A Bibliometric Analysis of Human-Machine Interaction Methodology for Electric-Powered Wheelchairs Driving from 1998 to 2020

2021 ◽  
Vol 18 (14) ◽  
pp. 7567
Author(s):  
Xiaochen Zhang ◽  
Lanxin Hui ◽  
Linchao Wei ◽  
Fuchuan Song ◽  
Fei Hu
Keyword(s):  
The Elderly ◽  
Research Field ◽  
Future Research ◽  
Human Machine Interaction ◽  
Research Directions ◽  
The Past ◽  
Power Wheelchairs ◽  
The Disabled ◽  
Future Research Directions ◽  
Machine Interaction

Electric power wheelchairs (EPWs) enhance the mobility capability of the elderly and the disabled, while the human-machine interaction (HMI) determines how well the human intention will be precisely delivered and how human-machine system cooperation will be efficiently conducted. A bibliometric quantitative analysis of 1154 publications related to this research field, published between 1998 and 2020, was conducted. We identified the development status, contributors, hot topics, and potential future research directions of this field. We believe that the combination of intelligence and humanization of an EPW HMI system based on human-machine collaboration is an emerging trend in EPW HMI methodology research. Particular attention should be paid to evaluating the applicability and benefits of the EPW HMI methodology for the users, as well as how much it contributes to society. This study offers researchers a comprehensive understanding of EPW HMI studies in the past 22 years and latest trends from the evolutionary footprints and forward-thinking insights regarding future research.

Sign in / Sign up

Export Citation Format

Share Document