Evaluating Multimodal Feedback for Assembly Tasks in a Virtual Environment

The contribution proposes innovative methods for design and ergonomic configuration of tools, equipment and manual workplaces for automobile assembly tasks, in order to increase the worker’s welfare and the system’s performance by improving general safety conditions. Developed activities are part of the research project “DEWO – Design Environment for WorkPlace Optimization”, financed by Italian Government to the Second University of Naples. The aim of this project is to identify new methods for optimization of assembly tasks in a virtual environment in terms of overall integration among materials management, working tasks organization and layout, starting from the principles of "WorkPlace Organization" and the modern theories of "Lean Production ". The manufacturing industry is heading to the ever more pushed use of digital technologies in order to achieve very dynamic production environments and to be able to develop continuous process and product innovations to fit into the so called Fourth Industrial Revolution, Industry 4.0. The main goal of Industry 4.0 is to “rethink” companies through the use of digital, to reconsider the design approach and to monitor the production process in real time. The research addresses the evolution of innovation 4.0 in relation to the discipline of design, where the management of knowledge in the production process has led to the strengthening and improvement of tangible goods. Starting by current ergonomic analysis models and innovative approaches to the process of industrial production line, the manufacturing processes in the virtual environment were defined and optimized with the use of innovative 3D enjoyment technologies. The constant interaction among the different disciplines of design, engineering and occupational medicine, enables the creation of advanced systems for simulating production processes based on virtual reality and augmented reality, mainly focused on the needs and requirements of the workers on a production line where it is possible to bring out the interaction between real and virtual factory (Cyber-Physical System). The objective is to define new models of analysis, of development and testing for the configuration of ergonomic processes that improve and facilitate the human-machine interaction in a holistic view, in order to protect and enhance human capital, transferring the experiences and knowledge in the factory system, key factors for the company and for the sustainability of workers welfare levels.DOI: http://dx.doi.org/10.4995/IFDP.2016.3297

Download Full-text

A Theoretical Framework for Generating Copious Multi-Sensory Feedback From Virtual Buttons

ASME 2010 World Conference on Innovative Virtual Reality ◽

10.1115/winvr2010-3756 ◽

2010 ◽

Author(s):

Adam J. Faeth ◽

Chris Harding

Keyword(s):

Virtual Reality ◽

Virtual Environment ◽

Real World ◽

Sensory Feedback ◽

Haptic Feedback ◽

Theoretical Framework ◽

Software Library ◽

Multimodal Feedback

This research describes a theoretical framework for designing multimodal feedback for 3D buttons in a virtual environment. Virtual button implementations often suffer from inadequate feedback compared to their mechanical, real-world, counterparts. This lack of feedback can lead to accidental button actuations and reduce the user’s ability to discover how to interact with the virtual button. We propose a framework for more expressive virtual button feedback that communicates visual, audio, and haptic feedback to the user. We apply the theoretical framework by implementing a software library prototype to support multimodal feedback from virtual buttons in a 3D virtual reality workspace.

Download Full-text

Impact of multimodal feedback on simulated ergonomic measurements in a virtual environment: A case study with manufacturing workers

Human Factors and Ergonomics in Manufacturing & Service Industries ◽

10.1002/hfm.20293 ◽

2011 ◽

Vol 22 (2) ◽

pp. 145-155 ◽

Cited By ~ 9

Author(s):

Bo Hu ◽

Wei Zhang ◽

Gavriel Salvendy

Keyword(s):

Virtual Environment ◽

Multimodal Feedback

Download Full-text

Virtual Assembly Environment Modelling

ASME-AFM 2009 World Conference on Innovative Virtual Reality ◽

10.1115/winvr2009-743 ◽

2009 ◽

Cited By ~ 4

Author(s):

Ulises Zaldivar-Colado ◽

Samir Garbaya

Keyword(s):

Virtual Environment ◽

Haptic Feedback ◽

Design Stage ◽

Assembly Sequence ◽

Interaction Technique ◽

Sequence Generation ◽

Stage Of Development ◽

Assembly Sequence Generation ◽

Assembly Tasks ◽

Environment Modelling

In this paper, we present the virtual environment of assembly sequence generation of a product at the design stage. The interaction technique developed for the manipulation of virtual parts includes visual and haptic feedback limited to force sensation in the fingertips and weight and inertia parts sensation. At this stage of development, the parts and subassemblies have kinematics behaviour in the virtual scene. We present some guidelines for modeling a generic virtual environment for performing assembly tasks. Virtual parts modeling and connections modeling is based on characteristics of real parts and connections. The mating phase of assembly is based on the Snap-Fitting technique, which is improved by the addition of vectors in the symmetry axis of virtual parts. An XML modeling allows the environment to be generic and supporting different products.

Download Full-text

Haptic Simulation of Assembly Operation in Virtual Environment

10.1115/imece2000-2430 ◽

2000 ◽

Author(s):

Tsuneo Yoshikawa ◽

Kouki Yoshimoto

Keyword(s):

Virtual Environment ◽

Real World ◽

Surface Friction ◽

Friction Characteristics ◽

Assembly Operation ◽

Human Skill ◽

Assembly Operations ◽

Haptic Simulation ◽

Assembly Tasks ◽

Gathering Data

Abstract This paper presents a haptic simulator of 2-dimensional peg-in-hole assembly operations in a virtual environment, considering the dynamics and the surface friction characteristics of the peg and the hole. An operator can operate the virtual peg by inserting his fingers into rings at the tips of link mechanisms which display the operating feeling to the operator. By using this simulator, we can measure the force between fingers and the peg, the contact states between the peg and hole, and the position of the peg during the operation. To examine the validity of the simulator, comparison between the peg-in-hole task using the simulator and that in the real world has been performed. It is hoped that this simulator will help in gathering data of human skill in assembly tasks and analyzing the human skill.

Download Full-text