scholarly journals A Mixed Reality Interface for a Digital Twin Based Crane

2021 ◽  
Vol 11 (20) ◽  
pp. 9480
Author(s):  
Xinyi Tu ◽  
Juuso Autiosalo ◽  
Adnane Jadid ◽  
Kari Tammi ◽  
Gudrun Klinker

Digital twin technology empowers the digital transformation of the industrial world with an increasing amount of data, which meanwhile creates a challenging context for designing a human–machine interface (HMI) for operating machines. This work aims at creating an HMI for digital twin based services. With an industrial crane platform as a case study, we presented a mixed reality (MR) application running on a Microsoft HoloLens 1 device. The application, consisting of visualization, interaction, communication, and registration modules, allowed crane operators to both monitor the crane status and control its movement through interactive holograms and bi-directional data communication, with enhanced mobility thanks to spatial registration and tracking of the MR environment. The prototype was quantitatively evaluated regarding the control accuracy in 20 measurements following a step-by-step protocol that we defined to standardize the measurement procedure. The results suggested that the differences between the target and actual positions were within the 10 cm range in three dimensions, which were considered sufficiently small regarding the typical crane operation use case of logistics purposes and could be improved with the adoption of robust registration and tracking techniques in our future work.

2021 ◽  
Vol 11 (12) ◽  
pp. 5519
Author(s):  
Rui Carvalho ◽  
Alberto Rodrigues da Silva

Sustainable development was defined by the UN in 1987 as development that meets the needs of the present without compromising the ability of future generations to meet their own needs, and this is a core concept in this paper. This work acknowledges the three dimensions of sustainability, i.e., economic, social, and environmental, but its focus is on this last one. A digital twin (DT) is frequently described as a physical entity with a virtual counterpart, and the data, connections between the two, implying the existence of connectors and blocks for efficient and effective data communication. This paper provides a meta systematic literature review (SLR) (i.e., an SLR of SLRs) regarding the sustainability requirements of DT-based systems. Numerous papers on the subject of DT were also selected because they cited the analyzed SLRs and were considered relevant to the purposes of this research. From the selection and analysis of 29 papers, several limitations and challenges were identified: the perceived benefits of DTs are not clearly understood; DTs across the product life cycle or the DT life cycle are not sufficiently studied; it is not clear how DTs can contribute to reducing costs or supporting decision-making; technical implementation of DTs must be improved and better integrated in the context of the IoT; the level of fidelity of DTs is not entirely evaluated in terms of their parameters, accuracy, and level of abstraction; and the ownership of data stored within DTs should be better understood. Furthermore, from our research, it was not possible to find a paper discussing DTs only in regard to environmental sustainability.


Author(s):  
Steve Beitzel ◽  
Josiah Dykstra ◽  
Paul Toliver ◽  
Jason Youzwak

We investigate the feasibility of using Microsoft HoloLens, a mixed reality device, to visually analyze network capture data and locate anomalies. We developed MINER, a prototype application to visualize details from network packet captures as 3D stereogram charts. MINER employs a novel approach to time-series visualization that extends the time dimension across two axes, thereby taking advantage of the immersive 3D space available via the HoloLens. Users navigate the application through eye gaze and hand gestures to view summary and detailed bar graphs. Callouts display additional detail based on the user’s immediate gaze. In a user study, volunteers used MINER to locate network attacks in a dataset from the 2013 VAST Challenge. We compared the time and effort with a similar test using traditional tools on a desktop computer. Our findings suggest that network anomaly analysis with the HoloLens achieved comparable effectiveness, efficiency and satisfaction. We describe user metrics and feedback collected from these experiments; lessons learned and suggested future work.


Author(s):  
Dominik Hüsener ◽  
Michael Schluse ◽  
Dorit Kaufmann ◽  
Jürgen Roßmann

AbstractA Digital Twin is a virtual representation of a physical asset. It reflects the current state of that machine through a model and the data as observed by sensors in the real machine; and enables effective and efficient interaction with the machine, i.e. for monitoring and control purposes. The Digital Twin facilitates the collection of data, as well as its analysis and visualization through its user interfaces, i.e. GUIs such as screens or Mixed Reality that provide intuitive access to the data and facilitates its manipulation. Embedded in Virtual Testbeds the Digital Twin becomes an “Experimentable Digital Twin” (EDT), in which experiments can be performed and the different outcomes can be compared or evaluated. The intuitive representation of the assets allows the experts to interact with the twin, without highly detailed knowledge in computer science. The digital twin observes, records, and benchmarks experiments performed by the operator. This way the operator’s knowledge becomes digitized and thus preserved as an abstract representation of data, formulas, and models inside the digital twin. By introducing the Digital Twin into the processes carried out by different operators (not only the initially observed expert), formerly intuitive decision-making processes of the operators are enhanced based on empirical data. As a result, the Digital Twin serves as an assistance system that can guide future operators and the outcomes of the experiments become reproducible. The specific representations of interactions and outcomes also facilitate collaboration between the machine operators and other stakeholders by providing different operators a common “perspective”.


Energies ◽  
2021 ◽  
Vol 14 (18) ◽  
pp. 5933
Author(s):  
Georgios Falekas ◽  
Athanasios Karlis

State-of-the-art Predictive Maintenance (PM) of Electrical Machines (EMs) focuses on employing Artificial Intelligence (AI) methods with well-established measurement and processing techniques while exploring new combinations, to further establish itself a profitable venture in industry. The latest trend in industrial manufacturing and monitoring is the Digital Twin (DT) which is just now being defined and explored, showing promising results in facilitating the realization of the Industry 4.0 concept. While PM efforts closely resemble suggested DT methodologies and would greatly benefit from improved data handling and availability, a lack of combination regarding the two concepts is detected in literature. In addition, the next-generation-Digital-Twin (nexDT) definition is yet ambiguous. Existing DT reviews discuss broader definitions and include citations often irrelevant to PM. This work aims to redefine the nexDT concept by reviewing latest descriptions in broader literature while establishing a specialized denotation for EM manufacturing, PM, and control, encapsulating most of the relevant work in the process, and providing a new definition specifically catered to PM, serving as a foundation for future endeavors. A brief review of both DT research and PM state-of-the-art spanning the last five years is presented, followed by the conjunction of core concepts into a definitive description. Finally, surmised benefits and future work prospects are reported, especially focused on enabling PM state-of-the-art in AI techniques.


Electronics ◽  
2021 ◽  
Vol 10 (4) ◽  
pp. 415
Author(s):  
Jordan C. Hanson

Phased array radar systems have a wide variety of applications in engineering and physics research. Phased array design usually requires numerical modeling with expensive commercial computational packages. Using the open-source MIT Electrogmagnetic Equation Propagation (MEEP) package, a set of phased array designs is presented. Specifically, one and two-dimensional arrays of Yagi-Uda and horn antennas were modeled in the bandwidth [0.1–5] GHz, and compared to theoretical expectations in the far-field. Precise matches between MEEP simulation and radiation pattern predictions at different frequencies and beam angles are demonstrated. Given that the computations match the theory, the effect of embedding a phased array within a medium of varying index of refraction is then computed. Understanding the effect of varying index on phased arrays is critical for proposed ultra-high energy neutrino observatories which rely on phased array detectors embedded in natural ice. Future work will develop the phased array concepts with parallel MEEP, in order to increase the detail, complexity, and speed of the computations.


2021 ◽  
Vol 1 ◽  
pp. 2107-2116
Author(s):  
Agnese Brunzini ◽  
Alessandra Papetti ◽  
Michele Germani ◽  
Erica Adrario

AbstractIn the medical education field, the use of highly sophisticated simulators and extended reality (XR) simulations allow training complex procedures and acquiring new knowledge and attitudes. XR is considered useful for the enhancement of healthcare education; however, several issues need further research.The main aim of this study is to define a comprehensive method to design and optimize every kind of simulator and simulation, integrating all the relevant elements concerning the scenario design and prototype development.A complete framework for the design of any kind of advanced clinical simulation is proposed and it has been applied to realize a mixed reality (MR) prototype for the simulation of the rachicentesis. The purpose of the MR application is to immerse the trainee in a more realistic environment and to put him/her under pressure during the simulation, as in real practice.The application was tested with two different devices: the headset Vox Gear Plus for smartphone and the Microsoft Hololens. Eighteen students of the 6th year of Medicine and Surgery Course were enrolled in the study. Results show the comparison of user experience related to the two different devices and simulation performance using the Hololens.


1984 ◽  
Vol 106 (3) ◽  
pp. 279-284 ◽  
Author(s):  
Y. Bai ◽  
W. Johnson ◽  
R. G. M. Low ◽  
S. K. Ghosh

When an oil tank collapses or ruptures any contained hazardous substance flows outwards and can damage nearby plant or people as well as lead to pollution of the local environment. In recent years, this and similar subjects have given rise to a new kind of engineering—spill prevention and control. However, theoretical background, backed by experiment, is lacking to work out reliable regulations. An intermediate-asymptotic analysis for late-stage spreading is carried out in this paper. This analysis reveals several characteristic features of the spill wave such as transition period and linear relationships between spreading area and time, and wave front velocity and the inverse of zone radius. Most of the latter results have been verified by model experiment. This paper also discusses the discrepancies between observations and the theory suggested in a recent UK Health and Safety Executive report. Finally, the present paper puts forward proper modeling rules for future work.


Sign in / Sign up

Export Citation Format

Share Document