scholarly journals SYSTEM BASED COMPONENT IDENTIFICATION USING COORDINATE DETERMINATION IN MIXED REALITY

2020 ◽  
Vol 1 ◽  
pp. 275-284
Author(s):  
S. G. Kunnen ◽  
D. Adamenko ◽  
R. Pluhnau ◽  
A. Nagarajah

AbstractThe maintenance of an industrial plant is mainly based on analogue and manual methods and processes. In the future, the maintenance data of the real object should be determined digital and transferred to a PDM system in real time. This is made possible with a digital method of component identification. This publication presents a system-based component identification using Mixed Reality. Coordinates are determined by the terminal device and compared with a reference structure. After successful identification, maintenance data can be determined and automatically transferred to a PDM System.

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1123
Author(s):  
David Jurado ◽  
Juan M. Jurado ◽  
Lidia Ortega ◽  
Francisco R. Feito

Mixed reality (MR) enables a novel way to visualize virtual objects on real scenarios considering physical constraints. This technology arises with other significant advances in the field of sensors fusion for human-centric 3D capturing. Recent advances for scanning the user environment, real-time visualization and 3D vision using ubiquitous systems like smartphones allow us to capture 3D data from the real world. In this paper, a disruptive application for assessing the status of indoor infrastructures is proposed. The installation and maintenance of hidden facilities such as water pipes, electrical lines and air conditioning tubes, which are usually occluded behind the wall, supposes tedious and inefficient tasks. Most of these infrastructures are digitized but they cannot be visualized onsite. In this research, we focused on the development of a new application (GEUINF) to be launched on smartphones that are capable of capturing 3D data of the real world by depth sensing. This information is relevant to determine the user position and orientation. Although previous approaches used fixed markers for this purpose, our application enables the estimation of both parameters with a centimeter accuracy without them. This novelty is possible since our method is based on a matching process between reconstructed walls of the real world and 3D planes of the replicated world in a virtual environment. Our markerless approach is based on scanning planar surfaces of the user environment and then, these are geometrically aligned with their corresponding virtual 3D entities. In a preprocessing phase, the 2D CAD geometry available from an architectural project is used to generate 3D models of an indoor building structure. In real time, these virtual elements are tracked with the real ones modeled by using ARCore library. Once the alignment between virtual and real worlds is done, the application enables the visualization, navigation and interaction with the virtual facility networks in real-time. Thus, our method may be used by private companies and public institutions responsible of the indoor facilities management and also may be integrated with other applications focused on indoor navigation.


Author(s):  
Ralph Stelzer ◽  
Matthias Klaus ◽  
Wolfgang Steger ◽  
Erik Steindecker ◽  
Gregor Tauscher

Virtual testing is a significant part of the product development process. It is possible to completely solve many problems through the interaction of geometric models, simulation tools, human models with the help of the appropriate software. If, in the course of testing, it is necessary to take into account subjective human perception, one may profitably use a full-size system for immersive projection (VR system). Such a system particularly makes sense in evaluating manufacturing, operating, application or maintenance. The human being interacts with a product whose physical shape does not yet exist in a virtual environment. In this case, the movements of product components are generally indirectly controlled by using a flystick, a wand or a similar input device. In reality many operations in maintenance are determined by the position and posture of the maintenance personal as well as by the mass, center of gravity and dimensions of the object to be manipulated. In a Mixed Reality Environment, it is possible to achieve a meaningful subjective ergonomic evaluation of the abovementioned operations. The paper elucidates a strategy to integrate real product components into a virtual environment. The user applies the real components or tools in the immersive full-size projection of the VR system. The VR system tracks the real object. This way, it is possible to move an invisible object model in the VR system in sync with the movements of the real object. The collision detection tool provided in the VR system is available and signalises contact of the real object with the virtual environment. The demonstrated solution is under consideration for the planning and ergonomic evaluation of service activities. The need of industry for a process that can be controlled in a safe manner is of particular concern. The solution given here is aimed at maintenance to be performed on the brake system of a light-duty truck.


2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Shousheng Chai ◽  
Jun Shan ◽  
Yi Hui Chan

Based on the multimodal wireless virtual reality technology, this article researches and implements two different spatial positioning estimation systems based on intelligent networks and mixed reality devices, which can estimate their position and attitude in space with higher accuracy. Based on the multimodal protocol, an extensible information exchange protocol is designed to meet the requirements of the terminal and the background service in the scenic spot, which realizes the information interaction between the terminal and the background service and supports the realization of system functions. Second, a real-time data management module is designed for the two types of terminal historical location query and real-time location query. Through the research and summary of GPS positioning technology and existing matching algorithms, as well as the analysis of positioning errors, a scenic map matching algorithm based on an improved virtual reality model is proposed. Later, in the electronic map design, the traditional linear street view model was improved, the width element of the street view was increased, and the rectangular street view model was introduced. When the candidate road section was selected, the candidate road section was determined by the area intersection method of the error rectangle and the rectangular street view, and the search path was improved, while reducing omissions in the selection of candidate road sections. In the process of adaptive moving target feature learning, it can effectively remove the inaccurate foreground extraction caused by the misjudgement and misdetection of the multimodal background modeling method. This plays an important role in the later trajectory tracking and reduces the uninterruptedness. The simulation results show that the real-time data is cached in the memory, and the real-time data is divided and organized on the basis of region, which realizes efficient designated terminal location query, range query, neighbour query, and many other typical real-time location-based queries. Finally, using the characteristics of the database management system adopted, through a reasonable design of the database table structure, efficient access to historical data is realized. System test results show that the system has realized multimedia applications, electronic maps, travel notes, and other functions and has a friendly interface, easy operation, and good maintainability and scalability.


2014 ◽  
Author(s):  
Irving Biederman ◽  
Ori Amir
Keyword(s):  

2015 ◽  
Vol 2 (1) ◽  
pp. 35-41
Author(s):  
Rivan Risdaryanto ◽  
Houtman P. Siregar ◽  
Dedy Loebis

The real-time system is now used on many fields, such as telecommunication, military, information system, evenmedical to get information quickly, on time and accurate. Needless to say, a real-time system will always considerthe performance time. In our application, we define the time target/deadline, so that the system should execute thewhole tasks under predefined deadline. However, if the system failed to finish the tasks, it will lead to fatal failure.In other words, if the system cannot be executed on time, it will affect the subsequent tasks. In this paper, wepropose a real-time system for sending data to find effectiveness and efficiency. Sending data process will beconstructed in MATLAB and sending data process has a time target as when data will send.


2019 ◽  
Vol 2019 (1) ◽  
pp. 237-242
Author(s):  
Siyuan Chen ◽  
Minchen Wei

Color appearance models have been extensively studied for characterizing and predicting the perceived color appearance of physical color stimuli under different viewing conditions. These stimuli are either surface colors reflecting illumination or self-luminous emitting radiations. With the rapid development of augmented reality (AR) and mixed reality (MR), it is critically important to understand how the color appearance of the objects that are produced by AR and MR are perceived, especially when these objects are overlaid on the real world. In this study, nine lighting conditions, with different correlated color temperature (CCT) levels and light levels, were created in a real-world environment. Under each lighting condition, human observers adjusted the color appearance of a virtual stimulus, which was overlaid on a real-world luminous environment, until it appeared the whitest. It was found that the CCT and light level of the real-world environment significantly affected the color appearance of the white stimulus, especially when the light level was high. Moreover, a lower degree of chromatic adaptation was found for viewing the virtual stimulus that was overlaid on the real world.


Sign in / Sign up

Export Citation Format

Share Document