Mobile Based Real-Time Occlusion Between Real and Digital Objects in Augmented Reality

2019 ◽  
Author(s):  
Pranav Jain ◽  
Conrad Tucker
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Real World ◽  
Motion Artifacts ◽  
Virtual Objects ◽  
Depth Sensors ◽  
Lead Users ◽  
Digital Objects ◽  
The Cost

Abstract In this paper, a mobile-based augmented reality (AR) method is presented that is capable of accurate occlusion between digital and real-world objects in real-time. AR occlusion is the process of hiding or showing virtual objects behind physical ones. Existing approaches that address occlusion in AR applications typically require the use of markers or depth sensors, coupled with compute machines (e.g., laptop or desktop). Furthermore, real-world environments are cluttered and contain motion artifacts that result in occlusion errors and improperly rendered virtual objects, relative to the real world environment. These occlusion errors can lead users to have an incorrect perception of the environment around them while using an AR application, namely not knowing a real-world object is present. Moving the technology to mobile-based AR environments is necessary to reduce the cost and complexity of these technologies. This paper presents a mobile-based AR method that brings real and virtual objects into a similar coordinate system so that virtual objects do not obscure nearby real-world objects in an AR environment. This method captures and processes visual data in real-time, allowing the method to be used in a variety of non-static environments and scenarios. The results of the case study show that the method has the potential to reduce compute complexity, maintain high frame rates to run in real-time, and maintain occlusion efficacy.

Real-Time Occlusion Between Real and Digital Objects in Augmented Reality

2018 ◽  
Author(s):  
Kevin Lesniak ◽  
Conrad S. Tucker
Keyword(s):  
Augmented Reality ◽  
Coordinate System ◽  
Real Time ◽  
Real World ◽  
Virtual Object ◽  
Virtual Objects ◽  
Common Coordinate System ◽  
Realistic Representation ◽  
Lead Users

The method presented in this work reduces the frequency of virtual objects incorrectly occluding real-world objects in Augmented Reality (AR) applications. Current AR rendering methods cannot properly represent occlusion between real and virtual objects because the objects are not represented in a common coordinate system. These occlusion errors can lead users to have an incorrect perception of the environment around them when using an AR application, namely not knowing a real-world object is present due to a virtual object incorrectly occluding it and incorrect perception of depth or distance by the user due to incorrect occlusions. The authors of this paper present a method that brings both real-world and virtual objects into a common coordinate system so that distant virtual objects do not obscure nearby real-world objects in an AR application. This method captures and processes RGB-D data in real-time, allowing the method to be used in a variety of environments and scenarios. A case study shows the effectiveness and usability of the proposed method to correctly occlude real-world and virtual objects and provide a more realistic representation of the combined real and virtual environments in an AR application. The results of the case study show that the proposed method can detect at least 20 real-world objects with potential to be incorrectly occluded while processing and fixing occlusion errors at least 5 times per second.

Augmented Reality Berbasis Android Sebagai Media Pembelajaran Sistem Tata Surya

2021 ◽  
Vol 2 (1) ◽  
pp. 53-59
Author(s):  
Yulia Fatma ◽  
Armen Salim ◽  
Regiolina Hayami
Keyword(s):  
Augmented Reality ◽  
Solar System ◽  
Real Time ◽  
Real World ◽  
Virtual World ◽  
The Real ◽  
Virtual Objects ◽  
Augmented Reality Technology ◽  
The Revolution

Along with the development, the application can be used as a medium for learning. Augmented Reality is a technology that combines two-dimensional’s virtual objects and three-dimensional’s virtual objects into a real three-dimensional’s  then projecting the virtual objects in real time and simultaneously. The introduction of Solar System’s material, students are invited to get to know the planets which are directly encourage students to imagine circumtances in the Solar System. Explenational of planets form and how the planets make the revolution and rotation in books are considered less material’s explanation because its only display objects in 2D. In addition, students can not practice directly in preparing the layout of the planets in the Solar System. By applying Augmented Reality Technology, information’s learning delivery can be clarified, because in these applications are combined the real world and the virtual world. Not only display the material, the application also display images of planets in 3D animation’s objects with audio.

scholarly journals Augmented Reality Research and Applications in Education

2021 ◽  
Author(s):  
Ezgi Pelin Yildiz
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
Real Time ◽  
Virtual Environment ◽  
Real World ◽  
The Real ◽  
Virtual Objects ◽  
Physical Environments ◽  
Real Objects ◽  
As If

Augmented reality is defined as the technology in which virtual objects are blended with the real world and also interact with each other. Although augmented reality applications are used in many areas, the most important of these areas is the field of education. AR technology allows the combination of real objects and virtual information in order to increase students’ interaction with physical environments and facilitate their learning. Developing technology enables students to learn complex topics in a fun and easy way through virtual reality devices. Students interact with objects in the virtual environment and can learn more about it. For example; by organizing digital tours to a museum or zoo in a completely different country, lessons can be taught in the company of a teacher as if they were there at that moment. In the light of all these, this study is a compilation study. In this context, augmented reality technologies were introduced and attention was drawn to their use in different fields of education with their examples. As a suggestion at the end of the study, it was emphasized that the prepared sections should be carefully read by the educators and put into practice in their lessons. In addition it was also pointed out that it should be preferred in order to communicate effectively with students by interacting in real time, especially during the pandemic process.

A Simple and Practical Method for Incorporating Augmented Reality into the Classroom and Laboratory

2018 ◽  
Author(s):  
Kyle Plunkett
Keyword(s):  
Organic Chemistry ◽  
Augmented Reality ◽  
Real Time ◽  
Real World ◽  
Smart Phone ◽  
Practical Method ◽  
Virtual Expert ◽  
Video Projection

This manuscript provides two demonstrations of how Augmented Reality (AR), which is the projection of virtual information onto a real-world object, can be applied in the classroom and in the laboratory. Using only a smart phone and the free HP Reveal app, content rich AR notecards were prepared. The physical notecards are based on Organic Chemistry I reactions and show only a reagent and substrate. Upon interacting with the HP Reveal app, an AR video projection shows the product of the reaction as well as a real-time, hand-drawn curved-arrow mechanism of how the product is formed. Thirty AR notecards based on common Organic Chemistry I reactions and mechanisms are provided in the Supporting Information and are available for widespread use. In addition, the HP Reveal app was used to create AR video projections onto laboratory instrumentation so that a virtual expert can guide the user during the equipment setup and operation.

Case Study: Enhancing Human Reliability With Artificial Intelligence and Augmented Reality Tools for Nuclear Maintenance

2018 ◽  
Author(s):  
Geoffrey Momin ◽  
Raj Panchal ◽  
Daniel Liu ◽  
Sharman Perera
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Human Error ◽  
Nuclear Industry ◽  
Industrial Accidents ◽  
Worker Productivity ◽  
Energy Agency ◽  
Computer Mediated ◽  
Critical Feedback

Human error accounts for about 60% of the annual power loss due to maintenance incidents in the fossil power industry. The International Atomic Energy Agency reports that 80\% of industrial accidents in the nuclear industry can be attributed to human error and 20\% to equipment failure. The Personal Augmented Reality Reference System (PARRS) is a suite of computer-mediated reality applications that looks to minimize human error by digitizing manual procedures and providing real-time monitoring of hazards present in an environment. Our mission is to be able to provide critical feedback to inform personnel in real-time and protect them from avoidable hazards. PARRS aims to minimize human error and increase worker productivity by bringing innovation to safety and procedural compliance by leveraging technologies such as augmented reality, LiDAR, computer machine learning and particulate mapping using remote systems.

scholarly journals AUGMENTED REALITY A NEW ERA IN EDUCATION

2020 ◽  
Vol 5 (2) ◽  
pp. 19-29
Author(s):  
Vivek Parashar
Keyword(s):  
Augmented Reality ◽  
Learning Process ◽  
Real World ◽  
Physical Environment ◽  
Virtual World ◽  
3D Models ◽  
Text Book ◽  
New Era ◽  
Virtual Objects ◽  
Education Industry

Augmented Reality is the technology using which we can integrate 3D virtual objects in our physical environment in real time. Augmented Reality helps us in bring the virtual world closer to our physical worlds and gives us the ability to interact with the surrounding. This paper will give you an idea that how Augmented Reality can transform Education Industry. In this paper we have used Augmented Reality to simplify the learning process and allow people to interact with 3D models with the help of gestures. This advancement in the technology is changing the way we interact with our surrounding, rather than watching videos or looking at a static diagram in your text book, Augmented Reality enables you to do more. So rather than putting someone in the animated world, the goal of augmented reality is to blend the virtual objects in the real world.

Educational Augmented Reality (AR) Applications and Development Process

2017 ◽  
pp. 26-53 ◽  
Author(s):  
Muzaffer Özdemir
Keyword(s):  
Augmented Reality ◽  
Real World ◽  
Development Process ◽  
Empirical Studies ◽  
Abstract Concepts ◽  
Development Stages ◽  
Development Tools ◽  
Sense Of Reality ◽  
Digital Objects

In recent years, presenting the useful information in an effective way has become a great necessity for educators. The opportunities provided by the AR technologies offer practical ways to meet this need of educators. By integrating the digital objects with real-world assets simultaneously, AR helps to concretize abstract concepts, and enhances the sense of reality, which in turn is a huge contribution to learning. In this chapter, it was presented the various limitations and advantages of AR revealed by some empirical studies in the literature. In addition, it was given information about AR development tools/ programs, add-on packages and presented development stages for an exemplary AR book page. The use of the Unity and Vuforia was explained as the development tools. It is believed that this information would be useful for those who will develop AR application which can be easily displayed by mobile or desktop PCs.

AN S-PI VISION-BASED TRACKING SYSTEM FOR OBJECT MANIPULATION IN AUGMENTED REALITY

2015 ◽  
Vol 75 (4) ◽  
Author(s):  
Ajune Wanis Ismail ◽  
Mark Bilinghust ◽  
Mohd Shahrizal Sunar
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Tracking System ◽  
Object Manipulation ◽  
3D Graphics ◽  
Virtual Objects ◽  
3D Objects ◽  
Time Calibration ◽  
Detection Stage ◽  
Vision Algorithm

In this paper, we describe a new tracking approach for object handling in Augmented Reality (AR). Our approach improves the standard vision-based tracking system during marker extraction and its detection stage. It transforms a unique tracking pattern into set of vertices which are able to perform interaction such as translate, rotate, and copy. This is based on arobust real-time computer vision algorithm that tracks a paddle that a person uses for input. A paddle pose pattern is constructed in a one-time calibration process and through vertex-based calculation of the camera pose relative to the paddle we can show 3D graphics on top of it. This allows the user to look at virtual objects from different viewing angles in the AR interface and perform 3D object manipulation. This approach was implemented using marker-based tracking to improve the tracking in term of the accuracy and robustness in manipulating 3D objects in real-time. We demonstrate our improved tracking system with a sample Tangible AR application, and describe how the system could be improved in the future.

scholarly journals Virtual Object Replacement Based on Real Environments: Potential Application in Augmented Reality Systems

2019 ◽  
Vol 9 (9) ◽  
pp. 1797
Author(s):  
Chen ◽  
Lin
Keyword(s):  
Augmented Reality ◽  
Virtual Environments ◽  
Real World ◽  
Point Clouds ◽  
Virtual Object ◽  
Movement Trajectory ◽  
The Real ◽  
Virtual Objects ◽  
Real Environment ◽  
Localization And Mapping

Augmented reality (AR) is an emerging technology that allows users to interact with simulated environments, including those emulating scenes in the real world. Most current AR technologies involve the placement of virtual objects within these scenes. However, difficulties in modeling real-world objects greatly limit the scope of the simulation, and thus the depth of the user experience. In this study, we developed a process by which to realize virtual environments that are based entirely on scenes in the real world. In modeling the real world, the proposed scheme divides scenes into discrete objects, which are then replaced with virtual objects. This enables users to interact in and with virtual environments without limitations. An RGB-D camera is used in conjunction with simultaneous localization and mapping (SLAM) to obtain the movement trajectory of the user and derive information related to the real environment. In modeling the environment, graph-based segmentation is used to segment point clouds and perform object segmentation to enable the subsequent replacement of objects with equivalent virtual entities. Superquadrics are used to derive shape parameters and location information from the segmentation results in order to ensure that the scale of the virtual objects matches the original objects in the real world. Only after the objects have been replaced with their virtual counterparts in the real environment converted into a virtual scene. Experiments involving the emulation of real-world locations demonstrated the feasibility of the proposed rendering scheme. A rock-climbing application scenario is finally presented to illustrate the potential use of the proposed system in AR applications.

Sign in / Sign up

Export Citation Format

Share Document