Vision-based overlay of a virtual object into real scene for designing room interior

2001 ◽  
Author(s):  
Shunsuke Harasaki ◽  
Hideo Saito
Keyword(s):  
Virtual Object ◽  
Real Scene

scholarly journals Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools

2020 ◽  
Vol 10 (15) ◽  
pp. 5344
Author(s):  
Mehmet Murat Aygün ◽  
Yusuf Çağrı Öğüt ◽  
Hulusi Baysal ◽  
Yiğit Taşcıoğlu
Keyword(s):  
Mixed Reality ◽  
Real Life ◽  
General Purpose ◽  
Virtual Object ◽  
Tennis Ball ◽  
Real Scene ◽  
Simple Simulation ◽  
Kinesthetic Feedback ◽  
Simulation Scenario ◽  
Torque Transducer

Visuo-haptic mixed reality (VHMR) adds virtual objects to a real scene and enables users to see and also touch them via a see-through display and a haptic device. Most studies with kinesthetic feedback use general-purpose haptic devices, which require the user to continuously hold an attached stylus. This approach constrains users to the mechanical limits of the device even when it is not needed. In this paper, we propose a novel VHMR concept with an encountered-type haptic display (ETHD), which consists of a precision hexapod positioner and a six-axis force/torque transducer. The main contribution is that the users work with unbound real-life tools with tracking markers. ETHD’s end-effector remains inside the virtual object and follows the tooltip to engage only during an interaction. We have developed a simulation setup and experimentally evaluated the relative accuracy and synchronization of the three major processes, namely tool tracking, haptic rendering, and visual rendering. The experiments successfully build-up to a simple simulation scenario where a tennis ball with a fixed center is deformed by the user.

scholarly journals A Global-Local Blur Disentangling Network for Dynamic Scene Deblurring

2021 ◽  
Vol 11 (5) ◽  
pp. 2174
Author(s):  
Xiaoguang Li ◽  
Feifan Yang ◽  
Jianglu Huang ◽  
Li Zhuo
Keyword(s):  
Local Features ◽  
Attention Mechanism ◽  
Experimental Results ◽  
Dynamic Scene ◽  
Feature Maps ◽  
Training Scheme ◽  
Real Scene ◽  
Global And Local

Images captured in a real scene usually suffer from complex non-uniform degradation, which includes both global and local blurs. It is difficult to handle the complex blur variances by a unified processing model. We propose a global-local blur disentangling network, which can effectively extract global and local blur features via two branches. A phased training scheme is designed to disentangle the global and local blur features, that is the branches are trained with task-specific datasets, respectively. A branch attention mechanism is introduced to dynamically fuse global and local features. Complex blurry images are used to train the attention module and the reconstruction module. The visualized feature maps of different branches indicated that our dual-branch network can decouple the global and local blur features efficiently. Experimental results show that the proposed dual-branch blur disentangling network can improve both the subjective and objective deblurring effects for real captured images.

scholarly journals Mirror neurons are modulated by grip force and reward expectation in the sensorimotor cortices (S1, M1, PMd, PMv)

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Md Moin Uddin Atique ◽  
Joseph Thachil Francis
Keyword(s):  
Neural Activity ◽  
Visual Information ◽  
Mirror Neurons ◽  
Grip Force ◽  
Neural Representation ◽  
Virtual Object ◽  
Time Lags ◽  
Subjective Value ◽  
Machine Interface ◽  
Definition Of

AbstractMirror Neurons (MNs) respond similarly when primates make or observe grasping movements. Recent work indicates that reward expectation influences rostral M1 (rM1) during manual, observational, and Brain Machine Interface (BMI) reaching movements. Previous work showed MNs are modulated by subjective value. Here we expand on the above work utilizing two non-human primates (NHPs), one male Macaca Radiata (NHP S) and one female Macaca Mulatta (NHP P), that were trained to perform a cued reward level isometric grip-force task, where the NHPs had to apply visually cued grip-force to move and transport a virtual object. We found a population of (S1 area 1–2, rM1, PMd, PMv) units that significantly represented grip-force during manual and observational trials. We found the neural representation of visually cued force was similar during observational trials and manual trials for the same units; however, the representation was weaker during observational trials. Comparing changes in neural time lags between manual and observational tasks indicated that a subpopulation fit the standard MN definition of observational neural activity lagging the visual information. Neural activity in (S1 areas 1–2, rM1, PMd, PMv) significantly represented force and reward expectation. In summary, we present results indicating that sensorimotor cortices have MNs for visually cued force and value.

scholarly journals Self-Localization of Mobile Robots Using a Single Catadioptric Camera with Line Feature Extraction

Sensors ◽  
2021 ◽  
Vol 21 (14) ◽  
pp. 4719
Author(s):  
Huei-Yung Lin ◽  
Yuan-Chi Chung ◽  
Ming-Liang Wang
Keyword(s):  
Mobile Robots ◽  
Ground Plane ◽  
Feature Correspondence ◽  
Projection Model ◽  
3D Space ◽  
Base Points ◽  
Real Scene ◽  
Correspondence Matching ◽  
Mobile Robot Localization ◽  
Catadioptric Camera

This paper presents a novel self-localization technique for mobile robots using a central catadioptric camera. A unified sphere model for the image projection is derived by the catadioptric camera calibration. The geometric property of the camera projection model is utilized to obtain the intersections of the vertical lines and ground plane in the scene. Different from the conventional stereo vision techniques, the feature points are projected onto a known planar surface, and the plane equation is used for depth computation. The 3D coordinates of the base points on the ground are calculated using the consecutive image frames. The derivation of motion trajectory is then carried out based on the computation of rotation and translation between the robot positions. We develop an algorithm for feature correspondence matching based on the invariability of the structure in the 3D space. The experimental results obtained using the real scene images have demonstrated the feasibility of the proposed method for mobile robot localization applications.

scholarly journals Research on Real Scene 3D Modelling Based on Multi-view

2021 ◽  
Vol 1852 (2) ◽  
pp. 022080
Author(s):  
Rui Liu ◽  
Liwu Yao ◽  
Lei Yan ◽  
Heping Li ◽  
Xiaolong Liu ◽  
...  
Keyword(s):  
3D Modelling ◽  
Real Scene

scholarly journals Kinematic of the Position and Orientation Synchronization of the Posture of a n DoF Upper-Limb Exoskeleton with a Virtual Object in an Immersive Virtual Reality Environment

Electronics ◽  
2021 ◽  
Vol 10 (9) ◽  
pp. 1069
Author(s):  
Deyby Huamanchahua ◽  
Adriana Vargas-Martinez ◽  
Ricardo Ramirez-Mendoza
Keyword(s):  
Virtual Reality ◽  
Upper Limb ◽  
Human Performance ◽  
Early Stage ◽  
Inverse Kinematic ◽  
Virtual Object ◽  
Immersive Virtual Reality ◽  
Virtual Reality Environment ◽  
Upper Limb Exoskeleton ◽  
Position And Orientation

Exoskeletons are an external structural mechanism with joints and links that work in tandem with the user, which increases, reinforces, or restores human performance. Virtual Reality can be used to produce environments, in which the intensity of practice and feedback on performance can be manipulated to provide tailored motor training. Will it be possible to combine both technologies and have them synchronized to reach better performance? This paper consists of the kinematics analysis for the position and orientation synchronization between an n DoF upper-limb exoskeleton pose and a projected object in an immersive virtual reality environment using a VR headset. To achieve this goal, the exoskeletal mechanism is analyzed using Euler angles and the Pieper technique to obtain the equations that lead to its orientation, forward, and inverse kinematic models. This paper extends the author’s previous work by using an early stage upper-limb exoskeleton prototype for the synchronization process.

scholarly journals High-precision 3D real scene model construction method based on air-ground data combination

2020 ◽  
Vol 570 ◽  
pp. 042022
Author(s):  
Fei Yang ◽  
Chengrong Ma ◽  
Bowen Zhang ◽  
Xuannan Chen ◽  
Li Cao ◽  
...  
Keyword(s):  
High Precision ◽  
Construction Method ◽  
Model Construction ◽  
Data Combination ◽  
Real Scene

scholarly journals Inside Touch: Presentation of Tactile Feeling Inside Virtual Object Using Finger-Mounted Pin-Array Display

IEEE Access ◽  
2021 ◽  
pp. 1-1
Author(s):  
Yusuke Ota ◽  
Yusuke Ujitoko ◽  
Sho Sakurai ◽  
Takuya Nojima ◽  
Koichi Hirota
Keyword(s):  
Virtual Object

An automatic decision algorithm and simulation performance analysis for public safety

2021 ◽  
pp. 1-12
Author(s):  
Xiangwei Qi ◽  
Weimin Pan ◽  
Bingcai Chen ◽  
Gulila Altenbek
Keyword(s):  
Emergency Response ◽  
Terrorist Attack ◽  
Scheduling Algorithm ◽  
Terrorist Attacks ◽  
Mathematical Form ◽  
Decision Algorithm ◽  
Simulation Performance ◽  
Whole Process ◽  
Real Scene ◽  
Crowd Evacuation

As the current society is increasingly facing major challenges from extremism and terrorism, protecting key urban public facilities and important targets from destruction is an important challenge facing the security departments of all countries. Based on real scene, this paper conducts researches on anti-terrorism security game algorithms and emergency response models in response to the three key links of before, during and after terrorist attacks. First of all, this paper constructs a multi-round joint attack game and emergency response model based on cooperation, establishes the optimization problem of solving the defender’s optimal strategy in mathematical form, and then obtains the optimal defense strategy. Secondly, in response to the fact that terrorists are not completely rational, a new hybrid model is constructed to propose an efficient allocation and scheduling algorithm for safe resources in response to terrorist attacks. Thirdly, a model of crowd evacuation strategy after a terrorist attack is built based on the problem of crowd evacuation in multiple rounds of premeditated cooperative attacks. Finally, taking the area of the first ring of a certain city as a real scene, a complete game system of the whole process is constructed, and the game effectiveness evaluation of the existing security resource allocation scheme in the first ring area is carried out. Through the research of this thesis, the author puts forward some new technical ideas for the current society’s anti-terrorism governance, and hopes to provide some technical references for the decision-making of security agencies.

Sign in / Sign up

Export Citation Format

Share Document