scholarly journals A New Approach for Eye-Blink to Speech Conversion by Dynamic Time Warping

2021 ◽  
Vol 38 (2) ◽  
pp. 369-377
Author(s):  
Güneş Ekim ◽  
Ayten Atasoy ◽  
Nuri İkizler
Keyword(s):  
Environmental Factors ◽  
Dynamic Time Warping ◽  
High Speed ◽  
Single Channel ◽  
Low Cost ◽  
High Accuracy ◽  
Eye Tracker ◽  
Time Warping ◽  
Eye Blink ◽  
Dynamic Time

Motor neuron patients such as paralysis, locking syndrome, and amyotrophic lateral sclerosis can see and hear what is happening in their environment, but cannot communicate with their environment. It is very important for these patients, who do not have any physical function other than eye movements, to be able to express their needs, feelings and thoughts. Therefore, to express the thoughts, needs and feelings of these patients, a system that converts eye-blink signals to speech was developed in this study. The main purpose of the designed system is high accuracy, low cost, high speed and independence from environmental factors. Undoubtedly, it is also very important that it causes as little discomfort to the patient as possible. Morse-coded signals generated by voluntary eye-blinks and the single-channel wireless NeuroSky MindWave Mobile device eliminates the need for cost-increasing equipment such as a camera or eye tracker and environmental factors such as light. With the use of Dynamic Time Warping (DTW), an algorithm which works at high speed and high accuracy at the time domain and does not require any training process has been implemented. In this way, the recorded speech was performed with a quite impressive accuracy.

Identify Finger Rotation Angles With ArUco Markers and Action Cameras

2021 ◽  
Author(s):  
Tianyun Yuan ◽  
Yu (Wolf) Song ◽  
Gerald A. Kraan ◽  
Richard H. M. Goossens
Keyword(s):  
Dynamic Time Warping ◽  
Tracking System ◽  
Low Cost ◽  
Finger Joint ◽  
Hand Tracking ◽  
Human Hand ◽  
Time Warping ◽  
Joint Rotation ◽  
Dynamic Time ◽  
The Right

Abstract Measuring the motion of human hand joints is a challenging task due to the high number of DOFs. In this study, we proposed a low-cost hand tracking system built on action cameras and ArUco markers to measure finger joint rotation angles. The lens distortion of each camera was corrected first via intra-calibration and the videos of different cameras were aligned to the reference camera using a dynamic time warping based method. Two methods were proposed and implemented for extracting the rotation angles of finger joints: one is based on the 3D positions of the markers via inter-calibration between cameras, named pos-based method; the other one is based on the relative marker orientation information from individual cameras, named rot-based method. An experiment was conducted to evaluate the effectiveness of the proposed system. The right hand of a volunteer was included in this practical study, where the movement of the fingers was recorded and the finger rotation angles were calculated with the two proposed methods, respectively. The results indicated that although using the rot-based method may collect less data than using the pos-based method, it was more stable and reliable. Therefore, the rot-based method is recommended for measuring finger joint rotation in practical setups.

Study on Rapid Archival Technology of Bullets Based on Graph Convolutional Neural Network

2021 ◽  
Author(s):  
Shi-bo Pan ◽  
Di-lin Pan ◽  
Nan Pan ◽  
Xiao Ye ◽  
Miaohan Zhang
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Neural Network Model ◽  
Dynamic Time Warping ◽  
Large Scale ◽  
Line Graph ◽  
High Accuracy ◽  
Time Warping ◽  
Large Numbers ◽  
Dynamic Time

Traditional gun archiving methods are mostly carried out through bullets’ physics or photography, which are inefficient and difficult to trace, and cannot meet the needs of large-scale archiving. Aiming at such problems, a rapid archival technology of bullets based on graph convolutional neural network has been studied and developed. First, the spot laser is used to take the circle points of the bullet rifling traces. The obtained data is filtered and noise-reduced to make the corresponding line graph, and then the dynamic time warping (DTW) algorithm convolutional neural network model is used to perform the processing on the processed data. Not only is similarity matched, the rapid matching of the rifling of the bullet is also accomplished. Comparison of experimental results shows that this technology has the advantages of rapid archiving and high accuracy. Furthermore, it can be carried out in large numbers at the same time, and is more suitable for practical promotion and application.

scholarly journals Detection of Freezing of Gait Using Template-Matching-Based Approaches

2017 ◽  
Vol 2017 ◽  
pp. 1-8 ◽  
Author(s):  
Cheng Xu ◽  
Jie He ◽  
Xiaotong Zhang ◽  
Cunda Wang ◽  
Shihong Duan
Keyword(s):  
Template Matching ◽  
Dynamic Time Warping ◽  
High Efficiency ◽  
Freezing Of Gait ◽  
Experimental Tests ◽  
High Accuracy ◽  
Detection Methods ◽  
Time Warping ◽  
Experimental Accuracy ◽  
Dynamic Time

Every year, injuries associated with fall incidences cause lots of human suffering and assets loss for Parkinson’s disease (PD) patients. Thereinto, freezing of gait (FOG), which is one of the most common symptoms of PD, is quite responsible for most incidents. Although lots of researches have been done on characterized analysis and detection methods of FOG, large room for improvement still exists in the high accuracy and high efficiency examination of FOG. In view of the above requirements, this paper presents a template-matching-based improved subsequence Dynamic Time Warping (IsDTW) method, and experimental tests were carried out on typical open source datasets. Results show that, compared with traditional template-matching and statistical learning methods, proposed IsDTW not only embodies higher experimental accuracy (92%) but also has a significant runtime efficiency. By contrast, IsDTW is far more available in real-time practice applications.

scholarly journals Efficient Detection of Robot Kidnapping in Range Finder-Based Indoor Localization Using Quasi-Standardized 2D Dynamic Time Warping

2021 ◽  
Vol 11 (4) ◽  
pp. 1580
Author(s):  
Zool H. Ismail ◽  
Iksan Bukhori
Keyword(s):  
Dynamic Time Warping ◽  
High Performance ◽  
Indoor Localization ◽  
High Accuracy ◽  
Range Finder ◽  
Time Warping ◽  
Efficient Detection ◽  
The Face ◽  
Scan Data ◽  
Dynamic Time

This paper proposes an augmented online approach to detect kidnapping events within range-finder-based indoor localization. The method is specifically designed for an Internet of Things (IoT)-Aided Robotics Platform that enables the system to detect kidnapping across all time instances of an indoor mobile robotic operation with high accuracy and maintain a high accuracy in the face of relocalization failures. The approach is based on similarity degree of geometry shape of the environment obtained from range scan data between two consecutive time instances. The proposed approach named Quasi-Standardized Two-Dimensional Dynamic Time Warping (QS-2DDTW) is based on the Multidimensional Dynamic Time Warping (MD-DTW) with homogeneity variance test imbued in it. A series of simulations are preformed against maximum current weight, measurement entropy, and the four metrics in metric based detector. The result shows that the proposed method yields high performance in terms of its ability to distinguish kidnapping condition from normal condition and that it has low dependency towards relocalization process, thus ensures the accuracy of detection is not disturbed by relocalization.

scholarly journals Choreographic Pattern Analysis from Heterogeneous Motion Capture Systems Using Dynamic Time Warping

Technologies ◽  
2019 ◽  
Vol 7 (3) ◽  
pp. 56 ◽  
Author(s):  
Ioannis Rallis ◽  
Eftychios Protopapadakis ◽  
Athanasios Voulodimos ◽  
Nikolaos Doulamis ◽  
Anastasios Doulamis ◽  
...  
Keyword(s):  
Cultural Heritage ◽  
Dynamic Time Warping ◽  
Pattern Analysis ◽  
Low Cost ◽  
Real Life ◽  
Time Warping ◽  
3D Space ◽  
Equal Importance ◽  
Dynamic Time ◽  
Interpretation Method

The convention for the safeguarding of Intangible Cultural Heritage (ICH) by UNESCO highlights the equal importance of intangible elements of cultural heritage to tangible ones. One of the most important domains of ICH is folkloric dances. A dance choreography is a time-varying 3D process (4D modelling), which includes dynamic co-interactions among different actors, emotional and style attributes, and supplementary elements, such as music tempo and costumes. Presently, research focuses on the use of depth acquisition sensors, to handle kinesiology issues. The extraction of skeleton data, in real time, contains a significant amount of information (data and metadata), allowing for various choreography-based analytics. In this paper, a trajectory interpretation method for Greek folkloric dances is presented. We focus on matching trajectories’ patterns, existing in a choreographic database, to new ones originating from different sensor types such as VICON and Kinect II. Then, a Dynamic Time Warping (DTW) algorithm is proposed to find out similarities/dissimilarities among the choreographic trajectories. The goal is to evaluate the performance of the low-cost Kinect II sensor for dance choreography compared to the accurate but of high-cost VICON-based choreographies. Experimental results on real-life dances are carried out to show the effectiveness of the proposed DTW methodology and the ability of Kinect II to localize dances in 3D space.

Sign in / Sign up

Export Citation Format

Share Document