scholarly journals DESIGNING TRANSLATION TOOL: BETWEEN SIGN LANGUAGE TO SPOKEN TEXT ON KINECT TIME SERIES DATA USING DYNAMIC TIME WARPING

SINERGI ◽  
2018 ◽  
Vol 22 (2) ◽  
pp. 91
Author(s):  
Zico Pratama Putera ◽  
Mila Desi Anasanti ◽  
Bagus Priambodo
Keyword(s):  
User Interface ◽  
Sign Language ◽  
Dynamic Time Warping ◽  
User Study ◽  
Hearing Impaired ◽  
Microsoft Kinect ◽  
Series Data ◽  
Time Warping ◽  
Dynamic Gestures ◽  
Dynamic Time

The gesture is one of the most natural and expressive methods for the hearing impaired. Most researchers, however, focus on either static gestures, postures or a small group of dynamic gestures due to the complexity of dynamic gestures. We propose the Kinect Translation Tool to recognize the user's gesture. As a result, the Kinect Translation Tool can be used for bilateral communication with the deaf community. Since real-time detection of a large number of dynamic gestures is taken into account, some efficient algorithms and models are required. The dynamic time warping algorithm is used here to detect and translate the gesture. Kinect Sign Language should translate sign language into written and spoken words. Conversely, people can reply directly with their spoken word, which is converted into literal text together with the animated 3D sign language gestures. The user study, which included several prototypes of the user interface, was carried out with the observation of ten participants who had to gesture and spell the phrases in American Sign Language (ASL). The speech recognition tests for simple phrases have therefore shown good results. The system also recognized the participant's gesture very well during the test. The study suggested that a natural user interface with Microsoft Kinect could be interpreted as a sign language translator for the hearing impaired.

scholarly journals Do all aspects of learning benefit from iconicity? Evidence from motion capture

2019 ◽  
Vol 12 (1) ◽  
pp. 36-55
Author(s):  
ASHA SATO ◽  
MARIEKE SCHOUWSTRA ◽  
MOLLY FLAHERTY ◽  
SIMON KIRBY
Keyword(s):  
Language Learning ◽  
Sign Language ◽  
Motion Capture ◽  
Dynamic Time Warping ◽  
Negative Impact ◽  
Conclusive Evidence ◽  
Microsoft Kinect ◽  
Time Warping ◽  
3D Camera ◽  
Dynamic Time

abstractRecent work suggests that not all aspects of learning benefit from an iconicity advantage (Ortega, 2017). We present the results of an artificial sign language learning experiment testing the hypothesis that iconicity may help learners to learn mappings between forms and meanings, whilst having a negative impact on learning specific features of the form. We used a 3D camera (Microsoft Kinect) to capture participants’ gestures and quantify the accuracy with which they reproduce the target gestures in two conditions. In the iconic condition, participants were shown an artificial sign language consisting of congruent gesture–meaning pairs. In the arbitrary condition, the language consisted of non-congruent gesture–meaning pairs. We quantified the accuracy of participants’ gestures using dynamic time warping (Celebi et. al., 2013). Our results show that participants in the iconic condition learn mappings more successfully than participants in the arbitrary condition, but there is no difference in the accuracy with which participants reproduce the forms. While our work confirms that iconicity helps to establish form–meaning mappings, our study did not give conclusive evidence about the effect of iconicity on production; we suggest that iconicity may only have an impact on learning forms when these are complex.

scholarly journals Incremental fuzzy C medoids clustering of time series data using dynamic time warping distance

PLoS ONE ◽  
2018 ◽  
Vol 13 (5) ◽  
pp. e0197499 ◽  
Author(s):  
Yongli Liu ◽  
Jingli Chen ◽  
Shuai Wu ◽  
Zhizhong Liu ◽  
Hao Chao
Keyword(s):  
Time Series ◽  
Dynamic Time Warping ◽  
Time Series Data ◽  
Series Data ◽  
Time Warping ◽  
Dynamic Time

scholarly journals Pattern Matching Trading System Based on the Dynamic Time Warping Algorithm

2018 ◽  
Author(s):  
Sang Hyuk Kim ◽  
Hee Soo Lee ◽  
Hanjun Ko ◽  
Seung Hwan Jeong ◽  
Hyun Woo Byun ◽  
...  
Keyword(s):  
Financial Markets ◽  
Real Time ◽  
Pattern Matching ◽  
Dynamic Time Warping ◽  
Series Data ◽  
Time Warping ◽  
Trading System ◽  
Index Futures ◽  
Data Movement ◽  
Dynamic Time

The futures market plays a significant role in hedging and speculating by investors. Although various models and instruments are developed for real-time trading, it is difficult to realize profit by processing and trading a vast amount of real-time data. This study proposes a real-time index futures trading strategy that uses the pattern of KOSPI 200 index futures time series data. We construct a pattern matching trading system (PMTS) based on a dynamic time warping algorithm that recognizes patterns of market data movement in the morning and determines the afternoon's clearing strategy. We adopt 13 and 27 representative patterns and conduct simulations with various ranges of parameters to find optimal ones. Our experimental results show that the PMTS provides stable and effective trading strategies with relatively low trading frequencies. Investor communities that have sustained financial markets are able to make more efficient investments by using the PMTS. In this sense, the system developed in this paper is a sustainable investment technique and helps financial markets achieve efficient sustainability.

scholarly journals Free congruence: an exploration of expanded similarity measures for time series data

2021 ◽  
Author(s):  
Lucas Cassiel Jacaruso
Keyword(s):  
Time Series ◽  
Dynamic Time Warping ◽  
Time Series Data ◽  
Similarity Measures ◽  
Distance Measures ◽  
Series Data ◽  
Time Warping ◽  
Point To Point ◽  
Dynamic Time ◽  
Point Distance

Abstract Time series similarity measures are highly relevant in a wide range of emerging applications including training machine learning models, classification, and predictive modeling. Standard similarity measures for time series most often involve point-to-point distance measures including Euclidean distance and Dynamic Time Warping. Such similarity measures fundamentally require the fluctuation of values in the time series being compared to follow a corresponding order or cadence for similarity to be established. Other existing approaches use local statistical tests to detect structural changes in time series. This paper is spurred by the exploration of a broader definition of similarity, namely one that takes into account the sheer numerical resemblance between sets of statistical properties for time series segments irrespectively of value labeling. Further, the presence of common pattern components between time series segments was examined even if they occur in a permuted order, which would not necessarily satisfy the criteria of more conventional point-to-point distance measures. The newly defined similarity measures were tested on time series data representing over 20 years of cooperation intent expressed in global media sentiment. Tests determined whether the newly defined similarity measures would accurately identify stronger resemblance, on average, for pairings of similar time series segments (exhibiting overall decline) than pairings of differing segments (exhibiting overall decline and overall rise). The ability to identify patterns other than the obvious overall rise or decline that can accurately relate samples is regarded as a first step towards assessing the value of the newly explored similarity measures for classification or prediction. Results were compared with those of Dynamic Time Warping on the same data for context. Surprisingly, the test for numerical resemblance between sets of statistical properties established stronger resemblance for pairings of decline years with greater statistical significance than Dynamic Time Warping on the particular data and sample size used.

Segmented Dynamic Time Warping

2019 ◽  
pp. 1-19
Author(s):  
Ruizhe Ma ◽  
Azim Ahmadzadeh ◽  
Soukaina Filali Boubrahimi ◽  
Rafal A Angryk
Keyword(s):  
Dynamic Time Warping ◽  
Time Series Data ◽  
Series Data ◽  
Time Warping ◽  
Use Of Time ◽  
Computational Speed ◽  
Selection Parameters ◽  
And Performance ◽  
Dynamic Time ◽  
The Relationship

Initially used in speech recognition, the dynamic time warping algorithm (DTW) has regained popularity with the widespread use of time series data. While demonstrating good performance, this elastic measure has two significant drawbacks: high computational costs and the possibility of pathological warping paths. Due to the balance between performance and the tightness of restrictions, the effects of many improvement techniques are either limited in effect or use accuracy as a trade-off. In this chapter, the authors discuss segmented-DTW (segDTW) and its applications. The intuition behind significant features is first established. Then considering the variability of different datasets, the relationship between specific global feature selection parameters, feature numbers, and performance are demonstrated. Other than the improvement in computational speed and scalability, another advantage of segDTW is that while it can be a stand-alone heuristic, it can also be easily combined with other DTW improvement methods.

Sign in / Sign up

Export Citation Format

Share Document