scholarly journals Image Generation for 2D-CNN Using Time-Series Signal Features from Foot Gesture Applied to Select Cobot Operating Mode

Sensors ◽  
2021 ◽  
Vol 21 (17) ◽  
pp. 5743
Author(s):  
Fadwa El Aswad ◽  
Gilde Vanel Tchane Djogdom ◽  
Martin J.-D. Otis ◽  
Johannes C. Ayena ◽  
Ramy Meziane
Keyword(s):  
Time Series ◽  
Inertial Measurement Unit ◽  
Statistical Approach ◽  
Industrial Robot ◽  
Recognition Rate ◽  
Operating Mode ◽  
Measurement Unit ◽  
Image Generation ◽  
Signal Features ◽  
Control Scheme

Advances in robotics are part of reducing the burden associated with manufacturing tasks in workers. For example, the cobot could be used as a “third-arm” during the assembling task. Thus, the necessity of designing new intuitive control modalities arises. This paper presents a foot gesture approach centered on robot control constraints to switch between four operating modalities. This control scheme is based on raw data acquired by an instrumented insole located at a human’s foot. It is composed of an inertial measurement unit (IMU) and four force sensors. Firstly, a gesture dictionary was proposed and, from data acquired, a set of 78 features was computed with a statistical approach, and later reduced to 3 via variance analysis ANOVA. Then, the time series collected data were converted into a 2D image and provided as an input for a 2D convolutional neural network (CNN) for the recognition of foot gestures. Every gesture was assimilated to a predefined cobot operating mode. The offline recognition rate appears to be highly dependent on the features to be considered and their spatial representation in 2D image. We achieve a higher recognition rate for a specific representation of features by sets of triangular and rectangular forms. These results were encouraging in the use of CNN to recognize foot gestures, which then will be associated with a command to control an industrial robot.

scholarly journals A Walking-in-Place Method for Virtual Reality Using Position and Orientation Tracking

Sensors ◽  
2018 ◽  
Vol 18 (9) ◽  
pp. 2832 ◽  
Author(s):  
Juyoung Lee ◽  
Sang Chul Ahn ◽  
Jae-In Hwang
Keyword(s):  
Virtual Reality ◽  
Inertial Measurement Unit ◽  
Recognition Rate ◽  
Head Tilt ◽  
The Body ◽  
Measurement Unit ◽  
Position And Orientation ◽  
Intentional Motion ◽  
Navigation Method ◽  
Virtual Velocity

People are interested in traveling in an infinite virtual environment, but no standard navigation method exists yet in Virtual Reality (VR). The Walking-In-Place (WIP) technique is a navigation method that simulates movement to enable immersive travel with less simulator sickness in VR. However, attaching the sensor to the body is troublesome. A previously introduced method that performed WIP using an Inertial Measurement Unit (IMU) helped address this problem. That method does not require placement of additional sensors on the body. That study proved, through evaluation, the acceptable performance of WIP. However, this method has limitations, including a high step-recognition rate when the user does various body motions within the tracking area. Previous works also did not evaluate WIP step recognition accuracy. In this paper, we propose a novel WIP method using position and orientation tracking, which are provided in the most PC-based VR HMDs. Our method also does not require additional sensors on the body and is more stable than the IMU-based method for non-WIP motions. We evaluated our method with nine subjects and found that the WIP step accuracy was 99.32% regardless of head tilt, and the error rate was 0% for squat motion, which is a motion prone to error. We distinguish jog-in-place as “intentional motion” and others as “unintentional motion”. This shows that our method correctly recognizes only jog-in-place. We also apply the saw-tooth function virtual velocity to our method in a mathematical way. Natural navigation is possible when the virtual velocity approach is applied to the WIP method. Our method is useful for various applications which requires jogging.

Bearing Metrics for Health Monitoring of Machine Tool Linear Axes

2019 ◽  
Author(s):  
Gregory W. Vogl ◽  
Brian C. Galfond ◽  
N. Jordan Jameson
Keyword(s):  
Standard Deviation ◽  
Inertial Measurement Unit ◽  
Ball Bearing ◽  
Geometric Error ◽  
Rotating Machinery ◽  
Measurement Unit ◽  
Ball Bearings ◽  
Statistical Population ◽  
Inertial Measurement ◽  
Signal Features

Abstract Diagnostics and prognostics of rotating machinery ball bearings is quite mature with an abundance of available methods and algorithms. However, extending these algorithms to other ball bearing applications is challenging and may not yield usable results. This work used a linear axis to study the ability of an inertial measurement unit (IMU), along with nine signal features, to measure changes in geometric error motions due to induced faults on the recirculating ball bearings of two carriage trucks. The IMU data was analyzed with the nine features used for rotating machinery systems, including root-mean-square, standard deviation, and kurtosis. For each stage of degradation, the statistical population and median value of each feature were compared against the population and median for no degradation, to monitor feature changes due to ball damage. Correlation analyses revealed an ability of the standard deviation feature to detect statistically significant changes as small as 0.05 micrometers or 0.5 microradians, corresponding to a total damaged surface area of truck balls of less than 0.1 percent.

scholarly journals Automatically evaluating balance using machine learning and data from a single inertial measurement unit

2021 ◽  
Vol 18 (1) ◽  
Author(s):  
Fahad Kamran ◽  
Kathryn Harrold ◽  
Jonathan Zwier ◽  
Wendy Carender ◽  
Tian Bao ◽  
...  
Keyword(s):  
Machine Learning ◽  
Inertial Measurement Unit ◽  
Physical Therapists ◽  
Physical Therapist ◽  
Model Performance ◽  
Machine Learning Techniques ◽  
Measurement Unit ◽  
Balance Performance ◽  
Inertial Measurement ◽  
Self Assessments

Abstract Background Recently, machine learning techniques have been applied to data collected from inertial measurement units to automatically assess balance, but rely on hand-engineered features. We explore the utility of machine learning to automatically extract important features from inertial measurement unit data for balance assessment. Findings Ten participants with balance concerns performed multiple balance exercises in a laboratory setting while wearing an inertial measurement unit on their lower back. Physical therapists watched video recordings of participants performing the exercises and rated balance on a 5-point scale. We trained machine learning models using different representations of the unprocessed inertial measurement unit data to estimate physical therapist ratings. On a held-out test set, we compared these learned models to one another, to participants’ self-assessments of balance, and to models trained using hand-engineered features. Utilizing the unprocessed kinematic data from the inertial measurement unit provided significant improvements over both self-assessments and models using hand-engineered features (AUROC of 0.806 vs. 0.768, 0.665). Conclusions Unprocessed data from an inertial measurement unit used as input to a machine learning model produced accurate estimates of balance performance. The ability to learn from unprocessed data presents a potentially generalizable approach for assessing balance without the need for labor-intensive feature engineering, while maintaining comparable model performance.

A Polishing Robot Force Control System Based on Time Series Data in Industrial Internet of Things

2021 ◽  
Vol 21 (2) ◽  
pp. 1-22
Author(s):  
Chen Zhang ◽  
Zhuo Tang ◽  
Kenli Li ◽  
Jianzhong Yang ◽  
Li Yang
Keyword(s):  
Time Series ◽  
Control System ◽  
Force Control ◽  
Time Series Data ◽  
Industrial Robot ◽  
Industrial Robots ◽  
Series Data ◽  
Industrial Internet Of Things ◽  
Industrial Internet ◽  
Force Control System

Installing a six-dimensional force/torque sensor on an industrial arm for force feedback is a common robotic force control strategy. However, because of the high price of force/torque sensors and the closedness of an industrial robot control system, this method is not convenient for industrial mass production applications. Various types of data generated by industrial robots during the polishing process can be saved, transmitted, and applied, benefiting from the growth of the industrial internet of things (IIoT). Therefore, we propose a constant force control system that combines an industrial robot control system and industrial robot offline programming software for a polishing robot based on IIoT time series data. The system mainly consists of four parts, which can achieve constant force polishing of industrial robots in mass production. (1) Data collection module. Install a six-dimensional force/torque sensor at a manipulator and collect the robot data (current series data, etc.) and sensor data (force/torque series data). (2) Data analysis module. Establish a relationship model based on variant long short-term memory which we propose between current time series data of the polishing manipulator and data of the force sensor. (3) Data prediction module. A large number of sensorless polishing robots of the same type can utilize that model to predict force time series. (4) Trajectory optimization module. The polishing trajectories can be adjusted according to the prediction sequences. The experiments verified that the relational model we proposed has an accurate prediction, small error, and a manipulator taking advantage of this method has a better polishing effect.

scholarly journals The Accelerations of a Wave Measurement Buoy Impacted by Breaking Waves in the Surf Zone

2021 ◽  
Vol 9 (2) ◽  
pp. 214
Author(s):  
Adam C. Brown ◽  
Robert K. Paasch
Keyword(s):  
Inertial Measurement Unit ◽  
Surf Zone ◽  
Spherical Wave ◽  
Breaking Waves ◽  
Measurement Unit ◽  
High Fidelity ◽  
Wave Measurement ◽  
Near Shore ◽  
Shoaling Waves ◽  
Multiple Deployments

A spherical wave measurement buoy capable of detecting breaking waves has been designed and built. The buoy is 16 inches in diameter and houses a 9 degree of freedom inertial measurement unit (IMU). The orientation and acceleration of the buoy is continuously logged at frequencies up to 200 Hz providing a high fidelity description of the motion of the buoy as it is impacted by breaking waves. The buoy was deployed several times throughout the winter of 2013–2014. Both moored and free-drifting data were acquired in near-shore shoaling waves off the coast of Newport, OR. Almost 200 breaking waves of varying type and intensity were measured over the course of multiple deployments. The characteristic signature of spilling and plunging breakers was identified in the IMU data.

scholarly journals Inertial Measurement Unit Sensors in Assistive Technologies for Visually Impaired People, a Review

Sensors ◽  
2021 ◽  
Vol 21 (14) ◽  
pp. 4767
Author(s):  
Karla Miriam Reyes Leiva ◽  
Milagros Jaén-Vargas ◽  
Benito Codina ◽  
José Javier Serrano Olmedo
Keyword(s):  
Inertial Measurement Unit ◽  
Visually Impaired ◽  
Inertial Sensors ◽  
Assistive Technologies ◽  
Biomechanical Analysis ◽  
Measurement Unit ◽  
Inertial Measurement ◽  
Visually Impaired People ◽  
Impaired People ◽  
Application Fields

A diverse array of assistive technologies have been developed to help Visually Impaired People (VIP) face many basic daily autonomy challenges. Inertial measurement unit sensors, on the other hand, have been used for navigation, guidance, and localization but especially for full body motion tracking due to their low cost and miniaturization, which have allowed the estimation of kinematic parameters and biomechanical analysis for different field of applications. The aim of this work was to present a comprehensive approach of assistive technologies for VIP that include inertial sensors as input, producing results on the comprehension of technical characteristics of the inertial sensors, the methodologies applied, and their specific role in each developed system. The results show that there are just a few inertial sensor-based systems. However, these sensors provide essential information when combined with optical sensors and radio signals for navigation and special application fields. The discussion includes new avenues of research, missing elements, and usability analysis, since a limitation evidenced in the selected articles is the lack of user-centered designs. Finally, regarding application fields, it has been highlighted that a gap exists in the literature regarding aids for rehabilitation and biomechanical analysis of VIP. Most of the findings are focused on navigation and obstacle detection, and this should be considered for future applications.

scholarly journals Early Detection of Freezing of Gait during Walking Using Inertial Measurement Unit and Plantar Pressure Distribution Data

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2246
Author(s):  
Scott Pardoel ◽  
Gaurav Shalin ◽  
Julie Nantel ◽  
Edward D. Lemaire ◽  
Jonathan Kofman
Keyword(s):  
Early Detection ◽  
Plantar Pressure ◽  
Inertial Measurement Unit ◽  
Binary Classification ◽  
Freezing Of Gait ◽  
Pressure Sensors ◽  
Measurement Unit ◽  
Distribution Data ◽  
Inertial Measurement ◽  
Plantar Pressure Distribution

Freezing of gait (FOG) is a sudden and highly disruptive gait dysfunction that appears in mid to late-stage Parkinson’s disease (PD) and can lead to falling and injury. A system that predicts freezing before it occurs or detects freezing immediately after onset would generate an opportunity for FOG prevention or mitigation and thus enhance safe mobility and quality of life. This research used accelerometer, gyroscope, and plantar pressure sensors to extract 861 features from walking data collected from 11 people with FOG. Minimum-redundancy maximum-relevance and Relief-F feature selection were performed prior to training boosted ensembles of decision trees. The binary classification models identified Total-FOG or No FOG states, wherein the Total-FOG class included data windows from 2 s before the FOG onset until the end of the FOG episode. Three feature sets were compared: plantar pressure, inertial measurement unit (IMU), and both plantar pressure and IMU features. The plantar-pressure-only model had the greatest sensitivity and the IMU-only model had the greatest specificity. The best overall model used the combination of plantar pressure and IMU features, achieving 76.4% sensitivity and 86.2% specificity. Next, the Total-FOG class components were evaluated individually (i.e., Pre-FOG windows, Freeze windows, transition windows between Pre-FOG and Freeze). The best model detected windows that contained both Pre-FOG and FOG data with 85.2% sensitivity, which is equivalent to detecting FOG less than 1 s after the freeze began. Windows of FOG data were detected with 93.4% sensitivity. The IMU and plantar pressure feature-based model slightly outperformed models that used data from a single sensor type. The model achieved early detection by identifying the transition from Pre-FOG to FOG while maintaining excellent FOG detection performance (93.4% sensitivity). Therefore, if used as part of an intelligent, real-time FOG identification and cueing system, even if the Pre-FOG state were missed, the model would perform well as a freeze detection and cueing system that could improve the mobility and independence of people with PD during their daily activities.

Sign in / Sign up

Export Citation Format

Share Document