Search of hidden properties in sensor data using recurrent neural networks

1999 ◽  
Author(s):  
Lissette Lemus del Cueto ◽  
Nancy Lopez ◽  
Luis J. Barrios ◽  
Roberto Cruz Moreno
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Sensor Data

scholarly journals An Autoencoder Gated Recurrent Unit for Remaining Useful Life Prediction

Processes ◽  
2020 ◽  
Vol 8 (9) ◽  
pp. 1155
Author(s):  
Yi-Wei Lu ◽  
Chia-Yu Hsu ◽  
Kuang-Chieh Huang
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Short Term Memory ◽  
Development Trend ◽  
Production Equipment ◽  
Remaining Useful Life ◽  
Sensor Data ◽  
Smart Manufacturing ◽  
Useful Life ◽  
Gated Recurrent Unit

With the development of smart manufacturing, in order to detect abnormal conditions of the equipment, a large number of sensors have been used to record the variables associated with production equipment. This study focuses on the prediction of Remaining Useful Life (RUL). RUL prediction is part of predictive maintenance, which uses the development trend of the machine to predict when the machine will malfunction. High accuracy of RUL prediction not only reduces the consumption of manpower and materials, but also reduces the need for future maintenance. This study focuses on detecting faults as early as possible, before the machine needs to be replaced or repaired, to ensure the reliability of the system. It is difficult to extract meaningful features from sensor data directly. This study proposes a model based on an Autoencoder Gated Recurrent Unit (AE-GRU), in which the Autoencoder (AE) extracts the important features from the raw data and the Gated Recurrent Unit (GRU) selects the information from the sequences to forecast RUL. To evaluate the performance of the proposed AE-GRU model, an aircraft turbofan engine degradation simulation dataset provided by NASA was used and a comparison made of different recurrent neural networks. The results demonstrate that the AE-GRU is better than other recurrent neural networks, such as Long Short-Term Memory (LSTM) and GRU.

scholarly journals Scalable Polyhedral Verification of Recurrent Neural Networks

2021 ◽  
pp. 225-248
Author(s):  
Wonryong Ryou ◽  
Jiayu Chen ◽  
Mislav Balunovic ◽  
Gagandeep Singh ◽  
Andrei Dan ◽  
...  
Keyword(s):  
Neural Networks ◽  
Computer Vision ◽  
Recurrent Neural Networks ◽  
Sensor Data ◽  
Motion Sensor ◽  
Use Case ◽  
Prior Work ◽  
Non Linear ◽  
Speech Classification ◽  
Sampling Optimization

AbstractWe present a scalable and precise verifier for recurrent neural networks, called Prover based on two novel ideas: (i) a method to compute a set of polyhedral abstractions for the non-convex and non-linear recurrent update functions by combining sampling, optimization, and Fermat’s theorem, and (ii) a gradient descent based algorithm for abstraction refinement guided by the certification problem that combines multiple abstractions for each neuron. Using Prover, we present the first study of certifying a non-trivial use case of recurrent neural networks, namely speech classification. To achieve this, we additionally develop custom abstractions for the non-linear speech preprocessing pipeline. Our evaluation shows that Prover successfully verifies several challenging recurrent models in computer vision, speech, and motion sensor data classification beyond the reach of prior work.

scholarly journals Attention-Based Convolutional and Recurrent Neural Networks for Driving Behavior Recognition Using Smartphone Sensor Data

IEEE Access ◽  
2019 ◽  
Vol 7 ◽  
pp. 148031-148046 ◽  
Author(s):  
Jun Zhang ◽  
Zhongcheng Wu ◽  
Fang Li ◽  
Jianfei Luo ◽  
Tingting Ren ◽  
...  
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Driving Behavior ◽  
Sensor Data ◽  
Behavior Recognition ◽  
Smartphone Sensor

scholarly journals Predicting Remaining Useful Life using Time Series Embeddings based on Recurrent Neural Networks

2020 ◽  
Vol 9 (1) ◽  
Author(s):  
Narendhar Gugulothu ◽  
Vishnu TV ◽  
Pankaj Malhotra ◽  
Lovekesh Vig ◽  
Puneet Agarwal ◽  
...  
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Recurrent Neural Networks ◽  
Missing Values ◽  
Multivariate Time Series ◽  
Remaining Useful Life ◽  
Sensor Data ◽  
Novel Approach ◽  
Useful Life ◽  
Robust To Noise

We consider the problem of estimating the remaining useful life (RUL) of a system or a machine from sensor data. Many approaches for RUL estimation based on sensor data make assumptions about how machines degrade. Additionally, sensor data from machines is noisy and often suffers from missing values in many practical settings. We propose Embed-RUL: a novel approach for RUL estimation from sensor data that does not rely on any degradation-trend assumptions, is robust to noise, and handles missing values. Embed-RUL utilizes a sequence-to-sequence model based on Recurrent Neural Networks (RNNs) to generate embeddings for multivariate time series subsequences. The embeddings for normal and degraded machines tend to be different, and are therefore found to be useful for RUL estimation. We show that the embeddings capture the overall pattern in the time series while filtering out the noise, so that the embeddings of two machines with similar operational behavior are close to each other, even when their sensor readings have significant and varying levels of noise content. We perform experiments on publicly available turbofan engine dataset and a proprietary real-world dataset, and demonstrate that Embed-RUL outperforms the previously reported state-of-the-art (Malhotra, TV, et al., 2016) on several metrics.

scholarly journals Using Deep Learning Methods to Monitor Non-Observable States in a Building

2020 ◽  
Vol 1 ◽  
pp. 6
Author(s):  
Kristoffer Tangrand ◽  
Bernt Bremdal
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Deep Learning ◽  
Recurrent Neural Networks ◽  
Training Data ◽  
Sensor Data ◽  
University Campus ◽  
Soft Sensors ◽  
Ongoing Research ◽  
Human Inspection

This paper presents results from ongoing research with a goal to use a combination of time series from non-intrusive soft sensors and deep recurrent neural networks to predict room usage at a university campus. Training data was created by collecting measurements from sensors measuring room CO2, humidity, temperature, light, motion and sound, while the labels was created manually by human inspection. Results include analyses of relationships between different sensor data sequences and recommendations for a prototype predictive model using deep recurrent neural networks.

Sign in / Sign up

Export Citation Format

Share Document