scholarly journals Anomaly Detection of Water Level Using Deep Autoencoder

Sensors ◽  
2021 ◽  
Vol 21 (19) ◽  
pp. 6679
Author(s):  
Isack Thomas Nicholaus ◽  
Jun Ryeol Park ◽  
Kyuil Jung ◽  
Jun Seoung Lee ◽  
Dae-Ki Kang
Keyword(s):  
Anomaly Detection ◽  
Time Series Data ◽  
Detection System ◽  
Water Levels ◽  
Sensor Data ◽  
Series Data ◽  
Network Architectures ◽  
Data Points ◽  
Water Tanks ◽  
The Given

Anomaly detection is one of the crucial tasks in daily infrastructure operations as it can prevent massive damage to devices or resources, which may then lead to catastrophic outcomes. To address this challenge, we propose an automated solution to detect anomaly pattern(s) of the water levels and report the analysis and time/point(s) of abnormality. This research’s motivation is the level difficulty and time-consuming managing facilities responsible for controlling water levels due to the rare occurrence of abnormal patterns. Consequently, we employed deep autoencoder, one of the types of artificial neural network architectures, to learn different patterns from the given sequences of data points and reconstruct them. Then we use the reconstructed patterns from the deep autoencoder together with a threshold to report which patterns are abnormal from the normal ones. We used a stream of time-series data collected from sensors to train the model and then evaluate it, ready for deployment as the anomaly detection system framework. We run extensive experiments on sensor data from water tanks. Our analysis shows why we conclude vanilla deep autoencoder as the most effective solution in this scenario.

scholarly journals Recent Advances in Anomaly Detection Methods Applied to Aviation

Aerospace ◽  
2019 ◽  
Vol 6 (11) ◽  
pp. 117 ◽  
Author(s):  
Luis Basora ◽  
Xavier Olive ◽  
Thomas Dubot
Keyword(s):  
Anomaly Detection ◽  
Time Series Data ◽  
Data Driven ◽  
Sensor Data ◽  
Detection Methods ◽  
Series Data ◽  
Detection Techniques ◽  
Advantages And Disadvantages ◽  
Recent Advances ◽  
Flight Operations

Anomaly detection is an active area of research with numerous methods and applications. This survey reviews the state-of-the-art of data-driven anomaly detection techniques and their application to the aviation domain. After a brief introduction to the main traditional data-driven methods for anomaly detection, we review the recent advances in the area of neural networks, deep learning and temporal-logic based learning. In particular, we cover unsupervised techniques applicable to time series data because of their relevance to the aviation domain, where the lack of labeled data is the most usual case, and the nature of flight trajectories and sensor data is sequential, or temporal. The advantages and disadvantages of each method are presented in terms of computational efficiency and detection efficacy. The second part of the survey explores the application of anomaly detection techniques to aviation and their contributions to the improvement of the safety and performance of flight operations and aviation systems. As far as we know, some of the presented methods have not yet found an application in the aviation domain. We review applications ranging from the identification of significant operational events in air traffic operations to the prediction of potential aviation system failures for predictive maintenance.

Excretion Detection System with Gas Sensor – Proposal and Verification of Algorithm Based on Time-Series Clustering –

2017 ◽  
Vol 29 (2) ◽  
pp. 353-363 ◽  
Author(s):  
Yoshimi Ui ◽  
◽  
Yutaka Akiba ◽  
Shohei Sugano ◽  
Ryosuke Imai ◽  
...  
Keyword(s):  
Time Series ◽  
Gas Sensor ◽  
Gas Sensors ◽  
Clustering Algorithm ◽  
Time Series Data ◽  
Detection System ◽  
Detection Algorithm ◽  
Sensor Data ◽  
Series Data ◽  
Processing Unit

[abstFig src='/00290002/09.jpg' width='300' text='Standard Lifilm configuration' ] In this study, we propose an excretion detection system, Lifi, which does not require sensors inside diapers, and we verify its capabilities. It consists of a sheet with strategically placed air intakes, a set of gas sensors, and a processing unit with a newly developed excretion detection algorithm. The gas sensor detects chemicals with odor in the excrement, such as hydrogen sulfide and urea. The time-series data from the gas sensor was used for the detection of not only excretion, but also of the presence/absence of the cared person on the bed. We examined two algorithms, one with a simple threshold and another based on the clustering of sensor data, obtained using the<span class=”bold”>k</span>-means method. The results from both algorithms were satisfactory and similar, once the algorithms were customized for each cared person. However, we adopted the clustering algorithm because it possesses a higher level of flexibility that can be explored and exploited. Lifi was conceived from an overwhelming and serious desire of caretakers to discover the excretion of bed-ridden cared persons, without opening their diapers. We believe that Lifi, along with the clustering algorithm, can help caretakers in this regard.

scholarly journals Recent Advances in Anomaly Detection Methods applied to Aviation

2019 ◽  
Author(s):  
Luis Basora ◽  
Xavier Olive ◽  
Thomas Dubot
Keyword(s):  
Anomaly Detection ◽  
Time Series Data ◽  
Data Driven ◽  
Sensor Data ◽  
Detection Methods ◽  
Series Data ◽  
Detection Techniques ◽  
Advantages And Disadvantages ◽  
Recent Advances ◽  
Flight Operations

Anomaly detection is an active area of research with numerous methods and applications. This survey reviews the state-of-the-art of data-driven anomaly detection techniques and their application to the the aviation domain. After a brief introduction to the main traditional data-driven methods for anomaly detection, we review the recent advances in the area of neural networks, deep learning and temporal-logic based learning. We cover especially unsupervised techniques applicable to time series data because of their relevance to the aviation domain, where the lack of labeled data is the most usual case, and the nature of flight trajectories and sensor data is sequential, or temporal. The advantages and disadvantages of each method are presented in terms of computational efficiency and detection efficacy. The second part of the survey explores the application of anomaly detection techniques to aviation and their contributions to the improvement of the safety and performance of flight operations and aviation systems. As far as we know, some of the presented methods have not yet found an application in the aviation domain. We review applications ranging from the identification of significant operational events in air traffic operations to the prediction of potential aviation system failures for predictive maintenance.

An Anomaly Detection Method with Exemplar Subsequence for Time Series Data

2016 ◽  
Vol 136 (3) ◽  
pp. 363-372
Author(s):  
Takaaki Nakamura ◽  
Makoto Imamura ◽  
Masashi Tatedoko ◽  
Norio Hirai
Keyword(s):  
Time Series ◽  
Anomaly Detection ◽  
Time Series Data ◽  
Detection Method ◽  
Series Data

Forecast of COVID-19 Cases in Nigeria: An implementation of an ARIMA model (Preprint)

2020 ◽  
Author(s):  
Sanyaolu Ameye ◽  
Michael Awoleye ◽  
Emmanuel Agogo ◽  
Ette Etuk
Keyword(s):  
Predictive Model ◽  
Time Series Data ◽  
Moving Average ◽  
Arima Model ◽  
Epidemiological Data ◽  
Series Data ◽  
Global Pandemic ◽  
First Case ◽  
Epidemiological Trend ◽  
Data Points

BACKGROUND The Coronavirus disease 2019 (COVID-2019) is a global pandemic and Nigeria is not left out in being affected. Though, the disease is just over three months since first case was identified in the country, we present a predictive model to forecast the number of cases expected to be seen in the country in the next 100 days. OBJECTIVE To implement a predictive model in forecasting the near future number of positive cases expected in the country following the present trend METHODS We performed an Auto Regressive Integrated Moving Average (ARIMA) model prediction on the epidemiological data obtained from Nigerian Centre for Disease Control to predict the epidemiological trend of the prevalence and incidence of COVID-2019. RESULTS There were 93 time series data points which lacked stationarity. From our ARIMA model, it is expected that the number of new cases declared per day will keep rising and towards the early September, 2020, Nigeria is expected to have well above sixty thousand confirmed cases. CONCLUSIONS We however believe that as we have more data points our model will be better fine-tuned.

scholarly journals Indirectly Supervised Anomaly Detection of Clinically Meaningful Health Events from Smart Home Data

2021 ◽  
Vol 12 (2) ◽  
pp. 1-18
Author(s):  
Jessamyn Dahmen ◽  
Diane J. Cook
Keyword(s):  
Anomaly Detection ◽  
Time Series Data ◽  
Bayesian Optimization ◽  
Detection Methods ◽  
Series Data ◽  
Detection Techniques ◽  
Health Events ◽  
Warm Start ◽  
Health Related ◽  
Unsupervised Algorithms

Anomaly detection techniques can extract a wealth of information about unusual events. Unfortunately, these methods yield an abundance of findings that are not of interest, obscuring relevant anomalies. In this work, we improve upon traditional anomaly detection methods by introducing Isudra, an Indirectly Supervised Detector of Relevant Anomalies from time series data. Isudra employs Bayesian optimization to select time scales, features, base detector algorithms, and algorithm hyperparameters that increase true positive and decrease false positive detection. This optimization is driven by a small amount of example anomalies, driving an indirectly supervised approach to anomaly detection. Additionally, we enhance the approach by introducing a warm-start method that reduces optimization time between similar problems. We validate the feasibility of Isudra to detect clinically relevant behavior anomalies from over 2M sensor readings collected in five smart homes, reflecting 26 health events. Results indicate that indirectly supervised anomaly detection outperforms both supervised and unsupervised algorithms at detecting instances of health-related anomalies such as falls, nocturia, depression, and weakness.

scholarly journals Remaining Useful Life Prediction Using Temporal Convolution with Attention

AI ◽  
2021 ◽  
Vol 2 (1) ◽  
pp. 48-70
Author(s):  
Wei Ming Tan ◽  
T. Hui Teo
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Time Series Data ◽  
Remaining Useful Life ◽  
Sensor Data ◽  
Series Data ◽  
Multiple Time ◽  
Data Set ◽  
Form Complex ◽  
Useful Life

Prognostic techniques attempt to predict the Remaining Useful Life (RUL) of a subsystem or a component. Such techniques often use sensor data which are periodically measured and recorded into a time series data set. Such multivariate data sets form complex and non-linear inter-dependencies through recorded time steps and between sensors. Many current existing algorithms for prognostic purposes starts to explore Deep Neural Network (DNN) and its effectiveness in the field. Although Deep Learning (DL) techniques outperform the traditional prognostic algorithms, the networks are generally complex to deploy or train. This paper proposes a Multi-variable Time Series (MTS) focused approach to prognostics that implements a lightweight Convolutional Neural Network (CNN) with attention mechanism. The convolution filters work to extract the abstract temporal patterns from the multiple time series, while the attention mechanisms review the information across the time axis and select the relevant information. The results suggest that the proposed method not only produces a superior accuracy of RUL estimation but it also trains many folds faster than the reported works. The superiority of deploying the network is also demonstrated on a lightweight hardware platform by not just being much compact, but also more efficient for the resource restricted environment.

scholarly journals Change Point Enhanced Anomaly Detection for IoT Time Series Data

Water ◽  
2021 ◽  
Vol 13 (12) ◽  
pp. 1633
Author(s):  
Elena-Simona Apostol ◽  
Ciprian-Octavian Truică ◽  
Florin Pop ◽  
Christian Esposito
Keyword(s):  
Time Series ◽  
Anomaly Detection ◽  
Change Point ◽  
Time Series Data ◽  
Multivariate Time Series ◽  
Change Point Detection ◽  
Change Points ◽  
Series Data ◽  
Prediction And Forecasting ◽  
Point Detection

Due to the exponential growth of the Internet of Things networks and the massive amount of time series data collected from these networks, it is essential to apply efficient methods for Big Data analysis in order to extract meaningful information and statistics. Anomaly detection is an important part of time series analysis, improving the quality of further analysis, such as prediction and forecasting. Thus, detecting sudden change points with normal behavior and using them to discriminate between abnormal behavior, i.e., outliers, is a crucial step used to minimize the false positive rate and to build accurate machine learning models for prediction and forecasting. In this paper, we propose a rule-based decision system that enhances anomaly detection in multivariate time series using change point detection. Our architecture uses a pipeline that automatically manages to detect real anomalies and remove the false positives introduced by change points. We employ both traditional and deep learning unsupervised algorithms, in total, five anomaly detection and five change point detection algorithms. Additionally, we propose a new confidence metric based on the support for a time series point to be an anomaly and the support for the same point to be a change point. In our experiments, we use a large real-world dataset containing multivariate time series about water consumption collected from smart meters. As an evaluation metric, we use Mean Absolute Error (MAE). The low MAE values show that the algorithms accurately determine anomalies and change points. The experimental results strengthen our assumption that anomaly detection can be improved by determining and removing change points as well as validates the correctness of our proposed rules in real-world scenarios. Furthermore, the proposed rule-based decision support systems enable users to make informed decisions regarding the status of the water distribution network and perform effectively predictive and proactive maintenance.

Sign in / Sign up

Export Citation Format

Share Document