scholarly journals Sensor Classification Using Convolutional Neural Network by Encoding Multivariate Time Series as Two-Dimensional Colored Images

Sensors ◽  
2019 ◽  
Vol 20 (1) ◽  
pp. 168 ◽  
Author(s):  
Chao-Lung Yang ◽  
Zhi-Xuan Chen ◽  
Chen-Yi Yang
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Convolutional Neural Network ◽  
Classification Accuracy ◽  
Multivariate Time Series ◽  
Complex Structure ◽  
Series Data ◽  
Two Dimensional ◽  
Transformation Methods ◽  
The Impact

This paper proposes a framework to perform the sensor classification by using multivariate time series sensors data as inputs. The framework encodes multivariate time series data into two-dimensional colored images, and concatenate the images into one bigger image for classification through a Convolutional Neural Network (ConvNet). This study applied three transformation methods to encode time series into images: Gramian Angular Summation Field (GASF), Gramian Angular Difference Field (GADF), and Markov Transition Field (MTF). Two open multivariate datasets were used to evaluate the impact of using different transformation methods, the sequences of concatenating images, and the complexity of ConvNet architectures on classification accuracy. The results show that the selection of transformation methods and the sequence of concatenation do not affect the prediction outcome significantly. Surprisingly, the simple structure of ConvNet is sufficient enough for classification as it performed equally well with the complex structure of VGGNet. The results were also compared with other classification methods and found that the proposed framework outperformed other methods in terms of classification accuracy.

scholarly journals Method for Mapping Rice Fields in Complex Landscape Areas Based on Pre-Trained Convolutional Neural Network from HJ-1 A/B Data

2018 ◽  
Vol 7 (11) ◽  
pp. 418 ◽  
Author(s):  
Tian Jiang ◽  
Xiangnan Liu ◽  
Ling Wu
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Time Series ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Vegetation Index ◽  
Southern China ◽  
Series Data ◽  
Support Vector ◽  
Complex Landscape

Accurate and timely information about rice planting areas is essential for crop yield estimation, global climate change and agricultural resource management. In this study, we present a novel pixel-level classification approach that uses convolutional neural network (CNN) model to extract the features of enhanced vegetation index (EVI) time series curve for classification. The goal is to explore the practicability of deep learning techniques for rice recognition in complex landscape regions, where rice is easily confused with the surroundings, by using mid-resolution remote sensing images. A transfer learning strategy is utilized to fine tune a pre-trained CNN model and obtain the temporal features of the EVI curve. Support vector machine (SVM), a traditional machine learning approach, is also implemented in the experiment. Finally, we evaluate the accuracy of the two models. Results show that our model performs better than SVM, with the overall accuracies being 93.60% and 91.05%, respectively. Therefore, this technique is appropriate for estimating rice planting areas in southern China on the basis of a pre-trained CNN model by using time series data. And more opportunity and potential can be found for crop classification by remote sensing and deep learning technique in the future study.

Outlier Detection Using Convolutional Neural Network for Wireless Sensor Network

2021 ◽  
Vol 17 (2) ◽  
pp. 0-0
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Deep Learning ◽  
Wireless Sensor Network ◽  
Convolutional Neural Network ◽  
Sensor Network ◽  
Time Series Data ◽  
Wireless Sensor ◽  
Series Data ◽  
Detection Accuracy

Over the recent years, the term deep learning has been considered as one of the primary choice for handling huge amount of data. Having deeper hidden layers, it surpasses classical methods for detection of outlier in wireless sensor network. The Convolutional Neural Network (CNN) is a biologically inspired computational model which is one of the most popular deep learning approaches. It comprises neurons that self-optimize through learning. EEG generally known as Electroencephalography is a tool used for investigation of brain function and EEG signal gives time-series data as output. In this paper, we propose a state-of-the-art technique designed by processing the time-series data generated by the sensor nodes stored in a large dataset into discrete one-second frames and these frames are projected onto a 2D map images. A convolutional neural network (CNN) is then trained to classify these frames. The result improves detection accuracy and encouraging.

THE IMPROVED BPNN-NAR AND BPNN-NARMA MODELS ON MALAYSIAN AGGREGATE COST INDICES WITH OUTLYING DATA

2016 ◽  
Vol 78 (12-3) ◽  
Author(s):  
Saadi Ahmad Kamaruddin ◽  
Nor Azura Md Ghani ◽  
Norazan Mohamed Ramli
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Mean Squared Error ◽  
Ordinary Least Squares ◽  
Series Data ◽  
Backpropagation Neural Network ◽  
Data Set ◽  
Squared Error ◽  
The Impact ◽  
Nonlinear Autoregressive

Neurocomputing have been adapted in time series forecasting arena, but the presence of outliers that usually occur in data time series may be harmful to the data network training. This is because the ability to automatically find out any patterns without prior assumptions and loss of generality. In theory, the most common training algorithm for Backpropagation algorithms leans on reducing ordinary least squares estimator (OLS) or more specifically, the mean squared error (MSE). However, this algorithm is not fully robust when outliers exist in training data, and it will lead to false forecast future value. Therefore, in this paper, we present a new algorithm that manipulate algorithms firefly on least median squares estimator (FFA-LMedS) for  Backpropagation neural network nonlinear autoregressive (BPNN-NAR) and Backpropagation neural network nonlinear autoregressive moving (BPNN-NARMA) models to reduce the impact of outliers in time series data. The performances of the proposed enhanced models with comparison to the existing enhanced models using M-estimators, Iterative LMedS (ILMedS) and Particle Swarm Optimization on LMedS (PSO-LMedS) are done based on root mean squared error (RMSE) values which is the main highlight of this paper. In the meanwhile, the real-industrial monthly data of Malaysian Aggregate cost indices data set from January 1980 to December 2012 (base year 1980=100) with different degree of outliers problem is adapted in this research. At the end of this paper, it was found that the enhanced BPNN-NARMA models using M-estimators, ILMedS and FFA-LMedS performed very well with RMSE values almost zero errors. It is expected that the findings would assist the respected authorities involve in Malaysian construction projects to overcome cost overruns.

scholarly journals Soft Computation Vector Autoregressive Neural Network (VAR-NN) GUI-Based

2018 ◽  
Vol 73 ◽  
pp. 13008 ◽  
Author(s):  
Hasbi Yasin ◽  
Budi Warsito ◽  
Rukun Santoso ◽  
Suparti
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Autoregressive Model ◽  
Stock Price ◽  
Time Series Data ◽  
Multivariate Time Series ◽  
Series Data ◽  
Percentage Error ◽  
Vector Autoregressive ◽  
Price Data

Vector autoregressive model proposed for multivariate time series data. Neural Network, including Feed Forward Neural Network (FFNN), is the powerful tool for the nonlinear model. In autoregressive model, the input layer is the past values of the same series up to certain lag and the output layers is the current value. So, VAR-NN is proposed to predict the multivariate time series data using nonlinear approach. The optimal lag time in VAR are used as aid of selecting the input in VAR-NN. In this study we develop the soft computation tools of VAR-NN based on Graphical User Interface. In each number of neurons in hidden layer, the looping process is performed several times in order to get the best result. The best one is chosen by the least of Mean Absolute Percentage Error (MAPE) criteria. In this study, the model is applied in the two series of stock price data from Indonesia Stock Exchange. Evaluation of VAR-NN performance was based on train-validation and test-validation sample approach. Based on the empirical stock price data it can be concluded that VAR-NN yields perfect performance both in in-sample and in out-sample for non-linear function approximation. This is indicated by the MAPE value that is less than 1% .

scholarly journals Indoor 3D Localization Scheme Based on BLE Signal Fingerprinting and 1D Convolutional Neural Network

Electronics ◽  
2021 ◽  
Vol 10 (15) ◽  
pp. 1758
Author(s):  
Shangyi Yang ◽  
Chao Sun ◽  
Youngok Kim
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Convolutional Neural Network ◽  
Time Series Data ◽  
Indoor Navigation ◽  
Series Data ◽  
Positioning Accuracy ◽  
3D Localization ◽  
Localization Scheme ◽  
3D Positioning

Indoor localization schemes have significant potential for use in location-based services in areas such as smart factories, mixed reality, and indoor navigation. In particular, received signal strength (RSS)-based fingerprinting is used widely, given its simplicity and low hardware requirements. However, most studies tend to focus on estimating the 2D position of the target. Moreover, it is known that the fingerprinting scheme is computationally costly, and its positioning accuracy is readily affected by random fluctuations in the RSS values caused by fading and the multipath effect. We propose an indoor 3D localization scheme based on both fingerprinting and a 1D convolutional neural network (CNN). Instead of using the conventional fingerprint matching method, we transform the 3D positioning problem into a classification problem and use the 1D CNN model with the RSS time-series data from Bluetooth low-energy beacons for classification. By using the 1D CNN with the time-series data from multiple beacons, the inherent drawback of RSS-based fingerprinting, namely, its susceptibility to noise and randomness, is overcome, resulting in enhanced positioning accuracy. To evaluate the proposed scheme, we developed a 3D positioning system and performed comprehensive tests, whose results confirmed that the scheme significantly outperforms the conventional common spatial pattern classification algorithm.

scholarly journals XCM: An Explainable Convolutional Neural Network for Multivariate Time Series Classification

Mathematics ◽  
2021 ◽  
Vol 9 (23) ◽  
pp. 3137
Author(s):  
Kevin Fauvel ◽  
Tao Lin ◽  
Véronique Masson ◽  
Élisa Fromont ◽  
Alexandre Termier
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Input Data ◽  
State Of The Art ◽  
Multivariate Time Series ◽  
Learning Approach ◽  
Multiple Domains ◽  
Post Hoc

Multivariate Time Series (MTS) classification has gained importance over the past decade with the increase in the number of temporal datasets in multiple domains. The current state-of-the-art MTS classifier is a heavyweight deep learning approach, which outperforms the second-best MTS classifier only on large datasets. Moreover, this deep learning approach cannot provide faithful explanations as it relies on post hoc model-agnostic explainability methods, which could prevent its use in numerous applications. In this paper, we present XCM, an eXplainable Convolutional neural network for MTS classification. XCM is a new compact convolutional neural network which extracts information relative to the observed variables and time directly from the input data. Thus, XCM architecture enables a good generalization ability on both large and small datasets, while allowing the full exploitation of a faithful post hoc model-specific explainability method (Gradient-weighted Class Activation Mapping) by precisely identifying the observed variables and timestamps of the input data that are important for predictions. We first show that XCM outperforms the state-of-the-art MTS classifiers on both the large and small public UEA datasets. Then, we illustrate how XCM reconciles performance and explainability on a synthetic dataset and show that XCM enables a more precise identification of the regions of the input data that are important for predictions compared to the current deep learning MTS classifier also providing faithful explainability. Finally, we present how XCM can outperform the current most accurate state-of-the-art algorithm on a real-world application while enhancing explainability by providing faithful and more informative explanations.

scholarly journals Low-dimensional Convolutional Neural Network for Solar Flares GOES Time-series Classification

2022 ◽  
Vol 258 (1) ◽  
pp. 12
Author(s):  
Vlad Landa ◽  
Yuval Reuveni
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Solar Flare ◽  
Convolutional Neural Network ◽  
Solar Flares ◽  
Time Series Data ◽  
Series Data ◽  
Time Series Classification ◽  
X Ray ◽  
Low Dimensional

Abstract Space weather phenomena such as solar flares have a massive destructive power when they reach a certain magnitude. Here, we explore the deep-learning approach in order to build a solar flare-forecasting model, while examining its limitations and feature-extraction ability based on the available Geostationary Operational Environmental Satellite (GOES) X-ray time-series data. We present a multilayer 1D convolutional neural network to forecast the solar flare event probability occurrence of M- and X-class flares at 1, 3, 6, 12, 24, 48, 72, and 96 hr time frames. The forecasting models were trained and evaluated in two different scenarios: (1) random selection and (2) chronological selection, which were compared afterward in terms of common score metrics. Additionally, we also compared our results to state-of-the-art flare-forecasting models. The results indicates that (1) when X-ray time-series data are used alone, the suggested model achieves higher score results for X-class flares and similar scores for M-class as in previous studies. (2) The two different scenarios obtain opposite results for the X- and M-class flares. (3) The suggested model combined with solely X-ray time-series fails to distinguish between M- and X-class magnitude solar flare events. Furthermore, based on the suggested method, the achieved scores, obtained solely from X-ray time-series measurements, indicate that substantial information regarding the solar activity and physical processes are encapsulated in the data, and augmenting additional data sets, both spatial and temporal, may lead to better predictions, while gaining a comprehensive physical interpretation regarding solar activity. All source codes are available at https://github.com/vladlanda.

MULTIVARIATE TIME SERIES MODELING IN A CONNECTIONIST APPROACH

2000 ◽  
Vol 11 (01) ◽  
pp. 159-173
Author(s):  
D. R. KULKARNI ◽  
J. C. PARIKH
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Time Series Data ◽  
Multivariate Time Series ◽  
Series Data ◽  
Time Series Modeling ◽  
Multivariate Models ◽  
Short Term ◽  
Several Variables ◽  
Connectionist Approach

Multivariate models in the framework of artificial neural network have been constructed for systems where time series data of several variables is known. The models have been tested using computer generated data for the Lorenz and Henon systems. They are found to be robust and give accurate short term predictions. Analysis of the models is able to throw some light on theoretical questions related to multivariate "embedding" and removal of redundancy in the embedding.

Sign in / Sign up

Export Citation Format

Share Document