scholarly journals A Data-Driven Long Time-Series Electrical Line Trip Fault Prediction Method Using an Improved Stacked-Informer Network

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4466
Author(s):  
Li Guo ◽  
Runze Li ◽  
Bin Jiang
Keyword(s):  
Time Series ◽  
Prediction Accuracy ◽  
Time Series Data ◽  
Short Term Memory ◽  
Fault Prediction ◽  
Data Driven ◽  
Series Data ◽  
Sequence Prediction ◽  
Long Time Series ◽  
Long Time

The monitoring of electrical equipment and power grid systems is very essential and important for power transmission and distribution. It has great significances for predicting faults based on monitoring a long sequence in advance, so as to ensure the safe operation of the power system. Many studies such as recurrent neural network (RNN) and long short-term memory (LSTM) network have shown an outstanding ability in increasing the prediction accuracy. However, there still exist some limitations preventing those methods from predicting long time-series sequences in real-world applications. To address these issues, a data-driven method using an improved stacked-Informer network is proposed, and it is used for electrical line trip faults sequence prediction in this paper. This method constructs a stacked-Informer network to extract underlying features of long sequence time-series data well, and combines the gradient centralized (GC) technology with the optimizer to replace the previously used Adam optimizer in the original Informer network. It has a superior generalization ability and faster training efficiency. Data sequences used for the experimental validation are collected from the wind and solar hybrid substation located in Zhangjiakou city, China. The experimental results and concrete analysis prove that the presented method can improve fault sequence prediction accuracy and achieve fast training in real scenarios.

scholarly journals TIME SERIES LAND COVER CLASSIFICATION BASED ON SEMI-SUPERVISED CONVOLUTIONAL LONG SHORT-TERM MEMORY NEURAL NETWORKS

2020 ◽  
Vol XLIII-B2-2020 ◽  
pp. 1521-1528
Author(s):  
S. Jing ◽  
T. Chao
Keyword(s):  
Time Series ◽  
Classification Accuracy ◽  
Time Series Data ◽  
Short Term Memory ◽  
Series Data ◽  
Short Term ◽  
Long Time Series ◽  
Temporal Features ◽  
Long Time ◽  
Long Short Term Memory

Abstract. Time series imagery containing high-dimensional temporal features are conducive to improving classification accuracy. With the plenty accumulation of historical images, the inclusion of time series data becomes available to utilize, but it is difficult to avoid missing values caused by cloud cover. Meanwhile, seeking a large amount of training labels for long time series also makes data collection troublesome. In this study, we proposed a semi-supervised convolutional long short-term memory neural network (Semi-LSTM) in long time series which achieves an accurate and automated land cover classification with a small proportion of labels. Three main contributions of this work are summarized as follows: i) the proposed method achieve an excellent classification via a small group of labels in long time series data, and reducing dependence of training labels; ii) it is a robust algorithm in accuracy for the influence of noise, and reduces the requirements of sequential data for cloudless and lossless images; and iii) it makes full advantage of spectral-spatial-temporal features, especially expanding time context information to enhance classification accuracy. Finally, the proposed network is validated on time series imagery from Landsat 8. All quantitative analyses and evaluation indicators of the experimental results demonstrate competitive performance in the suggested modes.

scholarly journals STL-ATTLSTM: Vegetable Price Forecasting Using STL and Attention Mechanism-Based LSTM

Agriculture ◽  
2020 ◽  
Vol 10 (12) ◽  
pp. 612
Author(s):  
Helin Yin ◽  
Dong Jin ◽  
Yeong Hyeon Gu ◽  
Chang Jin Park ◽  
Sang Keun Han ◽  
...  
Keyword(s):  
Time Series ◽  
Prediction Accuracy ◽  
Crop Production ◽  
Time Series Data ◽  
Short Term Memory ◽  
Attention Mechanism ◽  
Series Data ◽  
Percentage Error ◽  
Hot Pepper ◽  
Types Of Information

It is difficult to forecast vegetable prices because they are affected by numerous factors, such as weather and crop production, and the time-series data have strong non-linear and non-stationary characteristics. To address these issues, we propose the STL-ATTLSTM (STL-Attention-based LSTM) model, which integrates the seasonal trend decomposition using the Loess (STL) preprocessing method and attention mechanism based on long short-term memory (LSTM). The proposed STL-ATTLSTM forecasts monthly vegetable prices using various types of information, such as vegetable prices, weather information of the main production areas, and market trading volumes. The STL method decomposes time-series vegetable price data into trend, seasonality, and remainder components. It uses the remainder component by removing the trend and seasonality components. In the model training process, attention weights are assigned to all input variables; thus, the model’s prediction performance is improved by focusing on the variables that affect the prediction results. The proposed STL-ATTLSTM was applied to five crops, namely cabbage, radish, onion, hot pepper, and garlic, and its performance was compared to three benchmark models (i.e., LSTM, attention LSTM, and STL-LSTM). The performance results show that the LSTM model combined with the STL method (STL-LSTM) achieved a 12% higher prediction accuracy than the attention LSTM model that did not use the STL method and solved the prediction lag arising from high seasonality. The attention LSTM model improved the prediction accuracy by approximately 4% to 5% compared to the LSTM model. The STL-ATTLSTM model achieved the best performance, with an average root mean square error (RMSE) of 380, and an average mean absolute percentage error (MAPE) of 7%.

Condition Monitoring of Equipment in Oil Wells using Deep Learning

2020 ◽  
Vol 12 (01) ◽  
pp. 2050001
Author(s):  
Yadigar N. Imamverdiyev ◽  
Fargana J. Abdullayeva
Keyword(s):  
Time Series ◽  
Deep Learning ◽  
Time Series Data ◽  
Short Term Memory ◽  
Single Layer ◽  
Oil Wells ◽  
Fault Prediction ◽  
Series Data ◽  
Oil Well ◽  
Data Set

In this paper, a fault prediction method for oil well equipment based on the analysis of time series data obtained from multiple sensors is proposed. The proposed method is based on deep learning (DL). For this purpose, comparative analysis of single-layer long short-term memory (LSTM) with the convolutional neural network (CNN) and stacked LSTM methods is provided. To demonstrate the efficacy of the proposed method, some experiments are conducted on the real data set obtained from eight sensors installed in oil wells. In this paper, compared to the single-layer LSTM model, the CNN and stacked LSTM predicted the faulty time series with a minimal loss.

scholarly journals A Fault Prediction and Cause Identification Approach in Complex Industrial Processes Based on Deep Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Yao Li
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Production Line ◽  
Prediction Accuracy ◽  
Time Series Data ◽  
Short Term Memory ◽  
Fault Prediction ◽  
Industrial Processes ◽  
Series Data ◽  
Process Data

Faults occurring in the production line can cause many losses. Predicting the fault events before they occur or identifying the causes can effectively reduce such losses. A modern production line can provide enough data to solve the problem. However, in the face of complex industrial processes, this problem will become very difficult depending on traditional methods. In this paper, we propose a new approach based on a deep learning (DL) algorithm to solve the problem. First, we regard these process data as a spatial sequence according to the production process, which is different from traditional time series data. Second, we improve the long short-term memory (LSTM) neural network in an encoder-decoder model to adapt to the branch structure, corresponding to the spatial sequence. Meanwhile, an attention mechanism (AM) algorithm is used in fault detection and cause identification. Third, instead of traditional biclassification, the output is defined as a sequence of fault types. The approach proposed in this article has two advantages. On the one hand, treating data as a spatial sequence rather than a time sequence can overcome multidimensional problems and improve prediction accuracy. On the other hand, in the trained neural network, the weight vectors generated by the AM algorithm can represent the correlation between faults and the input data. This correlation can help engineers identify the cause of faults. The proposed approach is compared with some well-developed fault diagnosing methods in the Tennessee Eastman process. Experimental results show that the approach has higher prediction accuracy, and the weight vector can accurately label the factors that cause faults.

scholarly journals Observing the Ocean

Eos ◽  
2017 ◽  
Vol 98 ◽  
Author(s):  
Toste Tanhua
Keyword(s):  
Time Series ◽  
Time Series Data ◽  
Series Data ◽  
Data Set ◽  
Long Time Series ◽  
Long Time

How measurements from a glider deployed off the coast of Peru are contributing to a much-needed long time-series data set.

scholarly journals Multivariate Temporal Convolutional Network: A Deep Neural Networks Approach for Multivariate Time Series Forecasting

Electronics ◽  
2019 ◽  
Vol 8 (8) ◽  
pp. 876 ◽  
Author(s):  
Renzhuo Wan ◽  
Shuping Mei ◽  
Jun Wang ◽  
Min Liu ◽  
Fan Yang
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Prediction Accuracy ◽  
Time Series Data ◽  
Short Term Memory ◽  
Time Series Prediction ◽  
Multivariate Time Series ◽  
Series Data ◽  
Asymmetric Structure ◽  
Convolutional Network

Multivariable time series prediction has been widely studied in power energy, aerology, meteorology, finance, transportation, etc. Traditional modeling methods have complex patterns and are inefficient to capture long-term multivariate dependencies of data for desired forecasting accuracy. To address such concerns, various deep learning models based on Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN) methods are proposed. To improve the prediction accuracy and minimize the multivariate time series data dependence for aperiodic data, in this article, Beijing PM2.5 and ISO-NE Dataset are analyzed by a novel Multivariate Temporal Convolution Network (M-TCN) model. In this model, multi-variable time series prediction is constructed as a sequence-to-sequence scenario for non-periodic datasets. The multichannel residual blocks in parallel with asymmetric structure based on deep convolution neural network is proposed. The results are compared with rich competitive algorithms of long short term memory (LSTM), convolutional LSTM (ConvLSTM), Temporal Convolution Network (TCN) and Multivariate Attention LSTM-FCN (MALSTM-FCN), which indicate significant improvement of prediction accuracy, robust and generalization of our model.

scholarly journals Highlights of Discoveries for δ Scuti Variable Stars From the Kepler Era

2021 ◽  
Vol 8 ◽  
Author(s):  
Joyce Ann Guzik
Keyword(s):  
Time Series ◽  
High Precision ◽  
Time Series Data ◽  
Variable Stars ◽  
Series Data ◽  
The Sun ◽  
Interior Structure ◽  
Hydrogen Burning ◽  
Long Time Series ◽  
Long Time

The NASA Kepler and follow-on K2 mission (2009–2018) left a legacy of data and discoveries, finding thousands of exoplanets, and also obtaining high-precision long time-series data for hundreds of thousands of stars, including many types of pulsating variables. Here we highlight a few of the ongoing discoveries from Kepler data on δ Scuti pulsating variables, which are core hydrogen-burning stars of about twice the mass of the Sun. We discuss many unsolved problems surrounding the properties of the variability in these stars, and the progress enabled by Kepler data in using pulsations to infer their interior structure, a field of research known as asteroseismology.

scholarly journals Uncertainty-Aware Multiple Instance Learning from Large-Scale Long Time Series Data

2021 ◽  
Author(s):  
Yuansheng Zhu ◽  
Weishi Shi ◽  
Deep Shankar Pandey ◽  
Yang Liu ◽  
Xiaofan Que ◽  
...  
Keyword(s):  
Time Series ◽  
Large Scale ◽  
Time Series Data ◽  
Multiple Instance Learning ◽  
Series Data ◽  
Long Time Series ◽  
Long Time

scholarly journals HURST COEFFICIENT IN LONG TIME SERIES OF POPULATION SIZE: MODEL FOR TWO PLANT POPULATIONS WITH DIFFERENT REPRODUCTIVE STRATEGIES

Fractals ◽  
2010 ◽  
Vol 18 (03) ◽  
pp. 301-307 ◽  
Author(s):  
ALFONSO GARMENDIA ◽  
LUIS GARMENDIA ◽  
ADELA SALVADOR
Keyword(s):  
Time Series ◽  
Fractal Dimension ◽  
Population Size ◽  
Time Series Data ◽  
Extinction Risk ◽  
Series Data ◽  
Plant Populations ◽  
Long Time Series ◽  
Hurst Coefficient ◽  
Long Time

Can the fractal dimension of fluctuations in population size be used to estimate extinction risk? The problem with estimating this fractal dimension is that the lengths of the time series are usually too short for conclusive results. This study answered this question with long time series data obtained from an iterative competition model. This model produces competitive extinction at different perturbation intensities for two different germination strategies: germination of all seeds vs. dormancy in half the seeds. This provided long time series of 900 years and different extinction risks. The results support the hypothesis for the effectiveness of the Hurst coefficient for estimating extinction risk.

Sign in / Sign up

Export Citation Format

Share Document