scholarly journals SL-BiLSTM: A Signal-Based Bidirectional LSTM Network for Over-the-Horizon Target Localization

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Wanting Yu ◽  
Hongyi Yu ◽  
Ding Wang ◽  
Jianping Du ◽  
Mengli Zhang
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Learning Technology ◽  
Long Distance ◽  
Position Information ◽  
Performance Loss ◽  
Low Snr ◽  
Regularization Techniques ◽  
Positioning Method ◽  
Lstm Network

Deep learning technology provides novel solutions for localization in complex scenarios. Conventional methods generally suffer from performance loss in the long-distance over-the-horizon (OTH) scenario due to uncertain ionospheric conditions. To overcome the adverse effects of the unknown and complex ionosphere on positioning, we propose a deep learning positioning method based on multistation received signals and bidirectional long short-term memory (BiLSTM) network framework (SL-BiLSTM), which refines position information from signal data. Specifically, we first obtain the form of the network input by constructing the received signal model. Second, the proposed method is developed to predict target positions using an SL-BiLSTM network, consisting of three BiLSTM layers, a maxout layer, a fully connected layer, and a regression layer. Then, we discuss two regularization techniques of dropout and randomization which are mainly adopted to prevent network overfitting. Simulations of OTH localization are conducted to examine the performance. The parameters of the network have been trained properly according to the scenario. Finally, the experimental results show that the proposed method can significantly improve the accuracy of OTH positioning at low SNR. When the number of training locations increases to 200, the positioning result of SL-BiLSTM is closest to CRLB at high SNR.

scholarly journals A Single-Terminal Fault Location Method for HVDC Transmission Lines Based on a Hybrid Deep Network

Electronics ◽  
2021 ◽  
Vol 10 (3) ◽  
pp. 255
Author(s):  
Lei Wang ◽  
Yigang He ◽  
Lie Li
Keyword(s):  
Deep Learning ◽  
Transmission Lines ◽  
Fault Location ◽  
Short Term Memory ◽  
Engineering Application ◽  
Energy Operator ◽  
Sampling Frequency ◽  
Learning Technology ◽  
Long Distance ◽  
Hvdc Transmission

High voltage direct current (HVDC) transmission systems play an increasingly important role in long-distance power transmission. Realizing accurate and timely fault location of transmission lines is extremely important for the safe operation of power systems. With the development of modern data acquisition and deep learning technology, deep learning methods have the feasibility of engineering application in fault location. The traditional single-terminal traveling wave method is used for fault location in HVDC systems. However, many challenges exist when a high impedance fault occurs including high sampling frequency dependence and difficulty to determine wave velocity and identify wave heads. In order to resolve these problems, this work proposed a deep hybrid convolutional neural network (CNN) and long short-term memory (LSTM) network model for single-terminal fault location of an HVDC system containing mixed cables and overhead line segments. Simultaneously, a variational mode decomposition–Teager energy operator is used in feature engineering to improve the effect of model training. 2D-CNN was employed as a classifier to identify fault segments, and LSTM as a regressor integrated the fault segment information of the classifier to achieve precise fault location. The experimental results demonstrate that the proposed method has high accuracy of fault location, with the effects of fault types, noise, sampling frequency, and different HVDC topologies in consideration.

scholarly journals Real-Time Detection of Dictionary DGA Network Traffic Using Deep Learning

2021 ◽  
Vol 2 (2) ◽  
Author(s):  
Kate Highnam ◽  
Domenic Puzio ◽  
Song Luo ◽  
Nicholas R. Jennings
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real Time ◽  
Network Traffic ◽  
Short Term Memory ◽  
Domain Names ◽  
Control Networks ◽  
Detection Techniques ◽  
Lstm Network ◽  
And Control

AbstractBotnets and malware continue to avoid detection by static rule engines when using domain generation algorithms (DGAs) for callouts to unique, dynamically generated web addresses. Common DGA detection techniques fail to reliably detect DGA variants that combine random dictionary words to create domain names that closely mirror legitimate domains. To combat this, we created a novel hybrid neural network, Bilbo the “bagging” model, that analyses domains and scores the likelihood they are generated by such algorithms and therefore are potentially malicious. Bilbo is the first parallel usage of a convolutional neural network (CNN) and a long short-term memory (LSTM) network for DGA detection. Our unique architecture is found to be the most consistent in performance in terms of AUC, $$F_1$$ F 1 score, and accuracy when generalising across different dictionary DGA classification tasks compared to current state-of-the-art deep learning architectures. We validate using reverse-engineered dictionary DGA domains and detail our real-time implementation strategy for scoring real-world network logs within a large enterprise. In 4 h of actual network traffic, the model discovered at least five potential command-and-control networks that commercial vendor tools did not flag.

scholarly journals Indicator Selection for Topic Popularity Definition Based on AHP and Deep Learning Models

2020 ◽  
Vol 2020 ◽  
pp. 1-11 ◽  
Author(s):  
Yuling Hong ◽  
Qishan Zhang
Keyword(s):  
Deep Learning ◽  
Social Network ◽  
Evaluation Method ◽  
Short Term Memory ◽  
Selection Model ◽  
Learning Technology ◽  
Prevention Measures ◽  
Learning Methods ◽  
Indicator Selection ◽  
The Social

Purpose. The purpose of this article is to predict the topic popularity on the social network accurately. Indicator selection model for a new definition of topic popularity with degree of grey incidence (DGI) is undertook based on an improved analytic hierarchy process (AHP). Design/Methodology/Approach. Through screening the importance of indicators by the deep learning methods such as recurrent neural networks (RNNs), long short-term memory (LSTM), and gated recurrent unit (GRU), a selection model of topic popularity indicators based on AHP is set up. Findings. The results show that when topic popularity is being built quantitatively based on the DGI method and different weights of topic indicators are obtained from the help of AHP, the average accuracy of topic popularity prediction can reach 97.66%. The training speed is higher and the prediction precision is higher. Practical Implications. The method proposed in the paper can be used to calculate the popularity of each hot topic and generate the ranking list of topics’ popularities. Moreover, its future popularity can be predicted by deep learning methods. At the same time, a new application field of deep learning technology has been further discovered and verified. Originality/Value. This can lay a theoretical foundation for the formulation of topic popularity tendency prevention measures on the social network and provide an evaluation method which is consistent with the actual situation.

scholarly journals Detection of dementia on raw voice recordings using deep learning: A Framingham Heart Study

2021 ◽  
Author(s):  
Chonghua Xue ◽  
Cody Karjadi ◽  
Ioannis Ch. Paschalidis ◽  
Rhoda Au ◽  
Vijaya B. Kolachalama
Keyword(s):  
Deep Learning ◽  
Framingham Heart Study ◽  
Short Term Memory ◽  
Neuropsychological Testing ◽  
Heart Study ◽  
Audio Recordings ◽  
Lstm Network ◽  
Sensitivity Specificity ◽  
Normal Cognition ◽  
Mean Sensitivity

AbstractBackgroundIdentification of reliable, affordable and easy-to-use strategies for detection of dementia are sorely needed. Digital technologies, such as individual voice recordings, offer an attractive modality to assess cognition but methods that could automatically analyze such data without any pre-processing are not readily available.MethodsWe used a subset of 1264 digital voice recordings of neuropsychological examinations administered to participants from the Framingham Heart Study (FHS), a community-based longitudinal observational study. The recordings were 73 minutes in duration, on average, and contained at least two speakers (participant and clinician). Of the total voice recordings, 483 were of participants with normal cognition (NC), 451 recordings were of participants with mild cognitive impairment (MCI), and 330 were of participants with dementia. We developed two deep learning models (a two-level long short-term memory (LSTM) network and a convolutional neural network (CNN)), which used the raw audio recordings to classify if the recording included a participant with only NC or only dementia, and also to differentiate between recordings corresponding to non-demented (NC+MCI) and demented participants.FindingsBased on 5-fold cross-validation, the LSTM model achieved a mean (±std) area under the sensitivity-specificity curve (AUC) of 0.744±0.038, mean accuracy of 0.680±0.032, mean sensitivity of 0.719±0.112, and mean specificity of 0.652±0.089 in predicting cases with dementia from those with normal cognition. The CNN model achieved a mean AUC of 0.805±0.027, mean accuracy of 0.740±0.033, mean sensitivity of 0.735±0.094, and mean specificity of 0.750±0.083 in predicting cases with only dementia from those with only NC. For the task related to classification of demented participants from non-demented ones, the LSTM model achieved a mean AUC of 0.659±0.043, mean accuracy of 0.701±0.057, mean sensitivity of 0.245±0.161 and mean specificity of 0.856±0.105. The CNN model achieved a mean AUC of 0.730±0.039, mean accuracy of 0.735±0.046, mean sensitivity of 0.443±0.113, and mean specificity of 0.840±0.076 in predicting cases with dementia from those who were not demented.InterpretationThis proof-of-concept study demonstrates the potential that raw audio recordings of neuropsychological testing performed on individuals recruited within a community cohort setting can provide a level of screening for dementia.

scholarly journals Flutter speed prediction by using deep learning

2021 ◽  
Vol 13 (11) ◽  
pp. 168781402110622
Author(s):  
Yi-Ren Wang ◽  
Yi-Jyun Wang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Short Term Memory ◽  
Learning Technology ◽  
Memory Space ◽  
Flutter Speed ◽  
Aeroelastic Flutter ◽  
Speed Prediction ◽  
Computational Fluid Dynamics Cfd ◽  
Cfd Method

Deep learning technology has been widely used in various field in recent years. This study intends to use deep learning algorithms to analyze the aeroelastic phenomenon and compare the differences between Deep Neural Network (DNN) and Long Short-term Memory (LSTM) applied on the flutter speed prediction. In this present work, DNN and LSTM are used to address complex aeroelastic systems by superimposing multi-layer Artificial Neural Network. Under such an architecture, the neurons in neural network can extract features from various flight data. Instead of time-consuming high-fidelity computational fluid dynamics (CFD) method, this study uses the K method to build the aeroelastic flutter speed big data for different flight conditions. The flutter speeds for various flight conditions are predicted by the deep learning methods and verified by the K method. The detailed physical meaning of aerodynamics and aeroelasticity of the prediction results are studied. The LSTM model has a cyclic architecture, which enables it to store information and update it with the latest information at the same time. Although the training of the model is more time-consuming than DNN, this method can increase the memory space. The results of this work show that the LSTM model established in this study can provide more accurate flutter speed prediction than the DNN algorithm.

scholarly journals Automatic Detection of Microsleep Episodes With Deep Learning

2021 ◽  
Vol 15 ◽  
Author(s):  
Alexander Malafeev ◽  
Anneke Hertig-Godeschalk ◽  
David R. Schreier ◽  
Jelena Skorucak ◽  
Johannes Mathis ◽  
...  
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Internal Representation ◽  
Automatic Detection ◽  
Maintenance Of Wakefulness Test ◽  
Lstm Network ◽  
Definition Of ◽  
Artificial Neuronal Network ◽  
Electroencephalogram Eeg ◽  
Laborious Work

Brief fragments of sleep shorter than 15 s are defined as microsleep episodes (MSEs), often subjectively perceived as sleepiness. Their main characteristic is a slowing in frequency in the electroencephalogram (EEG), similar to stage N1 sleep according to standard criteria. The maintenance of wakefulness test (MWT) is often used in a clinical setting to assess vigilance. Scoring of the MWT in most sleep-wake centers is limited to classical definition of sleep (30 s epochs), and MSEs are mostly not considered in the absence of established scoring criteria defining MSEs but also because of the laborious work. We aimed for automatic detection of MSEs with machine learning, i.e., with deep learning based on raw EEG and EOG data as input. We analyzed MWT data of 76 patients. Experts visually scored wakefulness, and according to recently developed scoring criteria MSEs, microsleep episode candidates (MSEc), and episodes of drowsiness (ED). We implemented segmentation algorithms based on convolutional neural networks (CNNs) and a combination of a CNN with a long-short term memory (LSTM) network. A LSTM network is a type of a recurrent neural network which has a memory for past events and takes them into account. Data of 53 patients were used for training of the classifiers, 12 for validation and 11 for testing. Our algorithms showed a good performance close to human experts. The detection was very good for wakefulness and MSEs and poor for MSEc and ED, similar to the low inter-expert reliability for these borderline segments. We performed a visualization of the internal representation of the data by the artificial neuronal network performing best using t-distributed stochastic neighbor embedding (t-SNE). Visualization revealed that MSEs and wakefulness were mostly separable, though not entirely, and MSEc and ED largely intersected with the two main classes. We provide a proof of principle that it is feasible to reliably detect MSEs with deep neuronal networks based on raw EEG and EOG data with a performance close to that of human experts. The code of the algorithms (https://github.com/alexander-malafeev/microsleep-detection) and data (https://zenodo.org/record/3251716) are available.

scholarly journals Classification of Covid-19 Coronavirus, Pneumonia and Healthy Lungs in CT Scans Using Q-Deformed Entropy and Deep Learning Features

Entropy ◽  
2020 ◽  
Vol 22 (5) ◽  
pp. 517 ◽  
Author(s):  
Ali M. Hasan ◽  
Mohammed M. AL-Jawad ◽  
Hamid A. Jalab ◽  
Hadil Shaiba ◽  
Rabha W. Ibrahim ◽  
...  
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Accurate Method ◽  
Short Term ◽  
Lung Scan ◽  
Deep Learning Features ◽  
Long Short Term Memory ◽  
Lstm Network ◽  
Ct Slices

Many health systems over the world have collapsed due to limited capacity and a dramatic increase of suspected COVID-19 cases. What has emerged is the need for finding an efficient, quick and accurate method to mitigate the overloading of radiologists’ efforts to diagnose the suspected cases. This study presents the combination of deep learning of extracted features with the Q-deformed entropy handcrafted features for discriminating between COVID-19 coronavirus, pneumonia and healthy computed tomography (CT) lung scans. In this study, pre-processing is used to reduce the effect of intensity variations between CT slices. Then histogram thresholding is used to isolate the background of the CT lung scan. Each CT lung scan undergoes a feature extraction which involves deep learning and a Q-deformed entropy algorithm. The obtained features are classified using a long short-term memory (LSTM) neural network classifier. Subsequently, combining all extracted features significantly improves the performance of the LSTM network to precisely discriminate between COVID-19, pneumonia and healthy cases. The maximum achieved accuracy for classifying the collected dataset comprising 321 patients is 99.68%.

scholarly journals Application of LSTM Network to Improve Indoor Positioning Accuracy

Sensors ◽  
2020 ◽  
Vol 20 (20) ◽  
pp. 5824
Author(s):  
Dongqi Gao ◽  
Xiangye Zeng ◽  
Jingyi Wang ◽  
Yanmang Su
Keyword(s):  
Short Term Memory ◽  
Indoor Positioning ◽  
Base Stations ◽  
Ultra Wideband ◽  
Positioning Accuracy ◽  
Last Mile ◽  
Ranging Error ◽  
Positioning Method ◽  
Lstm Network ◽  
Positioning Algorithm

Various indoor positioning methods have been developed to solve the “last mile on Earth”. Ultra-wideband positioning technology stands out among all indoor positioning methods due to its unique communication mechanism and has a broad application prospect. Under non-line-of-sight (NLOS) conditions, the accuracy of this positioning method is greatly affected. Unlike traditional inspection and rejection of NLOS signals, all base stations are involved in positioning to improve positioning accuracy. In this paper, a Long Short-Term Memory (LSTM) network is used while maximizing the use of positioning equipment. The LSTM network is applied to process the raw Channel Impulse Response (CIR) to calculate the ranging error, and combined with the improved positioning algorithm to improve the positioning accuracy. It has been verified that the accuracy of the predicted ranging error is up to centimeter level. Using this prediction for the positioning algorithm, the average positioning accuracy improved by about 62%.

scholarly journals Combining Post Sentiments and User Participation for Extracting Public Stances from Twitter

2020 ◽  
Vol 10 (22) ◽  
pp. 8035
Author(s):  
Jenq-Haur Wang ◽  
Ting-Wei Liu ◽  
Xiong Luo
Keyword(s):  
Social Media ◽  
Deep Learning ◽  
Short Term Memory ◽  
Absolute Error ◽  
User Participation ◽  
Sentiment Classification ◽  
Context Dependency ◽  
Long Distance ◽  
Learning Methods ◽  
The Public

With the wide popularity of social media, it’s becoming more convenient for people to express their opinions online. To better understand what the public think about a topic, sentiment classification techniques have been widely used to estimate the overall orientation of opinions in post contents. However, users might have various degrees of influence depending on their participation in discussions on different topics. In this paper, we address the issues of combining sentiment classification and link analysis techniques for extracting stances of the public from social media. Since social media posts are usually very short, word embedding models are first used to learn different word usages in various contexts. Then, deep learning methods such as Long Short-Term Memory (LSTM) are used to learn the long-distance context dependency among words for better estimation of sentiments. Third, we consider the major user participation in popular social media by adjusting the users weights to reflect their relative influence in user-post interaction graphs. Finally, we combine post sentiments and user influences into a total opinion score for extracting public stances. In the experiments, we evaluated the performance of our proposed approach for tweets about the 2016 U.S. Presidential Election. The best performance of sentiment classification can be observed with an F-measure of 72.97% for LSTM classifiers. This shows the effectiveness of deep learning methods in learning word usage in social media contexts. The experimental results on stance extraction showed the best performance of 0.68% Mean Absolute Error (MAE) in aggregating public stances on election candidates. This shows the potential of combining tweet sentiments and user participation structures for extracting the aggregate stances of the public on popular topics. Further investigation is needed to verify the performance in different social media sources.

scholarly journals Research on the Estimate of Gas Hydrate Saturation Based on LSTM Recurrent Neural Network

Energies ◽  
2020 ◽  
Vol 13 (24) ◽  
pp. 6536
Author(s):  
Chuanhui Li ◽  
Xuewei Liu
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Recurrent Neural Network ◽  
Gas Hydrate ◽  
Short Term Memory ◽  
Chloride Concentration ◽  
Well Logs ◽  
Good Prediction ◽  
Learning Technology ◽  
Hydrate Saturation

Gas hydrate saturation is an important index for evaluating gas hydrate reservoirs, and well logs are an effective method for estimating gas hydrate saturation. To use well logs better to estimate gas hydrate saturation, and to establish the deep internal connections and laws of the data, we propose a method of using deep learning technology to estimate gas hydrate saturation from well logs. Considering that well logs have sequential characteristics, we used the long short-term memory (LSTM) recurrent neural network to predict the gas hydrate saturation from the well logs of two sites in the Shenhu area, South China Sea. By constructing an LSTM recurrent layer and two fully connected layers at one site, we used resistivity and acoustic velocity logs that were sensitive to gas hydrate as input. We used the gas hydrate saturation calculated by the chloride concentration of the pore water as output to train the LSTM network. We achieved a good training result. Applying the trained LSTM recurrent neural network to another site in the same area achieved good prediction of gas hydrate saturation, showing the unique advantages of deep learning technology in gas hydrate saturation estimation.

Sign in / Sign up

Export Citation Format

Share Document