scholarly journals Comparing Performances of Five Distinct Automatic Classifiers for Fin Whale Vocalizations in Beamformed Spectrograms of Coherent Hydrophone Array

2020 ◽  
Vol 12 (2) ◽  
pp. 326 ◽  
Author(s):  
Heriberto A. Garcia ◽  
Trenton Couture ◽  
Amit Galor ◽  
Jessica M. Topple ◽  
Wei Huang ◽  
...  
Keyword(s):  
Real Time ◽  
Short Term Memory ◽  
Support Vector ◽  
Automated Classification ◽  
Sound Sources ◽  
Data Set ◽  
Fin Whale ◽  
Lstm Network ◽  
Hydrophone Array ◽  
Detection And Recognition

A large variety of sound sources in the ocean, including biological, geophysical, and man-made, can be simultaneously monitored over instantaneous continental-shelf scale regions via the passive ocean acoustic waveguide remote sensing (POAWRS) technique by employing a large-aperture densely-populated coherent hydrophone array system. Millions of acoustic signals received on the POAWRS system per day can make it challenging to identify individual sound sources. An automated classification system is necessary to enable sound sources to be recognized. Here, the objectives are to (i) gather a large training and test data set of fin whale vocalization and other acoustic signal detections; (ii) build multiple fin whale vocalization classifiers, including a logistic regression, support vector machine (SVM), decision tree, convolutional neural network (CNN), and long short-term memory (LSTM) network; (iii) evaluate and compare performance of these classifiers using multiple metrics including accuracy, precision, recall and F1-score; and (iv) integrate one of the classifiers into the existing POAWRS array and signal processing software. The findings presented here will (1) provide an automatic classifier for near real-time fin whale vocalization detection and recognition, useful in marine mammal monitoring applications; and (2) lay the foundation for building an automatic classifier applied for near real-time detection and recognition of a wide variety of biological, geophysical, and man-made sound sources typically detected by the POAWRS system in the ocean.

scholarly journals Ensemble Malware Classification System Using Deep Neural Networks

Electronics ◽  
2020 ◽  
Vol 9 (5) ◽  
pp. 721 ◽  
Author(s):  
Barath Narayanan Narayanan ◽  
Venkata Salini Priyamvada Davuluru
Keyword(s):  
Neural Networks ◽  
Classification System ◽  
Short Term Memory ◽  
Ensemble Classification ◽  
Machine Language ◽  
Support Vector ◽  
Automated Classification ◽  
Malware Classification ◽  
Lstm Network ◽  
Computational Resources

With the advancement of technology, there is a growing need of classifying malware programs that could potentially harm any computer system and/or smaller devices. In this research, an ensemble classification system comprising convolutional and recurrent neural networks is proposed to distinguish malware programs. Microsoft’s Malware Classification Challenge (BIG 2015) dataset with nine distinct classes is utilized for this study. This dataset contains an assembly file and a compiled file for each malware program. Compiled files are visualized as images and are classified using Convolutional Neural Networks (CNNs). Assembly files consist of machine language opcodes that are distinguished among classes using Long Short-Term Memory (LSTM) networks after converting them into sequences. In addition, features are extracted from these architectures (CNNs and LSTM) and are classified using a support vector machine or logistic regression. An accuracy of 97.2% is achieved using LSTM network for distinguishing assembly files, 99.4% using CNN architecture for classifying compiled files and an overall accuracy of 99.8% using the proposed ensemble approach thereby setting a new benchmark. An independent and automated classification system for assembly and/or compiled files provides the luxury to anti-malware industry experts to choose the type of system depending on their available computational resources.

LSTM-based soft sensor design for oxygen content of flue gas in coal-fired power plant

2020 ◽  
pp. 014233122093239
Author(s):  
Hongguang Pan ◽  
Tao Su ◽  
Xiangdong Huang ◽  
Zheng Wang
Keyword(s):  
Power Plant ◽  
Oxygen Content ◽  
Flue Gas ◽  
Oxygen Sensor ◽  
Short Term Memory ◽  
Support Vector ◽  
Data Sets ◽  
Auxiliary Variables ◽  
Data Set ◽  
Lstm Network

To address problems of high cost, complicated process and low accuracy of oxygen content measurement in flue gas of coal-fired power plant, a method based on long short-term memory (LSTM) network is proposed in this paper to replace oxygen sensor to estimate oxygen content in flue gas of boilers. Specifically, first, the LSTM model was built with the Keras deep learning framework, and the accuracy of the model was further improved by selecting appropriate super-parameters through experiments. Secondly, the flue gas oxygen content, as the leading variable, was combined with the mechanism and boiler process primary auxiliary variables. Based on the actual production data collected from a coal-fired power plant in Yulin, China, the data sets were preprocessed. Moreover, a selection model of auxiliary variables based on grey relational analysis is proposed to construct a new data set and divide the training set and testing set. Finally, this model is compared with the traditional soft-sensing modelling methods (i.e. the methods based on support vector machine and BP neural network). The RMSE of LSTM model is 4.51% lower than that of GA-SVM model and 3.55% lower than that of PSO-BP model. The conclusion shows that the oxygen content model based on LSTM has better generalization and has certain industrial value.

scholarly journals Real-Time Detection of Dictionary DGA Network Traffic Using Deep Learning

2021 ◽  
Vol 2 (2) ◽  
Author(s):  
Kate Highnam ◽  
Domenic Puzio ◽  
Song Luo ◽  
Nicholas R. Jennings
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real Time ◽  
Network Traffic ◽  
Short Term Memory ◽  
Domain Names ◽  
Control Networks ◽  
Detection Techniques ◽  
Lstm Network ◽  
And Control

AbstractBotnets and malware continue to avoid detection by static rule engines when using domain generation algorithms (DGAs) for callouts to unique, dynamically generated web addresses. Common DGA detection techniques fail to reliably detect DGA variants that combine random dictionary words to create domain names that closely mirror legitimate domains. To combat this, we created a novel hybrid neural network, Bilbo the “bagging” model, that analyses domains and scores the likelihood they are generated by such algorithms and therefore are potentially malicious. Bilbo is the first parallel usage of a convolutional neural network (CNN) and a long short-term memory (LSTM) network for DGA detection. Our unique architecture is found to be the most consistent in performance in terms of AUC, $$F_1$$ F 1 score, and accuracy when generalising across different dictionary DGA classification tasks compared to current state-of-the-art deep learning architectures. We validate using reverse-engineered dictionary DGA domains and detail our real-time implementation strategy for scoring real-world network logs within a large enterprise. In 4 h of actual network traffic, the model discovered at least five potential command-and-control networks that commercial vendor tools did not flag.

scholarly journals Multi-Regional Online Car-Hailing Order Quantity Forecasting Based on the Convolutional Neural Network

Information ◽  
2019 ◽  
Vol 10 (6) ◽  
pp. 193 ◽  
Author(s):  
Zihao Huang ◽  
Gang Huang ◽  
Zhijun Chen ◽  
Chaozhong Wu ◽  
Xiaofeng Ma ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Travel Demand ◽  
Short Term Memory ◽  
Demand Forecasting ◽  
Image Feature ◽  
Support Vector ◽  
Data Set ◽  
Demand Distribution ◽  
Demand Forecasting Model

With the development of online cars, the demand for travel prediction is increasing in order to reduce the information asymmetry between passengers and drivers of online car-hailing. This paper proposes a travel demand forecasting model named OC-CNN based on the convolutional neural network to forecast the travel demand. In order to make full use of the spatial characteristics of the travel demand distribution, this paper meshes the prediction area and creates a travel demand data set of the graphical structure to preserve its spatial properties. Taking advantage of the convolutional neural network in image feature extraction, the historical demand data of the first twenty-five minutes of the entire region are used as a model input to predict the travel demand for the next five minutes. In order to verify the performance of the proposed method, one-month data from online car-hailing of the Chengdu Fourth Ring Road are used. The results show that the model successfully extracts the spatiotemporal features of the data, and the prediction accuracies of the proposed method are superior to those of the representative methods, including the Bayesian Ridge Model, Linear Regression, Support Vector Regression, and Long Short-Term Memory networks.

scholarly journals NeuroVAD: Real-Time Voice Activity Detection from Non-Invasive Neuromagnetic Signals

Sensors ◽  
2020 ◽  
Vol 20 (8) ◽  
pp. 2248 ◽  
Author(s):  
Debadatta Dash ◽  
Paul Ferrari ◽  
Satwik Dutta ◽  
Jun Wang
Keyword(s):  
Real Time ◽  
Short Term Memory ◽  
Support Vector ◽  
Activity Detection ◽  
Neural Signals ◽  
Neural Recordings ◽  
Non Invasive ◽  
Speech Activity ◽  
The Voice ◽  
Voice Activity

Neural speech decoding-driven brain-computer interface (BCI) or speech-BCI is a novel paradigm for exploring communication restoration for locked-in (fully paralyzed but aware) patients. Speech-BCIs aim to map a direct transformation from neural signals to text or speech, which has the potential for a higher communication rate than the current BCIs. Although recent progress has demonstrated the potential of speech-BCIs from either invasive or non-invasive neural signals, the majority of the systems developed so far still assume knowing the onset and offset of the speech utterances within the continuous neural recordings. This lack of real-time voice/speech activity detection (VAD) is a current obstacle for future applications of neural speech decoding wherein BCI users can have a continuous conversation with other speakers. To address this issue, in this study, we attempted to automatically detect the voice/speech activity directly from the neural signals recorded using magnetoencephalography (MEG). First, we classified the whole segments of pre-speech, speech, and post-speech in the neural signals using a support vector machine (SVM). Second, for continuous prediction, we used a long short-term memory-recurrent neural network (LSTM-RNN) to efficiently decode the voice activity at each time point via its sequential pattern-learning mechanism. Experimental results demonstrated the possibility of real-time VAD directly from the non-invasive neural signals with about 88% accuracy.

scholarly journals HST-LSTM: A Hierarchical Spatial-Temporal Long-Short Term Memory Network for Location Prediction

2018 ◽  
Author(s):  
Dejiang Kong ◽  
Fei Wu
Keyword(s):  
Real Time ◽  
Short Term Memory ◽  
Location Based Services ◽  
Location Prediction ◽  
Trajectory Data ◽  
Short Term ◽  
Data Set ◽  
Term Memory ◽  
Long Time ◽  
Long Short Term Memory

The widely use of positioning technology has made mining the movements of people feasible and plenty of trajectory data have been accumulated. How to efficiently leverage these data for location prediction has become an increasingly popular research topic as it is fundamental to location-based services (LBS). The existing methods often focus either on long time (days or months) visit prediction (i.e., the recommendation of point of interest) or on real time location prediction (i.e., trajectory prediction). In this paper, we are interested in the location prediction problem in a weak real time condition and aim to predict users' movement in next minutes or hours. We propose a Spatial-Temporal Long-Short Term Memory (ST-LSTM) model which naturally combines spatial-temporal influence into LSTM to mitigate the problem of data sparsity. Further, we employ a hierarchical extension of the proposed ST-LSTM (HST-LSTM) in an encoder-decoder manner which models the contextual historic visit information in order to boost the prediction performance. The proposed HST-LSTM is evaluated on a real world trajectory data set and the experimental results demonstrate the effectiveness of the proposed model.

Automated Text Detection and Recognition in Annotated Biomedical Publication Images

2014 ◽  
Vol 9 (2) ◽  
pp. 34-63 ◽  
Author(s):  
Soumya De ◽  
R. Joe Stanley ◽  
Beibei Cheng ◽  
Sameer Antani ◽  
Rodney Long ◽  
...  
Keyword(s):  
Character Recognition ◽  
Optical Character Recognition ◽  
Recognition Rate ◽  
Regions Of Interest ◽  
Correct Recognition ◽  
Support Vector ◽  
Data Set ◽  
Biomedical Publication ◽  
Biomedical Publications ◽  
Detection And Recognition

Images in biomedical publications often convey important information related to an article's content. When referenced properly, these images aid in clinical decision support. Annotations such as text labels and symbols, as provided by medical experts, are used to highlight regions of interest within the images. These annotations, if extracted automatically, could be used in conjunction with either the image caption text or the image citations (mentions) in the articles to improve biomedical information retrieval. In the current study, automatic detection and recognition of text labels in biomedical publication images was investigated. This paper presents both image analysis and feature-based approaches to extract and recognize specific regions of interest (text labels) within images in biomedical publications. Experiments were performed on 6515 characters extracted from text labels present in 200 biomedical publication images. These images are part of the data set from ImageCLEF 2010. Automated character recognition experiments were conducted using geometry-, region-, exemplar-, and profile-based correlation features and Fourier descriptors extracted from the characters. Correct recognition as high as 92.67% was obtained with a support vector machine classifier, compared to a 75.90% correct recognition rate with a benchmark Optical Character Recognition technique.

scholarly journals Research on Real-Time Local Rainfall Prediction Based on MEMS Sensors

2018 ◽  
Vol 2018 ◽  
pp. 1-9 ◽  
Author(s):  
Zeyi Chao ◽  
Fangling Pu ◽  
Yuke Yin ◽  
Bin Han ◽  
Xiaoling Chen
Keyword(s):  
Real Time ◽  
Microelectromechanical Systems ◽  
Short Term Memory ◽  
Moving Average ◽  
Back Propagation ◽  
Support Vector ◽  
Mems Sensors ◽  
Rainfall Prediction ◽  
Weather Parameter ◽  
Pattern Description

A more accurate and timely rainfall prediction is needed for flood disaster reduction and prevention in Wuhan. The in situ microelectromechanical systems’ (MEMS) sensors can provide high time and spatial resolution of weather parameter measurement, but they suffer from stochastic measurement error. In order to apply MEMS sensors in real-time rainfall prediction in Wuhan, firstly, seasonal trend decomposition using Loess (STL) algorithm is utilized to decompose the observed time series into trend, seasonal, and remainder components. The trend of the observed series is compared with the corresponding trend of the data downloaded from the authoritative website with the same weather parameter in terms of Euclidean distance and cosine similarity. The similarity demonstrates that the observation of MEMS sensors is believable. Secondly, the long short-term memory (LSTM) is used to predict the real-time rainfall based on the observed data. Compared with autoregressive and moving average (ARMA), random forest (RF), support vector machine (SVM), and back propagation neural networks (BPNNs), LSTM not only performs as well as ARMA in real-time rainfall prediction but also outperforms the other four models in seasonal rainfall pattern description and seasonal real-time rainfall prediction. Our experiment results show that more detailed, timely, and accurate rainfall prediction can be achieved by using LSTM on the MEMS weather sensors.

scholarly journals A Real-Time Patient Monitoring Framework for Fall Detection

2019 ◽  
Vol 2019 ◽  
pp. 1-13 ◽  
Author(s):  
Dharmitha Ajerla ◽  
Sazia Mahfuz ◽  
Farhana Zulkernine
Keyword(s):  
Real Time ◽  
Data Analytics ◽  
Short Term Memory ◽  
Detection System ◽  
Fall Detection ◽  
Edge Computing ◽  
Streaming Data ◽  
Real Time Analysis ◽  
Long Short Term Memory ◽  
Lstm Network

Fall detection is a major problem in the healthcare department. Elderly people are more prone to fall than others. There are more than 50% of injury-related hospitalizations in people aged over 65. Commercial fall detection devices are expensive and charge a monthly fee for their services. A more affordable and adaptable system is necessary for retirement homes and clinics to build a smart city powered by IoT and artificial intelligence. An effective fall detection system would detect a fall and send an alarm to the appropriate authorities. We propose a framework that uses edge computing where instead of sending data to the cloud, wearable devices send data to a nearby edge device like a laptop or mobile device for real-time analysis. We use cheap wearable sensor devices from MbientLab, an open source streaming engine called Apache Flink for streaming data analytics, and a long short-term memory (LSTM) network model for fall classification. The model is trained using a published dataset called “MobiAct.” Using the trained model, we analyse optimal sampling rates, sensor placement, and multistream data correction. Our edge computing framework can perform real-time streaming data analytics to detect falls with an accuracy of 95.8%.

scholarly journals Prediction of Lane-Changing Maneuvers with Automatic Labeling and Deep Learning

2020 ◽  
Vol 2674 (7) ◽  
pp. 336-347 ◽  
Author(s):  
Vishal Mahajan ◽  
Christos Katrakazas ◽  
Constantinos Antoniou
Keyword(s):  
Real Time ◽  
Autonomous Vehicles ◽  
Short Term Memory ◽  
Highway Safety ◽  
Unlabeled Data ◽  
Support Vector ◽  
False Alarms ◽  
Lane Changing ◽  
Lane Changes ◽  
Significant Research

Highway safety has attracted significant research interest in recent years, especially as innovative technologies such as connected and autonomous vehicles (CAVs) are fast becoming a reality. Identification and prediction of driving intention are fundamental for avoiding collisions as it can provide useful information to drivers and vehicles in their vicinity. However, the state-of-the-art in maneuver prediction requires the utilization of large labeled datasets, which demand a significant amount of processing and might hinder real-time applications. In this paper, an end-to-end machine learning model for predicting lane-change maneuvers from unlabeled data using a limited number of features is developed and presented. The model is built on a novel comprehensive dataset (i.e., highD) obtained from German highways with camera-equipped drones. Density-based clustering is used to identify lane-changing and lane-keeping maneuvers and a support vector machine (SVM) model is then trained to learn the boundaries of the clustered labels and automatically label the new raw data. The labeled data are then input to a long short-term memory (LSTM) model which is used to predict maneuver class. The classification results show that lane changes can efficiently be predicted in real-time, with an average detection time of at least 3 s with a small percentage of false alarms. The utilization of unlabeled data and vehicle characteristics as features increases the prospects of transferability of the approach and its practical application for highway safety.

Sign in / Sign up

Export Citation Format

Share Document