scholarly journals Database security: combining neural networks and classification approach

2020 ◽  
pp. 95-115
Author(s):  
Jarosław Skaruz
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Detection System ◽  
Time Series Prediction ◽  
Database Security ◽  
Prediction Problem ◽  
New Approach ◽  
Classification Approach ◽  
Backpropagation Through Time ◽  
The Relationship

In the paper we present a new approach based on application of neural networks to detect SQL attacks. SQL attacks are those attacks that take the advantage of using SQL statements to be performed. The problem of detection of this class of attacks is transformed to time series prediction problem. SQL queries are used as a source of events in a protected environment. To differentiate between normal SQL queries and those sent by an attacker, we divide SQL statements into tokens and pass them to our detection system, which predicts the next token, taking into account previously seen tokens. In the learning phase tokens are passed to a recurrent neural network (RNN) trained by backpropagation through time (BPTT) algorithm. Then, two coefficients of the rule are evaluated. The rule is used to interpret RNN output. In the testing phase RNN with the rule is examined against attacks and legal data to find out how evaluated rule affects efficiency of detecting attacks. All experiments were conducted on Jordan network. Experimental results show the relationship between the rule and a length of SQL queries.

Neural Network Techniques for Time Series Prediction: A Review

2019 ◽  
Vol 3 (3) ◽  
Author(s):  
Muhammad Faheem Mushtaq ◽  
Urooj Akram ◽  
Muhammad Aamir ◽  
Haseeb Ali ◽  
Muhammad Zulqarnain
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Time Series Data ◽  
Weather Prediction ◽  
Time Series Prediction ◽  
Series Data ◽  
Prediction Problem ◽  
Neural Network Models ◽  
Physical Time

It is important to predict a time series because many problems that are related to prediction such as health prediction problem, climate change prediction problem and weather prediction problem include a time component. To solve the time series prediction problem various techniques have been developed over many years to enhance the accuracy of forecasting. This paper presents a review of the prediction of physical time series applications using the neural network models. Neural Networks (NN) have appeared as an effective tool for forecasting of time series.  Moreover, to resolve the problems related to time series data, there is a need of network with single layer trainable weights that is Higher Order Neural Network (HONN) which can perform nonlinearity mapping of input-output. So, the developers are focusing on HONN that has been recently considered to develop the input representation spaces broadly. The HONN model has the ability of functional mapping which determined through some time series problems and it shows the more benefits as compared to conventional Artificial Neural Networks (ANN). The goal of this research is to present the reader awareness about HONN for physical time series prediction, to highlight some benefits and challenges using HONN.

Real-time Detection of Aortic Valve in Echocardiography using Convolutional Neural Networks

2020 ◽  
Vol 16 (5) ◽  
pp. 584-591 ◽  
Author(s):  
Muhammad Hanif Ahmad Nizar ◽  
Chow Khuen Chan ◽  
Azira Khalil ◽  
Ahmad Khairuddin Mohamed Yusof ◽  
Khin Wee Lai
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Heart Disease ◽  
Aortic Valve ◽  
Real Time ◽  
Convolutional Neural Networks ◽  
Valvular Heart Disease ◽  
Detection System ◽  
Processing Unit ◽  
Real Time Detection

Background: Valvular heart disease is a serious disease leading to mortality and increasing medical care cost. The aortic valve is the most common valve affected by this disease. Doctors rely on echocardiogram for diagnosing and evaluating valvular heart disease. However, the images from echocardiogram are poor in comparison to Computerized Tomography and Magnetic Resonance Imaging scan. This study proposes the development of Convolutional Neural Networks (CNN) that can function optimally during a live echocardiographic examination for detection of the aortic valve. An automated detection system in an echocardiogram will improve the accuracy of medical diagnosis and can provide further medical analysis from the resulting detection. Methods: Two detection architectures, Single Shot Multibox Detector (SSD) and Faster Regional based Convolutional Neural Network (R-CNN) with various feature extractors were trained on echocardiography images from 33 patients. Thereafter, the models were tested on 10 echocardiography videos. Results: Faster R-CNN Inception v2 had shown the highest accuracy (98.6%) followed closely by SSD Mobilenet v2. In terms of speed, SSD Mobilenet v2 resulted in a loss of 46.81% in framesper- second (fps) during real-time detection but managed to perform better than the other neural network models. Additionally, SSD Mobilenet v2 used the least amount of Graphic Processing Unit (GPU) but the Central Processing Unit (CPU) usage was relatively similar throughout all models. Conclusion: Our findings provide a foundation for implementing a convolutional detection system to echocardiography for medical purposes.

scholarly journals Predicting Financial Prices of Stock Market using Recurrent Convolutional Neural Networks

2020 ◽  
Vol 12 (6) ◽  
pp. 21-32
Author(s):  
Muhammad Zulqarnain ◽  
◽  
Rozaida Ghazali ◽  
Muhammad Ghulam Ghouse ◽  
Yana Mazwin Mohmad Hassim ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Financial Time Series ◽  
Time Series Prediction ◽  
Financial Time ◽  
Data Mining Approach ◽  
Learning Tasks ◽  
Financial Prices ◽  
Stock Indexes

Financial time-series prediction has been long and the most challenging issues in financial market analysis. The deep neural networks is one of the excellent data mining approach has received great attention by researchers in several areas of time-series prediction since last 10 years. “Convolutional neural network (CNN) and recurrent neural network (RNN) models have become the mainstream methods for financial predictions. In this paper, we proposed to combine architectures, which exploit the advantages of CNN and RNN simultaneously, for the prediction of trading signals. Our model is essentially presented to financial time series predicting signals through a CNN layer, and directly fed into a gated recurrent unit (GRU) layer to capture long-term signals dependencies. GRU model perform better in sequential learning tasks and solve the vanishing gradients and exploding issue in standard RNNs. We evaluate our model on three datasets for stock indexes of the Hang Seng Indexes (HSI), the Deutscher Aktienindex (DAX) and the S&P 500 Index range 2008 to 2016, and associate the GRU-CNN based approaches with the existing deep learning models. Experimental results present that the proposed GRU-CNN model obtained the best prediction accuracy 56.2% on HIS dataset, 56.1% on DAX dataset and 56.3% on S&P500 dataset respectively.

Using Neural Networks to Discover Patterns in International Equity Markets

2002 ◽  
pp. 205-219 ◽  
Author(s):  
Mary E. Malliaris ◽  
Linda Salchenberger
Keyword(s):  
Neural Networks ◽  
Equity Markets ◽  
Time Frame ◽  
Exact Nature ◽  
Statistical Tools ◽  
New Approach ◽  
International Equity Markets ◽  
International Equity ◽  
The Relationship

The use of neural networks represents a new approach to how this type of problem can be investigated. The economics and finance literature is full of studies that require the researcher to prespecify the exact nature of the relationship and select specific variables to test. In this study, we use a multistage approach that requires no prespecification of the model and allows us to look for associations and relationships that may not have been considered. Previous studies have been limited by the nature of statistical tools, which require the researcher to determine the variables, time frame, and markets to test. An intelligent guess may lead to the desired outcome, but neural networks are used to produce a more thorough analysis of the data, thus improving the researcher’s ability to uncover unanticipated relationships and associations.

scholarly journals FPGA-Based Optical Surface Inspection of Wind Turbine Rotor Blades Using Quantized Neural Networks

Electronics ◽  
2020 ◽  
Vol 9 (11) ◽  
pp. 1824 ◽  
Author(s):  
Lino Antoni Giefer ◽  
Benjamin Staar ◽  
Michael Freitag
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Wind Turbine ◽  
Defect Detection ◽  
Detection System ◽  
Turbine Rotor ◽  
Rotor Blades ◽  
Surface Inspection ◽  
Wind Turbine Rotor

Quantization of the weights and activations of a neural network is a way to drastically reduce necessary memory accesses and to replace arithmetic operations with bit-wise operations. This is especially beneficial for the implementation on field-programmable gate array (FPGA) technology that is particularly suitable for embedded systems due to its low power consumption. In this paper, we propose an in-situ defect detection system utilizing a quantized neural network implemented on an FPGA for an automated surface inspection of wind turbine rotor blades using unpiloted aerial vehicles (UAVs). Contrary to the usual approach of offline defect detection, our approach prevents major downtimes and hence expenses. To our best knowledge, our work is among the first to transfer neural networks with weight and activation quantization into a tangible application. We achieve promising results with our network trained on our dataset consisting of 8024 good and defected rotor blade patches. Compared to a conventional network using floating-point arithmetic, we show that the classification accuracy we achieve is only slightly reduced by approximately 0.6%. With this work, we present a basic system for in-situ defect detection with versatile usability.

scholarly journals Hoax Detection System on Twitter using Feed-Forward and Back-Propagation Neural Networks Classification Method

2020 ◽  
Vol 4 (4) ◽  
pp. 655-663
Author(s):  
Crisanadenta Wintang Kencana ◽  
Erwin Budi Setiawan ◽  
Isman Kurniawan
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Social Media ◽  
Detection System ◽  
Back Propagation ◽  
Detection Methods ◽  
Network Connection ◽  
The Neural Network ◽  
The World ◽  
False News

Social media is one of the ways to connect every individual in the world. It also used by irresponsible people to spread a hoax. Hoax is false news that is made as if it is true. It may cause anxiety and panic in society. It can affect the social and political conditions. This era, the most popular social media is Twitter. It is a place for sharing information and users around the world can share and receive news in short messages or called tweet. Hoax detection gained significant interest in the last decade. Existing hoax detection methods are based on either news-content or social-context using user-based features. In this study, we present a hoax detection based on FF & BP neural networks. In the developing of it, we used two vectorization methods, TF-IDF and Word2Vec. Our model is designed to automatically learn features for hoax news classification through several hidden layers built into the neural network.  The neural network is actually using the ability of the human brain that is able to provide stimulation, process, and output. It works by the neuron to process every information that enters, then is processed through a network connection, and will continue learning to produce abilities to do classification. Our proposed model would be helpful to provide a better solution for hoax detection. Data collection obtained through crawling used Twitter API and retrieve data according to the keywords and hashtags. The neural networks highest accuracy obtained using TF-IDF by 78.76%. We also found that data quality affects the performance.

scholarly journals Understanding memories of the Holocaust—A new approach to neural networks in the digital humanities

2019 ◽  
Vol 35 (1) ◽  
pp. 17-33
Author(s):  
Tobias Blanke ◽  
Michael Bryant ◽  
Mark Hedges
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Sentiment Analysis ◽  
Digital Humanities ◽  
Research Question ◽  
Real Life ◽  
Computational Modelling ◽  
The United States ◽  
New Approach ◽  
Distant Supervision

Abstract This article addresses an important challenge in artificial intelligence research in the humanities, which has impeded progress with supervised methods. It introduces a novel method to creating test collections from smaller subsets. This method is based on what we will introduce as distant supervision’ and will allow us to improve computational modelling in the digital humanities by including new methods of supervised learning. Using recurrent neural networks, we generated a training corpus and were able to train a highly accurate model that qualitatively and quantitatively improved a baseline model. To demonstrate our new approach experimentally, we employ a real-life research question based on existing humanities collections. We use neural network based sentiment analysis to decode Holocaust memories and present a methodology to combine supervised and unsupervised sentiment analysis to analyse the oral history interviews of the United States Holocaust Memorial Museum. Finally, we employed three advanced methods of computational semantics. These helped us decipher the decisions by the neural network and understand, for instance, the complex sentiments around family memories in the testimonies.

Performance of Multi-Layer Feedforward Neural Networks to Predict Liver Transplantation Outcome

1996 ◽  
Vol 35 (01) ◽  
pp. 12-18 ◽  
Author(s):  
M. Subotin ◽  
W. Marsh ◽  
J. McMichael ◽  
J. J. Fung ◽  
I. Dvorchik
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Liver Transplantation ◽  
Missing Data ◽  
Network Performance ◽  
Missing Values ◽  
Feedforward Neural Networks ◽  
Linear Scaling ◽  
Data Set ◽  
New Approach

AbstractA novel multisolutional clustering and quantization (MCO) algorithm has been developed that provides a flexible way to preprocess data. It was tested whether it would impact the neural network’s performance favorably and whether the employment of the proposed algorithm would enable neural networks to handle missing data. This was assessed by comparing the performance of neural networks using a well-documented data set to predict outcome following liver transplantation. This new approach to data preprocessing leads to a statistically significant improvement in network performance when compared to simple linear scaling. The obtained results also showed that coding missing data as zeroes in combination with the MCO algorithm, leads to a significant improvement in neural network performance on a data set containing missing values in 59.4% of cases when compared to replacement of missing values with either series means or medians.

Learning Transformations with Complex-Valued Neurocomputing

2012 ◽  
Vol 3 (2) ◽  
pp. 81-116
Author(s):  
Tohru Nitta
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Affine Transformations ◽  
Generalization Ability ◽  
Practical Applications ◽  
Optical Flows ◽  
Fractal Images ◽  
Inherent Nature ◽  
The Relationship ◽  
Complex Valued

The ability of the 1-n-1 complex-valued neural network to learn 2D affine transformations has been applied to the estimation of optical flows and the generation of fractal images. The complex-valued neural network has the adaptability and the generalization ability as inherent nature. This is the most different point between the ability of the 1-n-1 complex-valued neural network to learn 2D affine transformations and the standard techniques for 2D affine transformations such as the Fourier descriptor. It is important to clarify the properties of complex-valued neural networks in order to accelerate its practical applications more and more. In this paper, first, the generalization ability of the 1-n-1 complex-valued neural network which has learned complicated rotations on a 2D plane is examined experimentally and analytically. Next, the behavior of the 1-n-1 complex-valued neural network that has learned a transformation on the Steiner circles is demonstrated, and the relationship the values of the complex-valued weights after training and a linear transformation related to the Steiner circles is clarified via computer simulations. Furthermore, the relationship the weight values of the 1-n-1 complex-valued neural network learned 2D affine transformations and the learning patterns used is elucidated. These research results make it possible to solve complicated problems more simply and efficiently with 1-n-1 complex-valued neural networks. As a matter of fact, an application of the 1-n-1 type complex-valued neural network to an associative memory is presented.

Sign in / Sign up

Export Citation Format

Share Document