A normalization method of input data that conserves the norm information for competitive learning neural network using inner product

1996 ◽  
Vol 3 (6) ◽  
pp. A414-A417 ◽  
Author(s):  
Mikihiko Terashima ◽  
Fumiyuki Shiratani ◽  
Takeshi Hashimoto ◽  
Kimiaki Yamamoto
Keyword(s):  
Neural Network ◽  
Input Data ◽  
Competitive Learning ◽  
Normalization Method ◽  
Inner Product

scholarly journals A Frequency Pattern Mining Model Based on Deep Neural Network for Real-Time Classification of Heart Conditions

Healthcare ◽  
2020 ◽  
Vol 8 (3) ◽  
pp. 234 ◽  
Author(s):  
Hyun Yoo ◽  
Soyoung Han ◽  
Kyungyong Chung
Keyword(s):  
Neural Network ◽  
Big Data ◽  
Fourier Transform ◽  
Fast Fourier Transform ◽  
Real Time ◽  
Normal Control ◽  
Input Data ◽  
Deep Neural Network ◽  
Pattern Mining ◽  
F Measure

Recently, a massive amount of big data of bioinformation is collected by sensor-based IoT devices. The collected data are also classified into different types of health big data in various techniques. A personalized analysis technique is a basis for judging the risk factors of personal cardiovascular disorders in real-time. The objective of this paper is to provide the model for the personalized heart condition classification in combination with the fast and effective preprocessing technique and deep neural network in order to process the real-time accumulated biosensor input data. The model can be useful to learn input data and develop an approximation function, and it can help users recognize risk situations. For the analysis of the pulse frequency, a fast Fourier transform is applied in preprocessing work. With the use of the frequency-by-frequency ratio data of the extracted power spectrum, data reduction is performed. To analyze the meanings of preprocessed data, a neural network algorithm is applied. In particular, a deep neural network is used to analyze and evaluate linear data. A deep neural network can make multiple layers and can establish an operation model of nodes with the use of gradient descent. The completed model was trained by classifying the ECG signals collected in advance into normal, control, and noise groups. Thereafter, the ECG signal input in real time through the trained deep neural network system was classified into normal, control, and noise. To evaluate the performance of the proposed model, this study utilized a ratio of data operation cost reduction and F-measure. As a result, with the use of fast Fourier transform and cumulative frequency percentage, the size of ECG reduced to 1:32. According to the analysis on the F-measure of the deep neural network, the model had 83.83% accuracy. Given the results, the modified deep neural network technique can reduce the size of big data in terms of computing work, and it is an effective system to reduce operation time.

scholarly journals Comparison of Forecasting Models for Real-Time Monitoring of Water Quality Parameters Based on Hybrid Deep Learning Neural Networks

Water ◽  
2021 ◽  
Vol 13 (11) ◽  
pp. 1547
Author(s):  
Jian Sha ◽  
Xue Li ◽  
Man Zhang ◽  
Zhong-Liang Wang
Keyword(s):  
Neural Network ◽  
Water Quality ◽  
Deep Learning ◽  
Real Time ◽  
Best Management Practices ◽  
Input Data ◽  
Management Practices ◽  
Quality Parameters ◽  
Water Quality Parameters ◽  
Real Time Monitoring

Accurate real-time water quality prediction is of great significance for local environmental managers to deal with upcoming events and emergencies to develop best management practices. In this study, the performances in real-time water quality forecasting based on different deep learning (DL) models with different input data pre-processing methods were compared. There were three popular DL models concerned, including the convolutional neural network (CNN), long short-term memory neural network (LSTM), and hybrid CNN–LSTM. Two types of input data were applied, including the original one-dimensional time series and the two-dimensional grey image based on the complete ensemble empirical mode decomposition algorithm with adaptive noise (CEEMDAN) decomposition. Each type of input data was used in each DL model to forecast the real-time monitoring water quality parameters of dissolved oxygen (DO) and total nitrogen (TN). The results showed that (1) the performances of CNN–LSTM were superior to the standalone model CNN and LSTM; (2) the models used CEEMDAN-based input data performed much better than the models used the original input data, while the improvements for non-periodic parameter TN were much greater than that for periodic parameter DO; and (3) the model accuracies gradually decreased with the increase of prediction steps, while the original input data decayed faster than the CEEMDAN-based input data and the non-periodic parameter TN decayed faster than the periodic parameter DO. Overall, the input data preprocessed by the CEEMDAN method could effectively improve the forecasting performances of deep learning models, and this improvement was especially significant for non-periodic parameters of TN.

scholarly journals Robust Approach to Supervised Deep Neural Network Training for Real-Time Object Classification in Cluttered Indoor Environment

2021 ◽  
Vol 11 (15) ◽  
pp. 7148
Author(s):  
Bedada Endale ◽  
Abera Tullu ◽  
Hayoung Shi ◽  
Beom-Soo Kang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real Time ◽  
Network Architecture ◽  
Input Data ◽  
Deep Neural Network ◽  
Data Augmentation ◽  
Object Classification ◽  
Training Data ◽  
Gradient Descent Algorithm

Unmanned aerial vehicles (UAVs) are being widely utilized for various missions: in both civilian and military sectors. Many of these missions demand UAVs to acquire artificial intelligence about the environments they are navigating in. This perception can be realized by training a computing machine to classify objects in the environment. One of the well known machine training approaches is supervised deep learning, which enables a machine to classify objects. However, supervised deep learning comes with huge sacrifice in terms of time and computational resources. Collecting big input data, pre-training processes, such as labeling training data, and the need for a high performance computer for training are some of the challenges that supervised deep learning poses. To address these setbacks, this study proposes mission specific input data augmentation techniques and the design of light-weight deep neural network architecture that is capable of real-time object classification. Semi-direct visual odometry (SVO) data of augmented images are used to train the network for object classification. Ten classes of 10,000 different images in each class were used as input data where 80% were for training the network and the remaining 20% were used for network validation. For the optimization of the designed deep neural network, a sequential gradient descent algorithm was implemented. This algorithm has the advantage of handling redundancy in the data more efficiently than other algorithms.

scholarly journals Optimal Artificial Neural Network Type Selection Method for Usage in Smart House Systems

Sensors ◽  
2020 ◽  
Vol 21 (1) ◽  
pp. 47
Author(s):  
Vasyl Teslyuk ◽  
Artem Kazarian ◽  
Natalia Kryvinska ◽  
Ivan Tsmots
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Artificial Neural Networks ◽  
Input Data ◽  
Optimization Criterion ◽  
Fuzzy Input ◽  
Different Types ◽  
Smart House ◽  
Artificial Neural

In the process of the “smart” house systems work, there is a need to process fuzzy input data. The models based on the artificial neural networks are used to process fuzzy input data from the sensors. However, each artificial neural network has a certain advantage and, with a different accuracy, allows one to process different types of data and generate control signals. To solve this problem, a method of choosing the optimal type of artificial neural network has been proposed. It is based on solving an optimization problem, where the optimization criterion is an error of a certain type of artificial neural network determined to control the corresponding subsystem of a “smart” house. In the process of learning different types of artificial neural networks, the same historical input data are used. The research presents the dependencies between the types of neural networks, the number of inner layers of the artificial neural network, the number of neurons on each inner layer, the error of the settings parameters calculation of the relative expected results.

A New Method of Rolling Prediction for Gas Emission Based on Wavelet Neural Network

2011 ◽  
Vol 383-390 ◽  
pp. 1500-1506
Author(s):  
Yu Min Pan ◽  
Xiao Yu Zhang ◽  
Peng Qian Xue
Keyword(s):  
Neural Network ◽  
Input Data ◽  
Wavelet Neural Network ◽  
New Method ◽  
Neutral Network ◽  
Gas Emission ◽  
Sample Data ◽  
Simulation Results

A new method of rolling prediction for gas emission based on wavelet neural network is proposed in this paper. In the method, part of the sample data is selected, which length is constant, and the data is reselected as the next prediction step. Then a wavelet neutral network is adopted to prediction which input data is rolling, the sequence model of rolling prediction is thus constructed. Simulation results have proved that the method is valid and feasible.

Artificial neural network-based seismic detector

1995 ◽  
Vol 85 (1) ◽  
pp. 308-319 ◽  
Author(s):  
Jin Wang ◽  
Ta-Liang Teng
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Input Data ◽  
Seismic Event ◽  
Signal To Noise Ratio ◽  
Type B ◽  
Earthquake Detection ◽  
Seismic Event Detection ◽  
Artificial Neural ◽  
Better Than

Abstract An artificial neural network-based pattern classification system is applied to seismic event detection. We have designed two types of Artificial Neural Detector (AND) for real-time earthquake detection. Type A artificial neural detector (AND-A) uses the recursive STA/LTA time series as input data, and type B (AND-B) uses moving window spectrograms as input data to detect earthquake signals. The two AND's are trained under supervised learning by using a set of seismic recordings, and then the trained AND's are applied to another set of recordings for testing. Results show that the accuracy of the artificial neural network-based seismic detectors is better than that of the conventional algorithms solely based on the STA/LTA threshold. This is especially true for signals with either low signal-to-noise ratio or spikelike noises.

scholarly journals PATTERN RECOGNITION BASED SPEED FORECASTING METHODOLOGY FOR URBAN TRAFFIC NETWORK

Transport ◽  
2018 ◽  
Vol 33 (4) ◽  
pp. 959-970 ◽  
Author(s):  
Tamás Tettamanti ◽  
Alfréd Csikós ◽  
Krisztián Balázs Kis ◽  
Zsolt János Viharos ◽  
István Varga
Keyword(s):  
Neural Network ◽  
Input Data ◽  
Road Traffic ◽  
Urban Traffic ◽  
Traffic Network ◽  
Data Handling ◽  
Urban Road ◽  
Traffic Sensors ◽  
Network Training ◽  
Artificial Neural Network Ann

A full methodology of short-term traffic prediction is proposed for urban road traffic network via Artificial Neural Network (ANN). The goal of the forecasting is to provide speed estimation forward by 5, 15 and 30 min. Unlike similar research results in this field, the investigated method aims to predict traffic speed for signalized urban road links and not for highway or arterial roads. The methodology contains an efficient feature selection algorithm in order to determine the appropriate input parameters required for neural network training. As another contribution of the paper, a built-in incomplete data handling is provided as input data (originating from traffic sensors or Floating Car Data (FCD)) might be absent or biased in practice. Therefore, input data handling can assure a robust operation of speed forecasting also in case of missing data. The proposed algorithm is trained, tested and analysed in a test network built-up in a microscopic traffic simulator by using daily course of real-world traffic.

scholarly journals The BP Network Classification Leafminer-Infected Leaves Based on the Fractal Dimension

2011 ◽  
Vol 1 ◽  
pp. 163-167
Author(s):  
Da Ke Wu ◽  
Chun Yan Xie
Keyword(s):  
Neural Network ◽  
Fractal Dimension ◽  
Correlation Coefficient ◽  
Bp Neural Network ◽  
Input Data ◽  
Bp Network ◽  
Neural Network Prediction ◽  
Infected Tomato ◽  
Network Prediction ◽  
Hidden Nodes

Leafminer is one of pest of many vegetables, and the damage may cover so much of the leaf that the plant is unable to function, and yields are noticeably decreased. In order to get the information of the pest in the vegetable before the damage was not serious, this research used a BP neural network to classify the leafminer-infected tomato leaves, and the fractal dimension of the leaves was the input data of the BP neural network. Prediction results showed that when the number of FD was 21 and the hidden nodes of BP neural network were 21, the detection performance of the model was good and the correlation coefficient (r) was 0.836. Thus, it is concluded that the FD is an available technique for the detection of disease level of leafminer on tomato leaves.

scholarly journals Input data preprocessing method for exchange rate forecasting via neural network

2014 ◽  
Vol 11 (4) ◽  
pp. 597-608
Author(s):  
Dragan Antic ◽  
Miroslav Milovanovic ◽  
Stanisa Peric ◽  
Sasa Nikolic ◽  
Marko Milojkovic
Keyword(s):  
Neural Network ◽  
Input Data ◽  
Principal Component ◽  
Economic Systems ◽  
Data Sets ◽  
Foreign Exchange Rates ◽  
Analysis Method ◽  
Feed Forward Neural Network ◽  
Parameters Selection ◽  
Neural Network Input

The aim of this paper is to present a method for neural network input parameters selection and preprocessing. The purpose of this network is to forecast foreign exchange rates using artificial intelligence. Two data sets are formed for two different economic systems. Each system is represented by six categories with 70 economic parameters which are used in the analysis. Reduction of these parameters within each category was performed by using the principal component analysis method. Component interdependencies are established and relations between them are formed. Newly formed relations were used to create input vectors of a neural network. The multilayer feed forward neural network is formed and trained using batch training. Finally, simulation results are presented and it is concluded that input data preparation method is an effective way for preprocessing neural network data.

scholarly journals A Novel Multi-Input Multi-Output Recurrent Neural Network Based on Multimodal Fusion and Spatiotemporal Prediction for 0–4 h Precipitation Nowcasting

Atmosphere ◽  
2021 ◽  
Vol 12 (12) ◽  
pp. 1596
Author(s):  
Fuhan Zhang ◽  
Xiaodong Wang ◽  
Jiping Guan
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Input Data ◽  
Learning Strategy ◽  
Meteorological Data ◽  
Precipitation Amount ◽  
Heavy Precipitation ◽  
Precipitation Intensity ◽  
Multimodal Fusion ◽  
Grid Data

Multi-source meteorological data can reflect the development process of single meteorological elements from different angles. Making full use of multi-source meteorological data is an effective method to improve the performance of weather nowcasting. For precipitation nowcasting, this paper proposes a novel multi-input multi-output recurrent neural network model based on multimodal fusion and spatiotemporal prediction, named MFSP-Net. It uses precipitation grid data, radar echo data, and reanalysis data as input data and simultaneously realizes 0–4 h precipitation amount nowcasting and precipitation intensity nowcasting. MFSP-Net can perform the spatiotemporal-scale fusion of the three sources of input data while retaining the spatiotemporal information flow of them. The multi-task learning strategy is used to train the network. We conduct experiments on the dataset of Southeast China, and the results show that MFSP-Net comprehensively improves the performance of the nowcasting of precipitation amounts. For precipitation intensity nowcasting, MFSP-Net has obvious advantages in heavy precipitation nowcasting and the middle and late stages of nowcasting.

Sign in / Sign up

Export Citation Format

Share Document