scholarly journals Landslide Occurrence Prediction Using Trainable Cascade Forward Network and Multilayer Perceptron

2015 ◽  
Vol 2015 ◽  
pp. 1-9 ◽  
Author(s):  
Mohammad Subhi Al-batah ◽  
Mutasem Sh. Alkhasawneh ◽  
Lea Tien Tay ◽  
Umi Kalthum Ngah ◽  
Habibah Hj Lateh ◽  
...  
Keyword(s):  
Neural Network ◽  
Conjugate Gradient ◽  
Multilayer Perceptron ◽  
Gradient Descent ◽  
Research Work ◽  
Machine Learning Algorithms ◽  
Training Data ◽  
Operating Characteristics ◽  
Data Set ◽  
Levenberg Marquardt

Landslides are one of the dangerous natural phenomena that hinder the development in Penang Island, Malaysia. Therefore, finding the reliable method to predict the occurrence of landslides is still the research of interest. In this paper, two models of artificial neural network, namely, Multilayer Perceptron (MLP) and Cascade Forward Neural Network (CFNN), are introduced to predict the landslide hazard map of Penang Island. These two models were tested and compared using eleven machine learning algorithms, that is, Levenberg Marquardt, Broyden Fletcher Goldfarb, Resilient Back Propagation, Scaled Conjugate Gradient, Conjugate Gradient with Beale, Conjugate Gradient with Fletcher Reeves updates, Conjugate Gradient with Polakribiere updates, One Step Secant, Gradient Descent, Gradient Descent with Momentum and Adaptive Learning Rate, and Gradient Descent with Momentum algorithm. Often, the performance of the landslide prediction depends on the input factors beside the prediction method. In this research work, 14 input factors were used. The prediction accuracies of networks were verified using the Area under the Curve method for the Receiver Operating Characteristics. The results indicated that the best prediction accuracy of 82.89% was achieved using the CFNN network with the Levenberg Marquardt learning algorithm for the training data set and 81.62% for the testing data set.

scholarly journals Deep Neural Network for Multi-Class Prediction of Student Performance in Educational Data

2019 ◽  
Vol 8 (2) ◽  
pp. 5073-5081
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Student Performance ◽  
Activation Function ◽  
Machine Learning Algorithms ◽  
Training Data ◽  
Fine Tuning ◽  
Academic Excellence ◽  
Data Set

Prediction of student performance is the significant part in processing the educational data. Machine learning algorithms are leading the role in this process. Deep learning is one of the important concepts of machine learning algorithm. In this paper, we applied the deep learning technique for prediction of the academic excellence of the students using R Programming. Keras and Tensorflow libraries utilized for making the model using neural network on the Kaggle dataset. The data is separated into testing data training data set. Plot the neural network model using neuralnet method and created the Deep Learning model using two hidden layers using ReLu activation function and one output layer using softmax activation function. After fine tuning process until the stable changes; this model produced accuracy as 85%.

scholarly journals Applying Sentiment Product Reviews and Visualization for BI Systems in Vietnamese E-Commerce Website: Focusing on Vietnamese Context

Electronics ◽  
2021 ◽  
Vol 10 (20) ◽  
pp. 2481
Author(s):  
Ngoc-Bao-Van Le ◽  
Jun-Ho Huh
Keyword(s):  
Neural Network ◽  
Short Term Memory ◽  
Evaluation Model ◽  
Machine Learning Algorithms ◽  
Training Data ◽  
Product Reviews ◽  
Analysis Model ◽  
Data Set ◽  
Research Results ◽  
Customer Reviews

Product reviews become more important in the buying decision-making process of customers. Exploiting and analyzing customer product reviews in sentiments also become an advantage for businesses and researchers in e-commerce platforms. This study proposes a sentiment evaluation model of customer reviews by extracting objects, emotional words for emotional level analysis, using machine learning algorithms. The research object is the Vietnamese language, which has special semantic structures and characteristics. In this research model, emotional dictionaries and sets of extract rules are combined to build a data training data set based on the semantic dependency relationship between words in sentences of the given Vietnamese context. The recurrent neural network model (RNN) solves the emotional analysis issue, specifically, the long short-term memory neural network (LSTMs). This analysis model combines the vector representations of words with a continuous bag-of-words (CBOW) architecture. Our system is designed to crawl realistic data in an e-commerce website and automatically aggregate them. These data will be stored in MongoDB before processing and input into our model on the server. Then, the system can exploit the features in products reviews and classify customer reviews. These features extracted from different feedback on each shopping step and depending on the kinds of products. Finally, there is a web-app to connect to a server and visualize all the research results. Based on the research results, enterprises can follow up their customers in real-time and receive recommendations to understand their customers. From there, they can improve their services and provide sustainable consumer service.

scholarly journals High-Precision Indoor Visible Light Positioning Using Modified Momentum Back Propagation Neural Network with Sparse Training Point

Sensors ◽  
2019 ◽  
Vol 19 (10) ◽  
pp. 2324 ◽  
Author(s):  
Haiqi Zhang ◽  
Jiahe Cui ◽  
Lihui Feng ◽  
Aiying Yang ◽  
Huichao Lv ◽  
...  
Keyword(s):  
Neural Network ◽  
Visible Light ◽  
High Precision ◽  
Back Propagation ◽  
Back Propagation Neural Network ◽  
Machine Learning Algorithms ◽  
Training Data ◽  
Data Set ◽  
Positioning Accuracy ◽  
Localization Accuracy

In this letter, we propose an indoor visible light positioning technique using a Modified Momentum Back-Propagation (MMBP) algorithm based on received signal strength (RSS) with sparse training data set. Unlike other neural network algorithms that require a large number of training data points to locate accurately, we have realized high-precision positioning for 100 test points with only 20 training points in a 1.8 m × 1.8 m × 2.1 m localization area. In order to verify the adaptability of the MMBP algorithm, we experimentally demonstrate two different training data acquisition methods adopting either even or arbitrary training sets. In addition, we also demonstrate the positioning accuracy of the traditional RSS algorithm. Experimental results show that the average localization accuracy optimized by our proposed algorithm is only 1.88 cm for the arbitrary set and 1.99 cm for the even set, while the average positioning error of the traditional RSS algorithm reaches 14.34 cm. Comparison indicates that the positioning accuracy of our proposed algorithm is 7.6 times higher. Results also show that the performance of our system is higher than some previous reports based on RSS and RSS fingerprint databases using complex machine learning algorithms trained by a large amount of training points.

Cloning Safe Driving Behavior for Self-Driving Cars using Convolutional Neural Networks

2019 ◽  
Vol 12 (2) ◽  
pp. 120-127 ◽  
Author(s):  
Wael Farag
Keyword(s):  
Gradient Descent ◽  
Autonomous Driving ◽  
Driving Behavior ◽  
Training Data ◽  
Stochastic Gradient Descent ◽  
Data Set ◽  
Safe Driving ◽  
Processing Pipeline ◽  
Self Driving Cars ◽  
And Training

Background: In this paper, a Convolutional Neural Network (CNN) to learn safe driving behavior and smooth steering manoeuvring, is proposed as an empowerment of autonomous driving technologies. The training data is collected from a front-facing camera and the steering commands issued by an experienced driver driving in traffic as well as urban roads. Methods: This data is then used to train the proposed CNN to facilitate what it is called “Behavioral Cloning”. The proposed Behavior Cloning CNN is named as “BCNet”, and its deep seventeen-layer architecture has been selected after extensive trials. The BCNet got trained using Adam’s optimization algorithm as a variant of the Stochastic Gradient Descent (SGD) technique. Results: The paper goes through the development and training process in details and shows the image processing pipeline harnessed in the development. Conclusion: The proposed approach proved successful in cloning the driving behavior embedded in the training data set after extensive simulations.

scholarly journals End-to-end convolutional neural network enables COVID-19 detection from breath and cough audio: a pilot study

2021 ◽  
Vol 7 (2) ◽  
pp. 356-362
Author(s):  
Harry Coppock ◽  
Alex Gaskell ◽  
Panagiotis Tzirakis ◽  
Alice Baird ◽  
Lyn Jones ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Low Cost ◽  
Area Under The Curve ◽  
Alternative Form ◽  
Economic Damage ◽  
Audio Signals ◽  
Operating Characteristics ◽  
Data Set ◽  
Empirical Performance

BackgroundSince the emergence of COVID-19 in December 2019, multidisciplinary research teams have wrestled with how best to control the pandemic in light of its considerable physical, psychological and economic damage. Mass testing has been advocated as a potential remedy; however, mass testing using physical tests is a costly and hard-to-scale solution.MethodsThis study demonstrates the feasibility of an alternative form of COVID-19 detection, harnessing digital technology through the use of audio biomarkers and deep learning. Specifically, we show that a deep neural network based model can be trained to detect symptomatic and asymptomatic COVID-19 cases using breath and cough audio recordings.ResultsOur model, a custom convolutional neural network, demonstrates strong empirical performance on a data set consisting of 355 crowdsourced participants, achieving an area under the curve of the receiver operating characteristics of 0.846 on the task of COVID-19 classification.ConclusionThis study offers a proof of concept for diagnosing COVID-19 using cough and breath audio signals and motivates a comprehensive follow-up research study on a wider data sample, given the evident advantages of a low-cost, highly scalable digital COVID-19 diagnostic tool.

Crack-Depth Determination by a Neural Network with a Synthetic Training Data Set

1993 ◽  
pp. 803-810 ◽  
Author(s):  
M. Takadoya ◽  
M. Notake ◽  
M. Kitahara ◽  
J. D. Achenbach ◽  
Q. C. Guo ◽  
...  
Keyword(s):  
Neural Network ◽  
Crack Depth ◽  
Training Data ◽  
Data Set ◽  
Depth Determination ◽  
Synthetic Training Data

scholarly journals Automatic Grading of Stroke Symptoms for Rapid Assessment Using Optimized Machine Learning and 4-Limb Kinematics: Clinical Validation Study (Preprint)

2020 ◽  
Author(s):  
Eunjeong Park ◽  
Kijeong Lee ◽  
Taehwa Han ◽  
Hyo Suk Nam
Keyword(s):  
Machine Learning ◽  
Medical Staff ◽  
Machine Learning Algorithms ◽  
Training Data ◽  
Support Vector ◽  
Grading System ◽  
Operating Characteristics ◽  
Stroke Patients ◽  
Motor Weakness ◽  
Automatic Grading

BACKGROUND Subtle abnormal motor signs are indications of serious neurological diseases. Although neurological deficits require fast initiation of treatment in a restricted time, it is difficult for nonspecialists to detect and objectively assess the symptoms. In the clinical environment, diagnoses and decisions are based on clinical grading methods, including the National Institutes of Health Stroke Scale (NIHSS) score or the Medical Research Council (MRC) score, which have been used to measure motor weakness. Objective grading in various environments is necessitated for consistent agreement among patients, caregivers, paramedics, and medical staff to facilitate rapid diagnoses and dispatches to appropriate medical centers. OBJECTIVE In this study, we aimed to develop an autonomous grading system for stroke patients. We investigated the feasibility of our new system to assess motor weakness and grade NIHSS and MRC scores of 4 limbs, similar to the clinical examinations performed by medical staff. METHODS We implemented an automatic grading system composed of a measuring unit with wearable sensors and a grading unit with optimized machine learning. Inertial sensors were attached to measure subtle weaknesses caused by paralysis of upper and lower limbs. We collected 60 instances of data with kinematic features of motor disorders from neurological examination and demographic information of stroke patients with NIHSS 0 or 1 and MRC 7, 8, or 9 grades in a stroke unit. Training data with 240 instances were generated using a synthetic minority oversampling technique to complement the imbalanced number of data between classes and low number of training data. We trained 2 representative machine learning algorithms, an ensemble and a support vector machine (SVM), to implement auto-NIHSS and auto-MRC grading. The optimized algorithms performed a 5-fold cross-validation and were searched by Bayes optimization in 30 trials. The trained model was tested with the 60 original hold-out instances for performance evaluation in accuracy, sensitivity, specificity, and area under the receiver operating characteristics curve (AUC). RESULTS The proposed system can grade NIHSS scores with an accuracy of 83.3% and an AUC of 0.912 using an optimized ensemble algorithm, and it can grade with an accuracy of 80.0% and an AUC of 0.860 using an optimized SVM algorithm. The auto-MRC grading achieved an accuracy of 76.7% and a mean AUC of 0.870 in SVM classification and an accuracy of 78.3% and a mean AUC of 0.877 in ensemble classification. CONCLUSIONS The automatic grading system quantifies proximal weakness in real time and assesses symptoms through automatic grading. The pilot outcomes demonstrated the feasibility of remote monitoring of motor weakness caused by stroke. The system can facilitate consistent grading with instant assessment and expedite dispatches to appropriate hospitals and treatment initiation by sharing auto-MRC and auto-NIHSS scores between prehospital and hospital responses as an objective observation.

scholarly journals Bootstrapping a Neural Morphological Generator from Morphological Analyzer Output for Inuktitut

2019 ◽  
Vol 2 (1) ◽  
Author(s):  
Jeffrey Micher
Keyword(s):  
Neural Network ◽  
Training Data ◽  
Data Set ◽  
Set Size ◽  
The Neural Network ◽  
Surface Character ◽  
Finite State ◽  
Character Sequences ◽  
Finite State Transducer

We present a method for building a morphological generator from the output of an existing analyzer for Inuktitut, in the absence of a two-way finite state transducer which would normally provide this functionality. We make use of a sequence to sequence neural network which “translates” underlying Inuktitut morpheme sequences into surface character sequences. The neural network uses only the previous and the following morphemes as context. We report a morpheme accuracy of approximately 86%. We are able to increase this accuracy slightly by passing deep morphemes directly to output for unknown morphemes. We do not see significant improvement when increasing training data set size, and postulate possible causes for this.

scholarly journals MODERN METHODS OF BUNDLE ADJUSTMENT ON THE GPU

2016 ◽  
Vol III-3 ◽  
pp. 43-50 ◽  
Author(s):  
R. Hänsch ◽  
I. Drude ◽  
O. Hellwich
Keyword(s):  
Conjugate Gradient ◽  
Gradient Descent ◽  
Optimization Problem ◽  
Error Rates ◽  
Bundle Adjustment ◽  
Test Cases ◽  
Current State ◽  
Marquardt Algorithm ◽  
Levenberg Marquardt ◽  
Nonlinear Conjugate Gradient

The task to compute 3D reconstructions from large amounts of data has become an active field of research within the last years. Based on an initial estimate provided by structure from motion, bundle adjustment seeks to find a solution that is optimal for all cameras and 3D points. The corresponding nonlinear optimization problem is usually solved by the Levenberg-Marquardt algorithm combined with conjugate gradient descent. While many adaptations and extensions to the classical bundle adjustment approach have been proposed, only few works consider the acceleration potentials of GPU systems. This paper elaborates the possibilities of time and space savings when fitting the implementation strategy to the terms and requirements of realizing a bundler on heterogeneous CPUGPU systems. Instead of focusing on the standard approach of Levenberg-Marquardt optimization alone, nonlinear conjugate gradient descent and alternating resection-intersection are studied as two alternatives. The experiments show that in particular alternating resection-intersection reaches low error rates very fast, but converges to larger error rates than Levenberg-Marquardt. PBA, as one of the current state-of-the-art bundlers, converges slower in 50 % of the test cases and needs 1.5-2 times more memory than the Levenberg- Marquardt implementation.

scholarly journals Modeling of daily runoff from a small agricultural watershed using artificial neural network with resampling techniques

2014 ◽  
Vol 17 (1) ◽  
pp. 56-74 ◽  
Author(s):  
Gurjeet Singh ◽  
Rabindra K. Panda ◽  
Marc Lamers
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Agricultural Watershed ◽  
Training Data ◽  
Optimum Number ◽  
Training Process ◽  
Data Set ◽  
Reported Study ◽  
Artificial Neural ◽  
Artificial Neural Network Ann

The reported study was undertaken in a small agricultural watershed, namely, Kapgari in Eastern India having a drainage area of 973 ha. The watershed was subdivided into three sub-watersheds on the basis of drainage network and land topography. An attempt was made to relate the continuously monitored runoff data from the sub-watersheds and the whole-watershed with the rainfall and temperature data using the artificial neural network (ANN) technique. The reported study also evaluated the bias in the prediction of daily runoff with shorter length of training data set using different resampling techniques with the ANN modeling. A 10-fold cross-validation (CV) technique was used to find the optimum number of hidden neurons in the hidden layer and to avoid neural network over-fitting during the training process for shorter length of data. The results illustrated that the ANN models developed with shorter length of training data set avoid neural network over-fitting during the training process, using a 10-fold CV method. Moreover, the biasness was investigated using the bootstrap resampling technique based ANN (BANN) for short length of training data set. In comparison with the 10-fold CV technique, the BANN is more efficient in solving the problems of the over-fitting and under-fitting during training of models for shorter length of data set.

Sign in / Sign up

Export Citation Format

Share Document