scholarly journals LEARNING AND UNDERSTANDING BASED ON NEURAL NETWORK TREES

2014 ◽  
pp. 84-92
Author(s):  
Qiangfu Zhao
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Decision Tree ◽  
The Other ◽  
Symbolic Model ◽  
Changing Environments ◽  
Model Based ◽  
Black Boxes ◽  
Network Tree ◽  
Recognition Learning

Models for machine learning can be categorized roughly into two groups: symbolic and non-symbolic Generally speaking, symbolic model based learning can provide understandable results, but cannot adapt to changing environments efficiently. On the other hand, non-symbolic model based learning can adapt to changing environments, but the results are usually "black-boxes”. In our study, we introduced a hybrid model called neural network tree (NNTree). An NNTree is a decision tree (DT) with each non-terminal node containing an expert neural network (ENN). Results obtained so far show that an NNTree can be re-trained incrementally using new data. In addition, an NNTree can be interpreted easily if we restrict the number of inputs for each ENN. Thus, it is possible to perform recognition, learning and understand using the NNTree model alone.

scholarly journals Analysis of the Nosema Cells Identification for Microscopic Images

Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3068
Author(s):  
Soumaya Dghim ◽  
Carlos M. Travieso-González ◽  
Radim Burget
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Image Processing ◽  
Deep Learning ◽  
The Other ◽  
Support Vector ◽  
Learning Approaches ◽  
Microscopic Images ◽  
Trained Neural Network ◽  
Nosema Disease

The use of image processing tools, machine learning, and deep learning approaches has become very useful and robust in recent years. This paper introduces the detection of the Nosema disease, which is considered to be one of the most economically significant diseases today. This work shows a solution for recognizing and identifying Nosema cells between the other existing objects in the microscopic image. Two main strategies are examined. The first strategy uses image processing tools to extract the most valuable information and features from the dataset of microscopic images. Then, machine learning methods are applied, such as a neural network (ANN) and support vector machine (SVM) for detecting and classifying the Nosema disease cells. The second strategy explores deep learning and transfers learning. Several approaches were examined, including a convolutional neural network (CNN) classifier and several methods of transfer learning (AlexNet, VGG-16 and VGG-19), which were fine-tuned and applied to the object sub-images in order to identify the Nosema images from the other object images. The best accuracy was reached by the VGG-16 pre-trained neural network with 96.25%.

scholarly journals Near-Optimal Sparse Neural Trees for Supervised Learning

2021 ◽  
Author(s):  
Tanujit Chakraborty
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Decision Tree ◽  
Classification Tree ◽  
Mathematical Formulation ◽  
Machine Learning Algorithms ◽  
Optimal Decision ◽  
Feed Forward ◽  
Feed Forward Network ◽  
Tree Algorithms

Decision tree algorithms have been among the most popular algorithms for interpretable (transparent) machine learning since the early 1980s. On the other hand, deep learning methods have boosted the capacity of machine learning algorithms and are now being used for non-trivial applications in various applied domains. But training a fully-connected deep feed-forward network by gradient-descent backpropagation is slow and requires arbitrary choices regarding the number of hidden units and layers. In this paper, we propose near-optimal neural regression trees, intending to make it much faster than deep feed-forward networks and for which it is not essential to specify the number of hidden units in the hidden layers of the neural network in advance. The key idea is to construct a decision tree and then simulate the decision tree with a neural network. This work aims to build a mathematical formulation of neural trees and gain the complementary benefits of both sparse optimal decision trees and neural trees. We propose near-optimal sparse neural trees (NSNT) that is shown to be asymptotically consistent and robust in nature. Additionally, the proposed NSNT model obtain a fast rate of convergence which is near-optimal up to some logarithmic factor. We comprehensively benchmark the proposed method on a sample of 80 datasets (40 classification datasets and 40 regression datasets) from the UCI machine learning repository. We establish that the proposed method is likely to outperform the current state-of-the-art methods (random forest, XGBoost, optimal classification tree, and near-optimal nonlinear trees) for the majority of the datasets.

scholarly journals An Attempt to Use Machine Learning Algorithms to Estimate the Rockburst Hazard in Underground Excavations of Hard Coal Mine

Energies ◽  
2021 ◽  
Vol 14 (21) ◽  
pp. 6928
Author(s):  
Łukasz Wojtecki ◽  
Sebastian Iwaszenko ◽  
Derek B. Apel ◽  
Tomasz Cichy
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Artificial Neural Network ◽  
Rock Mass ◽  
Decision Tree ◽  
Risk Prediction ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
Hard Coal ◽  
Underground Excavations

Rockburst is a dynamic rock mass failure occurring during underground mining under unfavorable stress conditions. The rockburst phenomenon concerns openings in different rocks and is generally correlated with high stress in the rock mass. As a result of rockburst, underground excavations lose their functionality, the infrastructure is damaged, and the working conditions become unsafe. Assessing rockburst hazards in underground excavations becomes particularly important with the increasing mining depth and the mining-induced stresses. Nowadays, rockburst risk prediction is based mainly on various indicators. However, some attempts have been made to apply machine learning algorithms for this purpose. For this article, we employed an extensive range of machine learning algorithms, e.g., an artificial neural network, decision tree, random forest, and gradient boosting, to estimate the rockburst risk in galleries in one of the deep hard coal mines in the Upper Silesian Coal Basin, Poland. With the use of these algorithms, we proposed rockburst risk prediction models. Neural network and decision tree models were most effective in assessing whether a rockburst occurred in an analyzed case, taking into account the average value of the recall parameter. In three randomly selected datasets, the artificial neural network models were able to identify all of the rockbursts.

scholarly journals Reconstructing coupled time series in climate systems using three kinds of machine-learning methods

2020 ◽  
Vol 11 (3) ◽  
pp. 835-853
Author(s):  
Yu Huang ◽  
Lichao Yang ◽  
Zuntao Fu
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Time Series ◽  
Explanatory Variable ◽  
The Other ◽  
Nonlinear Coupling ◽  
Linear Coupling ◽  
Explanatory Variables ◽  
Machine Learning Methods ◽  
Reconstruction Quality

Abstract. Despite the great success of machine learning, its application in climate dynamics has not been well developed. One concern might be how well the trained neural networks could learn a dynamical system and what will be the potential application of this kind of learning. In this paper, three machine-learning methods are used: reservoir computer (RC), backpropagation-based (BP) artificial neural network, and long short-term memory (LSTM) neural network. It shows that the coupling relations or dynamics among variables in linear or nonlinear systems can be inferred by RC and LSTM, which can be further applied to reconstruct one time series from the other. Specifically, we analyzed the climatic toy models to address two questions: (i) what factors significantly influence machine-learning reconstruction and (ii) how do we select suitable explanatory variables for machine-learning reconstruction. The results reveal that both linear and nonlinear coupling relations between variables do influence the reconstruction quality of machine learning. If there is a strong linear coupling between two variables, then the reconstruction can be bidirectional, and both of these two variables can be an explanatory variable for reconstructing the other. When the linear coupling among variables is absent but with the significant nonlinear coupling, the machine-learning reconstruction between two variables is direction dependent, and it may be only unidirectional. Then the convergent cross mapping (CCM) causality index is proposed to determine which variable can be taken as the reconstructed one and which as the explanatory variable. In a real-world example, the Pearson correlation between the average tropical surface air temperature (TSAT) and the average Northern Hemisphere SAT (NHSAT) is weak (0.08), but the CCM index of NHSAT cross mapped with TSAT is large (0.70). And this indicates that TSAT can be well reconstructed from NHSAT through machine learning. All results shown in this study could provide insights into machine-learning approaches for paleoclimate reconstruction, parameterization scheme, and prediction in related climate research.Highlights: i The coupling dynamics learned by machine learning can be used to reconstruct time series. ii Reconstruction quality is direction dependent and variable dependent for nonlinear systems. iii The CCM index is a potential indicator to choose reconstructed and explanatory variables. iv The tropical average SAT can be well reconstructed from the average Northern Hemisphere SAT.

Intelligent Models to Predict the Prognosis of Premature Neonates According to Their EEG Signals

2020 ◽  
pp. 830-840
Author(s):  
Yasser Al Hajjar ◽  
Abd El Salam Ahmad Al Hajjar ◽  
Bassam Daya ◽  
Pierre Chauvet
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Artificial Neural Network ◽  
Decision Tree ◽  
Linear Discriminant ◽  
Premature Newborns ◽  
Intelligent Models ◽  
Intelligent Model ◽  
Electroencephalogram Eeg ◽  
The Brain

The aim of this paper is to find the best intelligent model that allows predicting the future of premature newborns according to their electroencephalogram (EEG). EEG is a signal that measures the electrical activity of the brain. In this paper, the authors used a dataset of 397 EEG records detected at birth of premature newborns and their classification by doctors two years later: normal, sick or risky. They executed machine learning on this dataset using several intelligent models such as multiple linear regression, linear discriminant analysis, artificial neural network and decision tree. They used 14 parameters concerning characteristics extracted from EEG records that affect the prognosis of the newborn. Then, they presented a complete comparative study between these models in order to find who gives best results. Finally, they found that decision tree gave best result with performance of 100% for sick records, 76.9% for risky and 69.1% for normal ones.

Screen efficiency comparisons of decision tree and neural network algorithms in machine learning assisted drug design

2019 ◽  
Vol 62 (4) ◽  
pp. 506-514 ◽  
Author(s):  
Qiumei Pu ◽  
Yinghao Li ◽  
Hong Zhang ◽  
Haodong Yao ◽  
Bo Zhang ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Drug Design ◽  
Decision Tree ◽  
Network Algorithms
Sign in / Sign up

Export Citation Format

Share Document