scholarly journals Do Randomized Algorithms Improve the Efficiency of Minimal Learning Machine?

2020 ◽  
Vol 2 (4) ◽  
pp. 533-557
Author(s):  
Joakim Linja ◽  
Joonas Hämäläinen ◽  
Paavo Nieminen ◽  
Tommi Kärkkäinen
Keyword(s):  
Randomized Algorithms ◽  
Computing Time ◽  
Network Models ◽  
Ordinary Least Squares ◽  
Neural Network Models ◽  
Solution Algorithms ◽  
Attractive Option ◽  
Learning Machine ◽  
First Time ◽  
Minimal Learning Machine

Minimal Learning Machine (MLM) is a recently popularized supervised learning method, which is composed of distance-regression and multilateration steps. The computational complexity of MLM is dominated by the solution of an ordinary least-squares problem. Several different solvers can be applied to the resulting linear problem. In this paper, a thorough comparison of possible and recently proposed, especially randomized, algorithms is carried out for this problem with a representative set of regression datasets. In addition, we compare MLM with shallow and deep feedforward neural network models and study the effects of the number of observations and the number of features with a special dataset. To our knowledge, this is the first time that both scalability and accuracy of such a distance-regression model are being compared to this extent. We expect our results to be useful on shedding light on the capabilities of MLM and in assessing what solution algorithms can improve the efficiency of MLM. We conclude that (i) randomized solvers are an attractive option when the computing time or resources are limited and (ii) MLM can be used as an out-of-the-box tool especially for high-dimensional problems.

Identification of Tomato Leaf Disease Detection using Pretrained Deep Convolutional Neural Network Models

2020 ◽  
Vol 21 (4) ◽  
pp. 625-635
Author(s):  
Anandhakrishnan T ◽  
Jaisakthi S.M Murugaiyan
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Early Stage ◽  
Computing Time ◽  
Network Models ◽  
Deep Convolutional Neural Network ◽  
Neural Network Models ◽  
Leaf Disease ◽  
Proposed Model ◽  
Deep Cnn

In this paper, we proposed a plant leaf disease identification model based on a Pretrained deep convolutional neural network (Deep CNN). The Deep CNN model is trained using an open dataset with 10 different classes of tomato leaves We observed that overall architectures which can increase the best performance of the model. The proposed model was trained using different training epochs, batch sizes and dropouts. The Xception has attained maximum accuracy compare with all other approaches. After an extensive simulation, the proposed model achieves classification accuracy better. This accuracy of the proposed work is greater than the accuracy of all other Pretrained approaches. The proposed model is also tested with respect to its consistency and reliability. The set of data used for this work was collected from the plant village dataset, including sick and healthy images. Models for detection of plant disease should predict the disease quickly and accurately in the early stage itself so that a proper precautionary measures can be applied to avoid further spread of the diseases. So, to reduce the main issue about the leaf diseases, we can analyze distinct kinds of deep neural network architectures in this research. From the outcomes, Xception has a constantly improving more to enhance the accuracy by increasing the number of epochs, without any indications of overfitting and decreasein quality. And Xception also generated a fine 99.45% precision in less computing time.

A Study on the Contribution of 12 Key-Factors to the Growth Rates of the Region of the East Macedonia-Thrace (EMTH) by Using a Neural Network Model

2012 ◽  
Vol 1 (1) ◽  
pp. 18-28
Author(s):  
E. Stathakis ◽  
M. Hanias ◽  
P. Antoniades ◽  
L. Magafas ◽  
D. Bandekas
Keyword(s):  
Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Regional Growth ◽  
Network Models ◽  
Domestic Product ◽  
Key Factors ◽  
Neural Network Models ◽  
First Time

This study gives a new methodological framework regarding the measuring of the contribution of some key-factors on the regional growth rate and forecasting the future development rates, based on Neural Network Models (NN Models). It’s a serious attempt to study the contribution of twelve key-factors to the change of the Regional Gross Domestic Product of the Region of East Macedonia -Thrace during a long-term of growth process, by creating and using a suitable Neural Network Model. Specifically, twelve key-factors, time functioned in the period 1991-2008, are studied for the first time, in order to be investigated, scientifically, firstly their % contribution to growth of the regional economy and secondly, to be predicted how much the (Regional Growth Domestic Product) RGDP-under certain conditions-will be changed. It’s a NN Model with inputs the twelve key-factors in order to be evaluated and measured, at the best precise, their percentage contribution to the RGDP. The model and results can be found further into the article.

Criteria for comparing artificial intelligence systems

2021 ◽  
pp. 21-27
Author(s):  
В.А. Пятакович ◽  
В.Ф. Рычкова ◽  
Н.Г. Левченко
Keyword(s):  
Neural Network ◽  
Network Models ◽  
Neural Model ◽  
Neural Network Models ◽  
Actual Problem ◽  
Neuro Fuzzy ◽  
Classification Of Images ◽  
Fuzzy Network ◽  
First Time

Модели нейронных и нейро-нечетких сетевых критериев сравнения в задачах диагностики и классификации образов. Предложен комплекс критериев для оценки свойств искусственных нейронных и нейро-нечетких сетей. Он включает в себя критерии разнообразия, подгонки, эластичности, равнозначности, устойчивости к шуму, аварийной ситуации, а также заданную монотонность для построения нейронной модели. Применение предложенных критериев на практике позволяет автоматизировать процесс построения, анализа и сравнения нейронных моделей для решения задач диагностики и классификации паттернов. Предложено решение задачи повышения эффективности параметрического синтеза нейросетевых моделей сложных систем для обоснованного принятия решений о классификации подводных целей. Научная новизна работы заключается в том, что впервые предложен комплекс моделей критериев, характеризующих такие свойства нейронных и нейро-нечетких сетей как разнообразие, переобученность, эластичность, эквифинальность, устойчивость к шуму, эмерджентность, что позволяет автоматизировать решение задачи анализа свойств и сравнения нейросетевых и нейро-нечетких моделей при решении задач диагностики и классификации образов. В работе решена актуальная задача автоматизации анализа свойств и сравнения нейросетевых моделей. Models of neural and neuro-fuzzy network comparison criterions in the tasks of diagnostics and pattern classification. The complex of criterions for an estimation of properties artificial neural and neuro-fuzzy networks is proposed. It includes criterions of variety, overfitting, elasticity, equifinality, stability to a noise, emergency, and also set monotonicity for a neural model construction. The application of offered criterions in practice allows to automatize the process of a construction, analysis and comparison of neural models for problem solving of diagnostics and patternt classification. The solution of the problem of increasing the efficiency of parametric synthesis of neural network models of complex systems for informed decision-making on the classification of underwater targets is proposed. The scientific novelty of the work lies in the fact that for the first time a set of models of criteria characterizing such properties of neural and neuro-fuzzy networks as diversity, retraining, elasticity, equifinality, noise resistance, emergence is proposed, which allows automating the solution of the problem of analyzing the properties and comparing neural network and neuro-fuzzy models when solving problems of diagnostics and classification of images. The paper solves the actual problem of automating the analysis of properties and comparison of neural network models.

Neural network models for prediction of trichothecene content in wheat

2008 ◽  
Vol 1 (3) ◽  
pp. 349-356 ◽  
Author(s):  
F. Mateo ◽  
R. Gadea ◽  
R. Mateo ◽  
A. Medina ◽  
F. Valle-Algarra ◽  
...  
Keyword(s):  
Animal Health ◽  
Fungal Growth ◽  
Network Models ◽  
Data Matrix ◽  
Electron Capture Detection ◽  
Contamination Level ◽  
Fungal Contamination ◽  
Neural Network Models ◽  
The Mean ◽  
First Time

Fusarium graminearum is a mould that causes serious diseases in cereals worldwide and that synthesises mycotoxins such as deoxynivalenol (DON), which can seriously affect human and animal health. Predicting the level of mycotoxin accumulation in food is very difficult, because of the complexity of the influencing parameters. In this work, we have studied the possibility of using artificial neural networks (NN) to predict DON level attained in F. graminearum wheat cultures taking as inputs the fungal contamination level of the cereal, the water activity as a measure of the available water for fungal growth in the cereal, the temperature and time. DON analysis was performed by gas chromatography with electron capture detection. The data matrix was used to train and validate various types of NN using MATLAB 7.0. The aim was to obtain a network that provided the best possible fit between predicted and target DON levels by minimising the mean-square error of test. Radial basis function-NNs attained lower errors and better generalisation than multi-layer perceptron networks to predict DON accumulation in wheat. This is the first time that NNs have been used to predict DON accumulation in wheat based on the studied factors.

scholarly journals Two-Dimensional Extreme Learning Machine

2015 ◽  
Vol 2015 ◽  
pp. 1-8 ◽  
Author(s):  
Bo Jia ◽  
Dong Li ◽  
Zhisong Pan ◽  
Guyu Hu
Keyword(s):  
Extreme Learning Machine ◽  
Empirical Studies ◽  
Back Propagation ◽  
Image Data ◽  
Network Models ◽  
Support Vector ◽  
Two Dimensional ◽  
Neural Network Models ◽  
Efficiency And Effectiveness ◽  
Learning Machine

Extreme learning machine (ELM) has achieved wide attention due to faster learning speed compared with conventional neural network models like support vector machine (SVM) and back-propagation (BP) networks. However, like many other methods, ELM is originally proposed to handle vector pattern while nonvector patterns in real applications need to be explored, such as image data. We propose the two-dimensional extreme learning machine (2DELM) based on the very natural idea to deal with matrix data directly. Unlike original ELM which handles vectors, 2DELM take the matrices as input features without vectorization. Empirical studies on several real image datasets show the efficiency and effectiveness of the algorithm.

Complex-Valued Neural Networks

2011 ◽  
pp. 361-366
Author(s):  
Tohru Nitta
Keyword(s):  
Neural Networks ◽  
Soviet Union ◽  
Former Soviet Union ◽  
Neuron Model ◽  
Network Models ◽  
Two Dimensions ◽  
Complex Numbers ◽  
Neural Network Models ◽  
First Time ◽  
Complex Valued

The usual real-valued artificial neural networks have been applied to various fields such as telecommunications, robotics, bioinformatics, image processing and speech recognition, in which complex numbers (two dimensions) are often used with the Fourier transformation. This indicates the usefulness of complex-valued neural networks whose input and output signals and parameters such as weights and thresholds are all complex numbers, which are an extension of the usual real-valued neural networks. In addition, in the human brain, an action potential may have different pulse patterns, and the distance between pulses may be different. This suggests that it is appropriate to introduce complex numbers representing phase and amplitude into neural networks. Aizenberg, Ivaskiv, Pospelov and Hudiakov (1971) (former Soviet Union) proposed a complex-valued neuron model for the first time, and although it was only available in Russian literature, their work can now be read in English (Aizenberg, Aizenberg & Vandewalle, 2000). Prior to that time, most researchers other than Russians had assumed that the first persons to propose a complex-valued neuron were Widrow, McCool and Ball (1975). Interest in the field of neural networks started to grow around 1990, and various types of complex- valued neural network models were subsequently proposed. Since then, their characteristics have been researched, making it possible to solve some problems which could not be solved with the real-valued neuron, and to solve many complicated problems more simply and efficiently.

scholarly journals On Guaranteed Optimal Robust Explanations for NLP Models

2021 ◽  
Author(s):  
Emanuele La Malfa ◽  
Rhiannon Michelmore ◽  
Agnieszka M. Zbrzezny ◽  
Nicola Paoletti ◽  
Marta Kwiatkowska
Keyword(s):  
Neural Network ◽  
Language Processing ◽  
Network Models ◽  
Neural Network Models ◽  
Solution Algorithms ◽  
Input Text ◽  
Bounded Perturbation ◽  
Speed Up ◽  
Key Features ◽  
Prediction Invariance

We build on abduction-based explanations for machine learning and develop a method for computing local explanations for neural network models in natural language processing (NLP). Our explanations comprise a subset of the words of the input text that satisfies two key features: optimality w.r.t. a user-defined cost function, such as the length of explanation, and robustness, in that they ensure prediction invariance for any bounded perturbation in the embedding space of the left-out words. We present two solution algorithms, respectively based on implicit hitting sets and maximum universal subsets, introducing a number of algorithmic improvements to speed up convergence of hard instances. We show how our method can be configured with different perturbation sets in the embedded space and used to detect bias in predictions by enforcing include/exclude constraints on biased terms, as well as to enhance existing heuristic-based NLP explanation frameworks such as Anchors. We evaluate our framework on three widely used sentiment analysis tasks and texts of up to 100 words from SST, Twitter and IMDB datasets, demonstrating the effectiveness of the derived explanations.

Method of complex copper-zinc ore typification using neural network models

2020 ◽  
Vol 5 ◽  
pp. 140-147 ◽  
Author(s):  
T.N. Aleksandrova ◽  
◽  
E.K. Ushakov ◽  
A.V. Orlova ◽  
◽  
...  
Keyword(s):  
Neural Network ◽  
Network Models ◽  
Neural Network Models ◽  
Copper Zinc ◽  
Complex Copper
Sign in / Sign up

Export Citation Format

Share Document