scholarly journals Influence of the Depth of the Convolutional Neural Networks on an Artificial Intelligence Model for Diagnosis of Orthognathic Surgery

2021 ◽  
Vol 11 (5) ◽  
pp. 356
Author(s):  
Ye-Hyun Kim ◽  
Jae-Bong Park ◽  
Min-Seok Chang ◽  
Jae-Jun Ryu ◽  
Won Hee Lim ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
Orthognathic Surgery ◽  
Area Under The Curve ◽  
Network Models ◽  
Neural Network Models ◽  
Test Set ◽  
The Neural Networks ◽  
The Difference ◽  
Average Success Rate

The aim of this study was to investigate the relationship between image patterns in cephalometric radiographs and the diagnosis of orthognathic surgery and propose a method to improve the accuracy of predictive models according to the depth of the neural networks. The study included 640 and 320 patients requiring non-surgical and surgical orthodontic treatments, respectively. The data of 150 patients were exclusively classified as a test set. The data of the remaining 810 patients were split into five groups and a five-fold cross-validation was performed. The convolutional neural network models used were ResNet-18, 34, 50, and 101. The number in the model name represents the difference in the depth of the blocks that constitute the model. The accuracy, sensitivity, and specificity of each model were estimated and compared. The average success rate in the test set for the ResNet-18, 34, 50, and 101 was 93.80%, 93.60%, 91.13%, and 91.33%, respectively. In screening, ResNet-18 had the best performance with an area under the curve of 0.979, followed by ResNets-34, 50, and 101 at 0.974, 0.945, and 0.944, respectively. This study suggests the required characteristics of the structure of an artificial intelligence model for decision-making based on medical images.

Comprehensive Introduction to Neural Networks

2021 ◽  
pp. 24-48
Author(s):  
Rajesh Sai K. ◽  
Veneela Adapa ◽  
Hari Kishan Kondaveeti
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Human Brain ◽  
Network Models ◽  
Neuron Models ◽  
Neural Network Models ◽  
The Neural Networks ◽  
Biological Neuron ◽  
Comprehensive Introduction

Unknowingly, artificial intelligence (AI) has become an inevitable part of our lives. In this chapter, the authors discuss how the neural networks, a sub-part of AI, changed the way we analyse things. In this chapter, the advent of neural networks, inspiration from the human brain, simplification models of biological neuron models are discussed. Later, a detailed overview of various neural network models, their strengths, limitations, applications, and challenges are presented in detail.

scholarly journals Demand Modelling in Telecommunications

10.14311/1121 ◽  
2009 ◽  
Vol 49 (2) ◽  
Author(s):  
M. Chvalina
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Network Models ◽  
Short Term ◽  
Neural Network Models ◽  
Term Forecast ◽  
Artificial Intelligence Methods ◽  
Demand Modelling

This article analyses the existing possibilities for using Standard Statistical Methods and Artificial Intelligence Methods for a short-term forecast and simulation of demand in the field of telecommunications. The most widespread methods are based on Time Series Analysis. Nowadays, approaches based on Artificial Intelligence Methods, including Neural Networks, are booming. Separate approaches will be used in the study of Demand Modelling in Telecommunications, and the results of these models will be compared with actual guaranteed values. Then we will examine the quality of Neural Network models. 

scholarly journals Real-Time Guitar Amplifier Emulation with Deep Learning

2020 ◽  
Vol 10 (3) ◽  
pp. 766 ◽  
Author(s):  
Alec Wright ◽  
Eero-Pekka Damskägg ◽  
Lauri Juvela ◽  
Vesa Välimäki
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Real Time ◽  
Reference Signal ◽  
Network Models ◽  
Neural Network Models ◽  
Desktop Computer ◽  
The Neural Network ◽  
Highly Nonlinear ◽  
The Difference

This article investigates the use of deep neural networks for black-box modelling of audio distortion circuits, such as guitar amplifiers and distortion pedals. Both a feedforward network, based on the WaveNet model, and a recurrent neural network model are compared. To determine a suitable hyperparameter configuration for the WaveNet, models of three popular audio distortion pedals were created: the Ibanez Tube Screamer, the Boss DS-1, and the Electro-Harmonix Big Muff Pi. It is also shown that three minutes of audio data is sufficient for training the neural network models. Real-time implementations of the neural networks were used to measure their computational load. To further validate the results, models of two valve amplifiers, the Blackstar HT-5 Metal and the Mesa Boogie 5:50 Plus, were created, and subjective tests were conducted. The listening test results show that the models of the first amplifier could be identified as different from the reference, but the sound quality of the best models was judged to be excellent. In the case of the second guitar amplifier, many listeners were unable to hear the difference between the reference signal and the signals produced with the two largest neural network models. This study demonstrates that the neural network models can convincingly emulate highly nonlinear audio distortion circuits, whilst running in real-time, with some models requiring only a relatively small amount of processing power to run on a modern desktop computer.

scholarly journals Neural Networks for Target Selection in Direct Marketing

2002 ◽  
pp. 89-111 ◽  
Author(s):  
Rob Potharst ◽  
Uzay Kaymak ◽  
Wim Pijls
Keyword(s):  
Neural Networks ◽  
Model Building ◽  
Target Selection ◽  
Direct Marketing ◽  
Network Models ◽  
Neural Network Models ◽  
The Neural Network ◽  
The Neural Networks ◽  
Charity Organization ◽  
Comparison Of The Results

The outline of the chapter is as follows. The section on direct marketing explains briefly what it is and discusses the target selection problem in direct marketing. Target selection for a charity organization is also explained. The next section discusses how neural networks can be used for building target selection models that a charity organization can use. The section on data preparation considers how the actual data for training the neural networks is obtained from the organization’s database. The actual model building steps are explained in the following section. The results of the neural network models are discussed afterwards, followed by a comparison of the results with some other target selection methods. Finally, the chapter concludes with a short discussion.

Modified Tartagli Method for Calculation of Jominy Hardenability Curve

2008 ◽  
Vol 575-578 ◽  
pp. 892-897 ◽  
Author(s):  
Wojciech Sitek ◽  
Jacek Trzaska ◽  
Leszek Adam Dobrzański
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Chemical Composition ◽  
Network Models ◽  
Steel Grade ◽  
Regression Coefficients ◽  
Neural Network Models ◽  
The Neural Network ◽  
The Neural Networks ◽  
Hardenability Curve

Basing on the experimental results of the hardenability investigations, which employed Jominy method, the model of the neural networks was developed and fully verified experimentally. The model makes it possible to obtain Jominy hardenability curves basing on the steel chemical composition. The modified hardenability curves calculation method is presented in the paper, initially developed by Tartaglia, Eldis, and Geissler, later extended by T. Inoue. The method makes use of the similarity of the Jominy curve to the hyperbolic secant function. The empirical formulae proposed by the authors make calculation of the hardenability curve possible basing on the chemical composition of the steel. However, regression coefficients characteristic for the particular steel grade must be known. Replacing some formulae by the neural network models is proposed in the paper.

scholarly journals A Novel Low-Bit Quantization Strategy for Compressing Deep Neural Networks

2020 ◽  
Vol 2020 ◽  
pp. 1-7
Author(s):  
Xin Long ◽  
XiangRong Zeng ◽  
Zongcheng Ben ◽  
Dianle Zhou ◽  
Maojun Zhang
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Neural Networks ◽  
Computational Cost ◽  
Network Models ◽  
Memory Consumption ◽  
Neural Network Models ◽  
The Neural Network ◽  
The Neural Networks ◽  
Novel Strategy

The increase in sophistication of neural network models in recent years has exponentially expanded memory consumption and computational cost, thereby hindering their applications on ASIC, FPGA, and other mobile devices. Therefore, compressing and accelerating the neural networks are necessary. In this study, we introduce a novel strategy to train low-bit networks with weights and activations quantized by several bits and address two corresponding fundamental issues. One is to approximate activations through low-bit discretization for decreasing network computational cost and dot-product memory. The other is to specify weight quantization and update mechanism for discrete weights to avoid gradient mismatch. With quantized low-bit weights and activations, the costly full-precision operation will be replaced by shift operation. We evaluate the proposed method on common datasets, and results show that this method can dramatically compress the neural network with slight accuracy loss.

Bending Moment Prediction for Continuous Composite Beams by Neural Networks

2007 ◽  
Vol 10 (4) ◽  
pp. 439-454 ◽  
Author(s):  
Sandeep Chaudhary ◽  
Umesh Pendharkar ◽  
Ashok Kumar Nagpal
Keyword(s):  
Neural Networks ◽  
Structural Parameters ◽  
Bending Moment ◽  
Network Models ◽  
Composite Beams ◽  
Computational Effort ◽  
Neural Network Models ◽  
Significant Saving ◽  
Building Frames ◽  
The Neural Networks

A methodology has been developed for the continuous composite beams to predict the inelastic bending moments (considering the cracking of concrete) from the elastic moments (neglecting the cracking) by using the neural networks. The proposed neural network models predict the inelastic moment ratios (ratio of inelastic moment to elastic moment) at the supports of a span. Nine significant structural parameters have been identified governing the inelastic moment ratios. Six neural networks have been presented to cover the entire practical range of the beams. The proposed neural networks have been validated for a number of beams with different number of spans and the errors are shown to be small for practical purposes. The methodology enables rapid estimation of inelastic moments. The methodology can easily be extended for large composite building frames where a very significant saving in computational effort would result. The feasibility of the methodology for building frames has been demonstrated by considering a single story frame.

scholarly journals Multicenter Validation of Convolutional Neural Networks for Automated Detection of Cardiomegaly on Chest Radiographs

2020 ◽  
Author(s):  
Diego Cardenas ◽  
José Ferreira Junior ◽  
Ramon Moreno ◽  
Marina Rebelo ◽  
José Krieger ◽  
...  
Keyword(s):  
Neural Network ◽  
External Validation ◽  
Area Under The Curve ◽  
Network Models ◽  
Automated Detection ◽  
Neural Network Models ◽  
Test Set ◽  
Chest Cavity ◽  
Public Datasets ◽  
Multicenter Validation

This work focused on validating five convolutional neural network models to detect automatically cardiomegaly, a health complication that causes heart enlargement, which may lead to cardiac arrest. To do that, we trained the models with a customized multilayer perceptron. Radiographs from two public datasets were used in experiments, one of them only for external validation. Images were pre-processed to contain just the chest cavity. The EfficientNet model yielded the highest area under the curve (AUC) of 0.91 on the test set. However, the Inception-based model obtained the best generalization performance with AUC of 0.88 on the independent multicentric dataset. Therefore, this work accurately validated radiographic models to identify patients with cardiomegaly.

scholarly journals Utilizing Artificial Neural Network for Load Prediction Caused by Fluid Sloshing in Tanks

Geofluids ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-17
Author(s):  
Hossein Goudarzvand Chegini ◽  
Gholamreza Zarepour
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Models ◽  
Harmonic Excitation ◽  
Load Prediction ◽  
Neural Network Models ◽  
Fluid Sloshing ◽  
Particle Hydrodynamics ◽  
Feed Forward Neural Networks ◽  
The Neural Networks

In this research, neural network models were used to predict the action of sloshing phenomena in a tank containing fluid under harmonic excitation. A new methodology is proposed in this analysis to test and simulate fluid sloshing behavior in the tank. The sloshing behavior was first modeled using the smooth particle hydrodynamics (SPH) method. The backpropagation of the error algorithm was then used to apply the two multilayer feed-forward neural networks and the recurrent neural network. The findings of the SPH process are employed in the training and testing of neural networks. Input neural network data include the tank position, velocity, and acceleration, neural output data, and fluid sloshing curve wave position. The findings of the neural networks were correlated with the experimental evidence provided in the literature. The findings revealed that neural networks can be used to predict fluid sloshing.

scholarly journals APPLICATION OF COMPUTER VISION TECHNOLOGIES FOR THE DEVELOPMENT OF A MODEL FOR THE RECOGNITION OF LESIONS OF CULTIVATED PLANTS

2021 ◽  
Vol 21 (3) ◽  
pp. 5-13
Author(s):  
N.A. Yanishevskaya ◽  
◽  
I.P. Bolodurina ◽  
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Computer Vision ◽  
Network Models ◽  
Cultivated Plants ◽  
Industrial Complex ◽  
Neural Network Models ◽  
Crop Disease ◽  
The Russian Federation

In the Russian Federation, the agro-industrial complex is one of the leading sectors of the eco-nomy with a volume of domestic product of 4.5%. Russia owns 10 % of all arable land in the world. According to the data on the sown areas by crops in 2020, most of the agricultural area of Russia is occupied by wheat. The Russian Federation ranks third in the ranking of leading countries in the production of this type of grain crops, as well as leading positions in its export. Brown (leaf) and linear (stem) rust is the most harmful disease of grain crops. It is the reason for the sparseness of wheat crops and leads to a sharp decrease in yield. Therefore, one of the main tasks of farmers is to preserve the crop from diseases. The application of such areas of artificial intelligence as computer vision, machine learning and deep learning is able to cope with this task. These artificial intelligence technologies allow us to successfully solve applied problems of the agro-industrial complex using automated analysis of photographic materials. Aim. To consider the application of computer vision methods for the problem of classification of lesions of cultivated plants on the example of wheat. Materials and methods. The CGIAR Computer Vision for Crop Disease dataset for the crop disease recognition task is taken from the open source Kaggle. It is proposed to use an approach to the re-cognition of lesions of cultivated plants using the well-known neural network models ResNet50, DenseNet169, VGG16 and EfficientNet-B0. Neural network models receive images of wheat as in-put. The output of neural networks is the class of plant damage. To overcome the effect of overfit-ting neural networks, various regularization techniques are investigated. Results. The results of the classification quality, estimated by the software using the F1-score metric, which is the average harmonic between the Precision and Recall measures, are presented. Conclusion. As a result of the conducted research, it was found that the DenseNet model showed the best recognition accuracy us-ing a combination of transfer learning technology and DropOut and L2 regulation technologies to overcome the effect of retraining. The use of this approach allowed us to achieve a recognition ac-curacy of 91%.

Sign in / Sign up

Export Citation Format

Share Document