scholarly journals Evolution of Deep Neural Network Architecture Using Particle Swarm Optimization to Improve the Performance in Determining the Friction Angle of Soil

2021 ◽  
Vol 2021 ◽  
pp. 1-17
Author(s):  
Tuan Anh Pham ◽  
Van Quan Tran ◽  
Huong-Lan Thi Vu
Keyword(s):  
Neural Network ◽  
Particle Swarm Optimization ◽  
Deep Neural Network ◽  
Soil Layer ◽  
Particle Swarm ◽  
Friction Angle ◽  
Pso Algorithm ◽  
Unit Weight ◽  
Data Set ◽  
Swarm Optimization

This study focuses on the use of deep neural network (DNN) to predict the soil friction angle, one of the crucial parameters in geotechnical design. Besides, particle swarm optimization (PSO) algorithm was used to improve the performance of DNN by selecting the best structural DNN parameters, namely, the optimal numbers of hidden layers and neurons in each hidden layer. For this aim, a database containing 245 laboratory tests collected from a project in Ho Chi Minh city, Vietnam, was used for the development of the proposed hybrid PSO-DNN model, including seven input factors (soil state, standard penetration test value, unit weight of soil, void ratio, thickness of soil layer, top elevation of soil layer, and bottom elevation of soil layer) and the friction angle was considered as the target. The data set was divided into three parts, namely, the training, validation, and testing sets for the construction, validation, and testing phases of the model. Various quality assessment criteria, namely, the coefficient of determination (R2), mean absolute error (MAE), and root mean square error (RMSE), were used to estimate the performance of PSO-DNN models. The PSO algorithm showed a remarkable ability to find out an optimal DNN architecture for the prediction process. The results showed that the PSO-DNN model using 10 hidden layers outperformed the DNN model, in which the average correlation improvement increased R2 by 1.83%, MAE by 5.94%, and RMSE by 8.58%. Besides, a global sensitivity analysis technique was used to detect the most important inputs, and it showed that, among the seven input variables, the elevation of top and bottom of soil played an important role in predicting the friction angle of soil.

scholarly journals Position Control of Ultrasonic Motor Using IMC-PID Combined with Tribes Type NN Algorithm

2011 ◽  
Vol 2-3 ◽  
pp. 12-17
Author(s):  
Sheng Lin Mu ◽  
Kanya Tanaka
Keyword(s):  
Neural Network ◽  
Particle Swarm Optimization ◽  
Pid Control ◽  
Position Control ◽  
Back Propagation ◽  
Particle Swarm ◽  
Pso Algorithm ◽  
Ultrasonic Motor ◽  
Swarm Optimization

In this paper, we propose a novel scheme of IMC-PID control combined with a tribes type neural network (NN) for the position control of ultrasonic motor (USM). In this method, the NN controller is employed for tuning the parameter in IMC-PID control. The weights of NN are designed to be updated by the tribes-particle swarm optimization (PSO) algorithm. This method makes it possible to compensate for the characteristic changes and nonlinearity of USM. The parameter-free tribes-PSO requires no information about the USM beforehand; hence its application overcomes the problem of Jacobian estimation in the conventional back propagation (BP) method of NN. The effectiveness of the proposed method is confirmed by experiments.

WNN Model Based on Particle Swarm Optimization for Fault Diagnosis in Analog Circuit

2013 ◽  
Vol 427-429 ◽  
pp. 1048-1051
Author(s):  
Xu Sheng Gan ◽  
Hao Lin Cui ◽  
Ya Rong Wu
Keyword(s):  
Neural Network ◽  
Particle Swarm Optimization ◽  
Fault Diagnosis ◽  
Convergence Rate ◽  
Analog Circuit ◽  
Particle Swarm ◽  
Pso Algorithm ◽  
Wavelet Neural Network ◽  
Swarm Optimization ◽  
Fast Convergence Rate

In order to diagnose the fault in analog circuit correctly, a Wavelet Neural Network (WNN) method is proposed that uses the Particle Swarm Optimization (PSO) algorithm to optimize the network parameters. For the improvement of convergence rate in WNN based on PSO algorithm, a compressing method in research space is introduced into the traditional PSO algorithm to improve the convergence in WNN training. The simulation shows that the proposed method has a good diagnosis with fast convergence rate for the fault in analog circuit.

scholarly journals Novel Ensemble Approach of Deep Learning Neural Network (DLNN) Model and Particle Swarm Optimization (PSO) Algorithm for Prediction of Gully Erosion Susceptibility

Sensors ◽  
2020 ◽  
Vol 20 (19) ◽  
pp. 5609 ◽  
Author(s):  
Shahab S. Band ◽  
Saeid Janizadeh ◽  
Subodh Chandra Pal ◽  
Asish Saha ◽  
Rabin Chakrabortty ◽  
...  
Keyword(s):  
Neural Network ◽  
Particle Swarm Optimization ◽  
Deep Learning ◽  
Particle Swarm ◽  
Pso Algorithm ◽  
Gully Erosion ◽  
Slope Aspect ◽  
Swarm Optimization ◽  
Proposed Model ◽  
Deep Learning Neural Network

This study aims to evaluate a new approach in modeling gully erosion susceptibility (GES) based on a deep learning neural network (DLNN) model and an ensemble particle swarm optimization (PSO) algorithm with DLNN (PSO-DLNN), comparing these approaches with common artificial neural network (ANN) and support vector machine (SVM) models in Shirahan watershed, Iran. For this purpose, 13 independent variables affecting GES in the study area, namely, altitude, slope, aspect, plan curvature, profile curvature, drainage density, distance from a river, land use, soil, lithology, rainfall, stream power index (SPI), and topographic wetness index (TWI), were prepared. A total of 132 gully erosion locations were identified during field visits. To implement the proposed model, the dataset was divided into the two categories of training (70%) and testing (30%). The results indicate that the area under the curve (AUC) value from receiver operating characteristic (ROC) considering the testing datasets of PSO-DLNN is 0.89, which indicates superb accuracy. The rest of the models are associated with optimal accuracy and have similar results to the PSO-DLNN model; the AUC values from ROC of DLNN, SVM, and ANN for the testing datasets are 0.87, 0.85, and 0.84, respectively. The efficiency of the proposed model in terms of prediction of GES was increased. Therefore, it can be concluded that the DLNN model and its ensemble with the PSO algorithm can be used as a novel and practical method to predict gully erosion susceptibility, which can help planners and managers to manage and reduce the risk of this phenomenon.

scholarly journals A Decomposition Model for HPLC-DAD Data Set and Its Solution by Particle Swarm Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-10
Author(s):  
Lizhi Cui ◽  
Zhihao Ling ◽  
Josiah Poon ◽  
Simon K. Poon ◽  
Junbin Gao ◽  
...  
Keyword(s):  
Particle Swarm Optimization ◽  
High Performance ◽  
Particle Swarm ◽  
Pso Algorithm ◽  
Physical Principle ◽  
Reference Curve ◽  
Optimal Parameters ◽  
General Reference ◽  
Data Set ◽  
Swarm Optimization

This paper proposes a separation method, based on the model of Generalized Reference Curve Measurement and the algorithm of Particle Swarm Optimization (GRCM-PSO), for the High Performance Liquid Chromatography with Diode Array Detection (HPLC-DAD) data set. Firstly, initial parameters are generated to construct reference curves for the chromatogram peaks of the compounds based on its physical principle. Then, a General Reference Curve Measurement (GRCM) model is designed to transform these parameters to scalar values, which indicate the fitness for all parameters. Thirdly, rough solutions are found by searching individual target for every parameter, and reinitialization only around these rough solutions is executed. Then, the Particle Swarm Optimization (PSO) algorithm is adopted to obtain the optimal parameters by minimizing the fitness of these new parameters given by the GRCM model. Finally, spectra for the compounds are estimated based on the optimal parameters and the HPLC-DAD data set. Through simulations and experiments, following conclusions are drawn: (1) the GRCM-PSO method can separate the chromatogram peaks and spectra from the HPLC-DAD data set without knowing the number of the compounds in advance even when severe overlap and white noise exist; (2) the GRCM-PSO method is able to handle the real HPLC-DAD data set.

Monopole-Gear Design Based on Neural Network and Modified Particle Swarm Optimization

2013 ◽  
Vol 477-478 ◽  
pp. 368-373 ◽  
Author(s):  
Hai Rong Fang
Keyword(s):  
Neural Network ◽  
Particle Swarm Optimization ◽  
Simulated Annealing Algorithm ◽  
Particle Swarm ◽  
Pso Algorithm ◽  
Test Results ◽  
Swarm Optimization ◽  
Modified Particle Swarm Optimization ◽  
Gear Design ◽  
Annealing Algorithm

In order to raise the design efficiency and get the most excellent design effect, this paper combined Particle Swarm Optimization (PSO) algorithm and put forward a new kind of neural network, which based on PSO algorithm, and the implementing framework of PSO and NARMA model. It gives the basic theory, steps and algorithm; The test results show that rapid global convergence and reached the lesser mean square error MSE) when compared with Genetic Algorithm, Simulated Annealing Algorithm, the BP algorithm with momentum term.

scholarly journals A Hybrid Deep Neural Network for Electricity Theft Detection Using Intelligent Antenna-Based Smart Meters

2021 ◽  
Vol 2021 ◽  
pp. 1-19
Author(s):  
Ashraf Ullah ◽  
Nadeem Javaid ◽  
Adamu Sani Yahaya ◽  
Tanzeela Sultana ◽  
Fahad Ahmad Al-Zahrani ◽  
...  
Keyword(s):  
Neural Network ◽  
Particle Swarm Optimization ◽  
Convolutional Neural Network ◽  
Deep Neural Network ◽  
Particle Swarm ◽  
Smart Meters ◽  
Swarm Optimization ◽  
Electricity Theft ◽  
Unit Model ◽  
Gated Recurrent Unit

This paper presents a hybrid model, named as hybrid deep neural network, which combines convolutional neural network, particle swarm optimization, and gated recurrent unit, termed as convolutional neural network-particle swarm optimization-gated recurrent unit model. The major aims of the model are to perform accurate electricity theft detection and to overcome the issues in the existing models. The issues include overfitting and inability of the models to handle imbalanced data. For this purpose, the electricity consumption data of smart meters is taken from state grid corporation of China. An electric utility company gathers the data from the intelligent antenna-based smart meters installed at the consumers’ end. The dataset contains real-time data with missing values and outliers. Therefore, it is first preprocessed to get the refined data followed by feature engineering for selection and extraction of the finest features from the dataset using convolutional neural network. The classification of electricity consumers is performed by dividing them into honest and fraudulent classes using the proposed particle swarm optimization-gated recurrent unit model. The proposed model is evaluated by performing simulations in terms of several performance measures that include accuracy, area under the curve, F 1 -score, recall, and precision. The comparison between the proposed hybrid deep neural network and benchmark models is also performed. The benchmark models include gated recurrent unit, long short term memory, logistic regression, support vector machine, and genetic algorithm-based gated recurrent unit. The results indicate that the proposed hybrid deep neural network model is more efficient in handling class imbalanced issues and performing electricity theft detection. The robustness, accuracy, and generalization of the model are also analyzed in the proposed work.

Sign in / Sign up

Export Citation Format

Share Document