scholarly journals Multilayer Perceptron approach to Condition-Based Maintenance of Marine CODLAG Propulsion System Components

Pomorstvo ◽  
2019 ◽  
Vol 33 (2) ◽  
pp. 181-190 ◽  
Author(s):  
Ivan Lorencin ◽  
Nikola Anđelić ◽  
Vedran Mrzljak ◽  
Zlatan Car
Keyword(s):  
Relative Error ◽  
Multilayer Perceptron ◽  
Activation Function ◽  
Propulsion System ◽  
Condition Based Maintenance ◽  
Mean Relative Error ◽  
Marine Propulsion ◽  
Decay State ◽  
Using Data ◽  
Hidden Layer

In this paper multilayer perceptron (MLP) approach to condition-based maintenance of combined diesel-electric and gas (CODLAG) marine propulsion system is presented. By using data available in UCI, online machine learning repository, MLPs for prediction of gas turbine (GT) and GT compressor decay state coefficients are designed. Aforementioned MLPs are trained and tested by using 11 934 samples, of which 9 548 samples are used for training and 2 386 samples are used testing. In the case of GT decay state coefficient prediction, the lowest mean relative error of 0.622 % is achieved if MLP with one hidden layer of 50 artificial neurons (AN) designed with Tanh activation function is utilized. This configuration achieves the best results if it is trained by using L-BFGS solver. In the case of GT compressor decay state coefficient, the best results are achieved if MLP is designed with four hidden layers of 100, 50, 50 and 20 ANs, respectively. This configuration is designed by using Logistic sigmoid activation function. The lowest mean relative error of 1.094 % is achieved if MLP is trained by using L-BFGS solver.

scholarly journals Application of Artificial Neural Networks to Assess the Mycological State of Bulk Stored Rapeseeds

Agriculture ◽  
2020 ◽  
Vol 10 (11) ◽  
pp. 567
Author(s):  
Jolanta Wawrzyniak
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Control Systems ◽  
Multilayer Perceptron ◽  
Activation Function ◽  
Fungal Population ◽  
Support Tool ◽  
Artificial Neural ◽  
Hidden Layer ◽  
And Storage

Artificial neural networks (ANNs) constitute a promising modeling approach that may be used in control systems for postharvest preservation and storage processes. The study investigated the ability of multilayer perceptron and radial-basis function ANNs to predict fungal population levels in bulk stored rapeseeds with various temperatures (T = 12–30 °C) and water activity in seeds (aw = 0.75–0.90). The neural network model input included aw, temperature, and time, whilst the fungal population level was the model output. During the model construction, networks with a different number of hidden layer neurons and different configurations of activation functions in neurons of the hidden and output layers were examined. The best architecture was the multilayer perceptron ANN, in which the hyperbolic tangent function acted as an activation function in the hidden layer neurons, while the linear function was the activation function in the output layer neuron. The developed structure exhibits high prediction accuracy and high generalization capability. The model provided in the research may be readily incorporated into control systems for postharvest rapeseed preservation and storage as a support tool, which based on easily measurable on-line parameters can estimate the risk of fungal development and thus mycotoxin accumulation.

scholarly journals Use of Artificial Neural Network for Estimation of Propeller Torque Values in a CODLAG Propulsion System

2020 ◽  
Vol 58 (1) ◽  
pp. 25-38
Author(s):  
Sandi Baressi Šegota ◽  
Daniel Štifanić ◽  
Kazuhiro Ohkura ◽  
Zlatan Car
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Absolute Error ◽  
Activation Function ◽  
Propulsion System ◽  
Coefficient Of Determination ◽  
Decay State ◽  
Artificial Neural ◽  
Artificial Neural Network Ann ◽  
Torque Values

An artificial neural network (ANN) approach is proposed to the problem of estimating the propeller torques of a frigate using combined diesel, electric and gas (CODLAG) propulsion system. The authors use a multilayer perceptron (MLP) feed-forward ANN trained with data from a dataset which describes the decay state coefficients as outputs and system parameters as inputs – with a goal of determining the propeller torques, removing the decay state coefficients and using the torque values of the starboard and port propellers as outputs. A total of 53760 ANNs are trained – 26880 for each of the propellers, with a total 8960 parameter combinations. The results are evaluated using mean absolute error (MAE) and coefficient of determination (R2). Best results for the starboard propeller are MAE of 2.68 [Nm], and MAE of 2.58 [Nm] for the port propeller with following ANN configurations respectively: 2 hidden layers with 32 neurons and identity activation and 3 hidden layers with 16, 32 and 16 neurons and identity activation function. Both configurations achieve R2 value higher than 0.99.

scholarly journals Application of a multilayer perceptron artificial neural network for identification of peach cultivars based on physical characteristics

PeerJ ◽  
2021 ◽  
Vol 9 ◽  
pp. e11529
Author(s):  
Adel M. Al-Saif ◽  
Mahmoud Abdel-Sattar ◽  
Abdulwahed M. Aboukarima ◽  
Dalia H. Eshra
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Multilayer Perceptron ◽  
Activation Function ◽  
Cross Entropy ◽  
Output Layer ◽  
Entropy Error ◽  
Artificial Neural ◽  
The Cross ◽  
Hidden Layer

In the fresh fruit industry, identification of fruit cultivars and fruit quality is of vital importance. In the current study, nine peach cultivars (Dixon, Early Grande, Flordaprince, Flordastar, Flordaglo, Florda 834, TropicSnow, Desertred, and Swelling) were evaluated for differences in skin color, firmness, and size. Additionally, a multilayer perceptron (MLP) artificial neural network was applied for identification of the cultivars according to these attributes. The MLP was trained with an input layer including six input nodes, a single hidden layer with six hidden nodes, and an output layer with nine output nodes. A hyperbolic tangent activation function was used in the hidden layer and the cross entropy error was given because the softmax activation function was functional to the output layer. Results showed that the cross entropy error was 0.165. The peach identification process was significantly affected by the following variables in order of contribution (normalized importance): polar diameter (100%), L∗ (89.0), b∗ (88.0%), a∗ (78.5%), firmness (71.3%), and cross diameter (37.5.3%). The MLP was found to be a viable method of peach cultivar identification and classification because few identifying attributes were required and an overall classification accuracy of 100% was achieved in the testing phase. Measurements and quantitative discrimination of peach properties are provided in this research; these data may help enhance the processing efficiency and quality of processed peaches.

Analysis of Non-Linear Activation Functions for Classification Tasks Using Convolutional Neural Networks

2019 ◽  
Vol 12 (3) ◽  
pp. 156-161 ◽  
Author(s):  
Aman Dureja ◽  
Payal Pahwa
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
Activation Function ◽  
Primary Objective ◽  
Experimental Comparison ◽  
Activation Functions ◽  
Practical Applications ◽  
Network Activation ◽  
Non Linear ◽  
Hidden Layer

Background: In making the deep neural network, activation functions play an important role. But the choice of activation functions also affects the network in term of optimization and to retrieve the better results. Several activation functions have been introduced in machine learning for many practical applications. But which activation function should use at hidden layer of deep neural networks was not identified. Objective: The primary objective of this analysis was to describe which activation function must be used at hidden layers for deep neural networks to solve complex non-linear problems. Methods: The configuration for this comparative model was used by using the datasets of 2 classes (Cat/Dog). The number of Convolutional layer used in this network was 3 and the pooling layer was also introduced after each layer of CNN layer. The total of the dataset was divided into the two parts. The first 8000 images were mainly used for training the network and the next 2000 images were used for testing the network. Results: The experimental comparison was done by analyzing the network by taking different activation functions on each layer of CNN network. The validation error and accuracy on Cat/Dog dataset were analyzed using activation functions (ReLU, Tanh, Selu, PRelu, Elu) at number of hidden layers. Overall the Relu gave best performance with the validation loss at 25th Epoch 0.3912 and validation accuracy at 25th Epoch 0.8320. Conclusion: It is found that a CNN model with ReLU hidden layers (3 hidden layers here) gives best results and improve overall performance better in term of accuracy and speed. These advantages of ReLU in CNN at number of hidden layers are helpful to effectively and fast retrieval of images from the databases.

scholarly journals Hardware implementation of radial-basis neural networks with Gaussian activation functions on FPGA

2021 ◽  
Author(s):  
Volodymyr Shymkovych ◽  
Sergii Telenyk ◽  
Petro Kravets
Keyword(s):  
Neural Networks ◽  
Hardware Implementation ◽  
Gaussian Function ◽  
Activation Function ◽  
Rbf Neural Networks ◽  
Activation Functions ◽  
Rbf Network ◽  
Combination Scheme ◽  
Radial Basis ◽  
Hidden Layer

AbstractThis article introduces a method for realizing the Gaussian activation function of radial-basis (RBF) neural networks with their hardware implementation on field-programmable gaits area (FPGAs). The results of modeling of the Gaussian function on FPGA chips of different families have been presented. RBF neural networks of various topologies have been synthesized and investigated. The hardware component implemented by this algorithm is an RBF neural network with four neurons of the latent layer and one neuron with a sigmoid activation function on an FPGA using 16-bit numbers with a fixed point, which took 1193 logic matrix gate (LUTs—LookUpTable). Each hidden layer neuron of the RBF network is designed on an FPGA as a separate computing unit. The speed as a total delay of the combination scheme of the block RBF network was 101.579 ns. The implementation of the Gaussian activation functions of the hidden layer of the RBF network occupies 106 LUTs, and the speed of the Gaussian activation functions is 29.33 ns. The absolute error is ± 0.005. The Spartan 3 family of chips for modeling has been used to get these results. Modeling on chips of other series has been also introduced in the article. RBF neural networks of various topologies have been synthesized and investigated. Hardware implementation of RBF neural networks with such speed allows them to be used in real-time control systems for high-speed objects.

scholarly journals Modeling Spatiotemporal Population Changes by Integrating DMSP-OLS and NPP-VIIRS Nighttime Light Data in Chongqing, China

2021 ◽  
Vol 13 (2) ◽  
pp. 284
Author(s):  
Dan Lu ◽  
Yahui Wang ◽  
Qingyuan Yang ◽  
Kangchuan Su ◽  
Haozhe Zhang ◽  
...  
Keyword(s):  
Spatial Distribution ◽  
Relative Error ◽  
Urban Areas ◽  
Large Scale ◽  
Population Distribution ◽  
Spatial Optimization ◽  
Distribution Data ◽  
Mountainous Areas ◽  
Mean Relative Error ◽  
Nighttime Light

The sustained growth of non-farm wages has led to large-scale migration of rural population to cities in China, especially in mountainous areas. It is of great significance to study the spatial and temporal pattern of population migration mentioned above for guiding population spatial optimization and the effective supply of public services in the mountainous areas. Here, we determined the spatiotemporal evolution of population in the Chongqing municipality of China from 2000–2018 by employing multi-period spatial distribution data, including nighttime light (NTL) data from the Defense Meteorological Satellite Program’s Operational Linescan System (DMSP-OLS) and the Suomi National Polar-orbiting Partnership Visible Infrared Imaging Radiometer Suite (NPP-VIIRS). There was a power function relationship between the two datasets at the pixel scale, with a mean relative error of NTL integration of 8.19%, 4.78% less than achieved by a previous study at the provincial scale. The spatial simulations of population distribution achieved a mean relative error of 26.98%, improved the simulation accuracy for mountainous population by nearly 20% and confirmed the feasibility of this method in Chongqing. During the study period, the spatial distribution of Chongqing’s population has increased in the west and decreased in the east, while also increased in low-altitude areas and decreased in medium-high altitude areas. Population agglomeration was common in all of districts and counties and the population density of central urban areas and its surrounding areas significantly increased, while that of non-urban areas such as northeast Chongqing significantly decreased.

Breast cancer diagnosis using multiple activation deep neural network

2021 ◽  
pp. 1063293X2110251
Author(s):  
K Vijayakumar ◽  
Vinod J Kadam ◽  
Sudhir Kumar Sharma
Keyword(s):  
Breast Cancer ◽  
Neural Network ◽  
Deep Neural Network ◽  
Breast Cancer Diagnosis ◽  
Activation Function ◽  
Linear Functions ◽  
Cancer Data ◽  
Final Layer ◽  
Improved Performance ◽  
Hidden Layer

Deep Neural Network (DNN) stands for multilayered Neural Network (NN) that is capable of progressively learn the more abstract and composite representations of the raw features of the input data received, with no need for any feature engineering. They are advanced NNs having repetitious hidden layers between the initial input and the final layer. The working principle of such a standard deep classifier is based on a hierarchy formed by the composition of linear functions and a defined nonlinear Activation Function (AF). It remains uncertain (not clear) how the DNN classifier can function so well. But it is clear from many studies that within DNN, the AF choice has a notable impact on the kinetics of training and the success of tasks. In the past few years, different AFs have been formulated. The choice of AF is still an area of active study. Hence, in this study, a novel deep Feed forward NN model with four AFs has been proposed for breast cancer classification: hidden layer 1: Swish, hidden layer, 2:-LeakyReLU, hidden layer 3: ReLU, and final output layer: naturally Sigmoidal. The purpose of the study is twofold. Firstly, this study is a step toward a more profound understanding of DNN with layer-wise different AFs. Secondly, research is also aimed to explore better DNN-based systems to build predictive models for breast cancer data with improved accuracy. Therefore, the benchmark UCI dataset WDBC was used for the validation of the framework and evaluated using a ten-fold CV method and various performance indicators. Multiple simulations and outcomes of the experimentations have shown that the proposed solution performs in a better way than the Sigmoid, ReLU, and LeakyReLU and Swish activation DNN in terms of different parameters. This analysis contributes to producing an expert and precise clinical dataset classification method for breast cancer. Furthermore, the model also achieved improved performance compared to many established state-of-the-art algorithms/models.

scholarly journals An Artificial Intelligence Solution for Predicting Short-Term Degradation Behaviors of Proton Exchange Membrane Fuel Cell

2021 ◽  
Vol 11 (14) ◽  
pp. 6348
Author(s):  
Zijun Yang ◽  
Bowen Wang ◽  
Xia Sheng ◽  
Yupeng Wang ◽  
Qiang Ren ◽  
...  
Keyword(s):  
Fuel Cell ◽  
Proton Exchange Membrane ◽  
Pem Fuel Cell ◽  
Activation Function ◽  
Proton Exchange ◽  
Cell Performance ◽  
Short Term ◽  
Degradation Behaviors ◽  
Hidden Layer ◽  
Exchange Membrane

The dead-ended anode (DEA) and anode recirculation operations are commonly used to improve the hydrogen utilization of automotive proton exchange membrane (PEM) fuel cells. The cell performance will decline over time due to the nitrogen crossover and liquid water accumulation in the anode. Highly efficient prediction of the short-term degradation behaviors of the PEM fuel cell has great significance. In this paper, we propose a data-driven degradation prediction method based on multivariate polynomial regression (MPR) and artificial neural network (ANN). This method first predicts the initial value of cell performance, and then the cell performance variations over time are predicted to describe the degradation behaviors of the PEM fuel cell. Two cases of degradation data, the PEM fuel cell in the DEA and anode recirculation modes, are employed to train the model and demonstrate the validation of the proposed method. The results show that the mean relative errors predicted by the proposed method are much smaller than those by only using the ANN or MPR. The predictive performance of the two-hidden-layer ANN is significantly better than that of the one-hidden-layer ANN. The performance curves predicted by using the sigmoid activation function are smoother and more realistic than that by using rectified linear unit (ReLU) activation function.

scholarly journals Metamodels of a gas turbine powered marine propulsion system for simulation and diagnostic purposes

2015 ◽  
Vol 12 (1) ◽  
pp. 1-14 ◽  
Author(s):  
U. Campora ◽  
M. Capelli ◽  
C. Cravero ◽  
R. Zaccone
Keyword(s):  
Gas Turbine ◽  
Response Surfaces ◽  
Propulsion System ◽  
Direct Simulation ◽  
Analysis Method ◽  
Simulation Code ◽  
Marine Propulsion ◽  
Performance Reduction ◽  
Input Variables ◽  
Marine Propulsion System

The paper presents the application of artificial neural network for simulation and diagnostic purposes applied to a gas turbine powered marine propulsion plant. A simulation code for the propulsion system, developed by the authors, has been extended to take into account components degradation or malfunctioning with the addition of performance reduction coefficients. The above coefficients become input variables to the analysis method and define the system status at a given operating point. The simulator is used to generate databases needed to perform a variable selection analysis and to tune response surfaces for both direct (simulation) and inverse (diagnostic) purposes. The application of the methodology to the propulsion system of an existing frigate version demonstrate the potential of the approach.

Sign in / Sign up

Export Citation Format

Share Document