Numerical modeling and neural networks to identify model parameters from piezocone tests: II. Multi-parameter identification from piezocone data

2011 ◽  
Vol 36 (6) ◽  
pp. 743-779 ◽  
Author(s):  
Rafał F. Obrzud ◽  
Andrzej Truty ◽  
Laurent Vulliet
Keyword(s):  
Neural Networks ◽  
Numerical Modeling ◽  
Parameter Identification ◽  
Model Parameters

scholarly journals Application of Artificial Neural Networks to Streamline the Process of Adaptive Cruise Control

2021 ◽  
Vol 13 (8) ◽  
pp. 4572
Author(s):  
Jiří David ◽  
Pavel Brom ◽  
František Starý ◽  
Josef Bradáč ◽  
Vojtěch Dynybyl
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Adaptive Cruise Control ◽  
Control Unit ◽  
Driving Safety ◽  
Model Parameters ◽  
Cruise Control ◽  
Artificial Neural ◽  
Dynamic Obstacle ◽  
Braking Process

This article deals with the use of neural networks for estimation of deceleration model parameters for the adaptive cruise control unit. The article describes the basic functionality of adaptive cruise control and creates a mathematical model of braking, which is one of the basic functions of adaptive cruise control. Furthermore, an analysis of the influences acting in the braking process is performed, the most significant of which are used in the design of deceleration prediction for the adaptive cruise control unit using neural networks. Such a connection using artificial neural networks using modern sensors can be another step towards full vehicle autonomy. The advantage of this approach is the original use of neural networks, which refines the determination of the deceleration value of the vehicle in front of a static or dynamic obstacle, while including a number of influences that affect the braking process and thus increase driving safety.

scholarly journals Trigonometric Inference Providing Learning in Deep Neural Networks

2021 ◽  
Vol 11 (15) ◽  
pp. 6704
Author(s):  
Jingyong Cai ◽  
Masashi Takemoto ◽  
Yuming Qiu ◽  
Hironori Nakajo
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Deep Neural Networks ◽  
Activation Function ◽  
Trigonometric Approximation ◽  
Model Parameters ◽  
Training Algorithms ◽  
Activation Functions ◽  
Classical Training ◽  
Sum Formula

Despite being heavily used in the training of deep neural networks (DNNs), multipliers are resource-intensive and insufficient in many different scenarios. Previous discoveries have revealed the superiority when activation functions, such as the sigmoid, are calculated by shift-and-add operations, although they fail to remove multiplications in training altogether. In this paper, we propose an innovative approach that can convert all multiplications in the forward and backward inferences of DNNs into shift-and-add operations. Because the model parameters and backpropagated errors of a large DNN model are typically clustered around zero, these values can be approximated by their sine values. Multiplications between the weights and error signals are transferred to multiplications of their sine values, which are replaceable with simpler operations with the help of the product to sum formula. In addition, a rectified sine activation function is utilized for further converting layer inputs into sine values. In this way, the original multiplication-intensive operations can be computed through simple add-and-shift operations. This trigonometric approximation method provides an efficient training and inference alternative for devices with insufficient hardware multipliers. Experimental results demonstrate that this method is able to obtain a performance close to that of classical training algorithms. The approach we propose sheds new light on future hardware customization research for machine learning.

scholarly journals Explaining Neural Networks Using Attentive Knowledge Distillation

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1280
Author(s):  
Hyeonseok Lee ◽  
Sungchan Kim
Keyword(s):  
Neural Networks ◽  
Model Prediction ◽  
Saliency Map ◽  
Model Parameters ◽  
Learning Capability ◽  
Fine Grained ◽  
Network Layers ◽  
Saliency Maps ◽  
Novel Approach ◽  
Knowledge Distillation

Explaining the prediction of deep neural networks makes the networks more understandable and trusted, leading to their use in various mission critical tasks. Recent progress in the learning capability of networks has primarily been due to the enormous number of model parameters, so that it is usually hard to interpret their operations, as opposed to classical white-box models. For this purpose, generating saliency maps is a popular approach to identify the important input features used for the model prediction. Existing explanation methods typically only use the output of the last convolution layer of the model to generate a saliency map, lacking the information included in intermediate layers. Thus, the corresponding explanations are coarse and result in limited accuracy. Although the accuracy can be improved by iteratively developing a saliency map, this is too time-consuming and is thus impractical. To address these problems, we proposed a novel approach to explain the model prediction by developing an attentive surrogate network using the knowledge distillation. The surrogate network aims to generate a fine-grained saliency map corresponding to the model prediction using meaningful regional information presented over all network layers. Experiments demonstrated that the saliency maps are the result of spatially attentive features learned from the distillation. Thus, they are useful for fine-grained classification tasks. Moreover, the proposed method runs at the rate of 24.3 frames per second, which is much faster than the existing methods by orders of magnitude.

scholarly journals Parameter Identification and State-of-Charge Estimation for Lithium-Ion Batteries Using Separated Time Scales and Extended Kalman Filter

Energies ◽  
2021 ◽  
Vol 14 (4) ◽  
pp. 1054
Author(s):  
Kuo Yang ◽  
Yugui Tang ◽  
Zhen Zhang
Keyword(s):  
Kalman Filter ◽  
Parameter Identification ◽  
Open Circuit Voltage ◽  
Lithium Ion ◽  
Open Circuit ◽  
State Of Charge ◽  
Recursive Least Squares ◽  
Model Parameters ◽  
Soc Estimation ◽  
Battery Model

With the development of new energy vehicle technology, battery management systems used to monitor the state of the battery have been widely researched. The accuracy of the battery status assessment to a great extent depends on the accuracy of the battery model parameters. This paper proposes an improved method for parameter identification and state-of-charge (SOC) estimation for lithium-ion batteries. Using a two-order equivalent circuit model, the battery model is divided into two parts based on fast dynamics and slow dynamics. The recursive least squares method is used to identify parameters of the battery, and then the SOC and the open-circuit voltage of the model is estimated with the extended Kalman filter. The two-module voltages are calculated using estimated open circuit voltage and initial parameters, and model parameters are constantly updated during iteration. The proposed method can be used to estimate the parameters and the SOC in real time, which does not need to know the state of SOC and the value of open circuit voltage in advance. The method is tested using data from dynamic stress tests, the root means squared error of the accuracy of the prediction model is about 0.01 V, and the average SOC estimation error is 0.0139. Results indicate that the method has higher accuracy in offline parameter identification and online state estimation than traditional recursive least squares methods.

An improved nonlinear innovation-based parameter identification algorithm for ship models

2021 ◽  
pp. 1-9
Author(s):  
Baigang Zhao ◽  
Xianku Zhang
Keyword(s):  
Parameter Identification ◽  
Test Data ◽  
Stochastic Gradient ◽  
Least Square ◽  
Gradient Algorithm ◽  
Model Parameters ◽  
Identification Algorithm ◽  
Process Innovations ◽  
Stochastic Gradient Algorithm ◽  
Tangent Function

Abstract To solve the problem of identifying ship model parameters quickly and accurately with the least test data, this paper proposes a nonlinear innovation parameter identification algorithm for ship models. This is based on a nonlinear arc tangent function that can process innovations on the basis of an original stochastic gradient algorithm. A simulation was carried out on the ship Yu Peng using 26 sets of test data to compare the parameter identification capability of a least square algorithm, the original stochastic gradient algorithm and the improved stochastic gradient algorithm. The results indicate that the improved algorithm enhances the accuracy of the parameter identification by about 12% when compared with the least squares algorithm. The effectiveness of the algorithm was further verified by a simulation of the ship Yu Kun. The results confirm the algorithm's capacity to rapidly produce highly accurate parameter identification on the basis of relatively small datasets. The approach can be extended to other parameter identification systems where only a small amount of test data is available.

Steel Surface Defect Detection Using an Ensemble of Deep Residual Neural Networks

2021 ◽  
pp. 1-8
Author(s):  
Ihor Konovalenko ◽  
Pavlo Maruschak ◽  
Vitaly Brevus
Keyword(s):  
Neural Networks ◽  
Steel Surface ◽  
Production Efficiency ◽  
Surface Defects ◽  
Model Parameters ◽  
Feature Maps ◽  
Defect Diagnostics ◽  
Neuron Activation ◽  
Surface Defect Detection

Abstract Steel defect diagnostics is important for industry task as it is tied to the product quality and production efficiency. The aim of this paper is evaluating the application of residual neural networks for recognition of industrial steel defects of three classes. Developed and investigated models based on deep residual neural networks for the recognition and classification of surface defects of rolled steel. Investigated the influence of various loss functions, optimizers and hyperparameters on the obtained result and selected optimal model parameters. Based on an ensemble of two deep residual neural networks ResNet50 and ResNet152, a classifier was constructed to detect defects of three classes on flat metal surfaces. The proposed technique allows classifying images with high accuracy. The average binary accuracy of classifying the test data is 96.7% for all images (including defect-free ones). The fields of neuron activation in the convolutional layers of the model were investigated. Feature maps formed in the process were found to reflect the position, size and shape of the objects of interest very well. The proposed ensemble model has proven to be robust and able to accurately recognize steel surface defects. Erroneous recognition cases of the classifier application are investigated. It was shown that errors most often occur in ambiguous situations, where surface artifacts of different types are similar.

Carbon Brake Friction Model Parameter Identification Using Genetic Algorithms

1995 ◽  
Author(s):  
Roger C. von Doenhoff ◽  
Robert J. Streifel ◽  
Robert J. Marks
Keyword(s):  
Genetic Algorithm ◽  
Genetic Algorithms ◽  
Surface Temperature ◽  
Parameter Identification ◽  
Friction Model ◽  
Carbon Surface ◽  
Model Parameters ◽  
Model Parameter ◽  
Brake Pressure ◽  
Model Parameter Identification

Abstract A model of the friction characteristics of carbon brakes is proposed to aid in the understanding of the causes of brake vibration. The model parameters are determined by a genetic algorithm in an attempt to identify differences in friction properties between brake applications during which vibration occurs and those during which there is no vibration. The model computes the brake torque as a function of wheelspeed, brake pressure, and the carbon surface temperature. The surface temperature is computed using a five node temperature model. The genetic algorithm chooses the model parameters to minimize the error between the model output and the torque measured during a dynamometer test. The basics of genetic algorithms and results of the model parameter identification process are presented.

A COMPARATIVE STUDY OF PHENOMENOLOGICAL MODELS OF MR BRAKE BASED ON NEURAL NETWORKS APPROACH

2013 ◽  
Vol 11 (01) ◽  
pp. 1350009 ◽  
Author(s):  
WITOLD PAWLUS ◽  
HAMID REZA KARIMI
Keyword(s):  
Neural Networks ◽  
Vibration Suppression ◽  
Feedforward Neural Networks ◽  
Active Suspension ◽  
Full Scale ◽  
Parameters Estimation ◽  
Model Parameters ◽  
Systems Identification ◽  
Active Vibration ◽  
Models Validation

In this paper a full-scale commercially available magnetorheological (MR) brake installed in a semi-active suspension (SAS) system is modeled and simulated. Two well-known phenomenological hysteresis models are explored: Bouc–Wen and Dahl ones. In particular, influence of their parameters on the response is evaluated and assessed. The next step is to introduce the artificial neural networks and discuss their application in the field of systems identification. Subsequently, two feedforward neural networks are created and trained to estimate parameters characterizing each of the MR damper models described. The semi-active suspension (SAS) system equipped with a MR brake is described and the detailed procedure for acquisition of the reference data used in the models validation stage is elaborated. The models outputs obtained by simulating them with the values of coefficients as identified by the networks are compared to each other as well as to the reference experimental data. Thanks to that, the comparative analysis between the suggested vibration suppression models and the full-scale MR brake is done and it is concluded which of the discussed models has a better performance. The usability of neural networks in the field of parameters estimation of the mathematical models of the real world phenomena is described as well. The novelty of the presented methodology is the application of artificial intelligence methods to estimate model parameters of a MR brake utilized in a SAS system. The results of this approach have a strong potential to be successfully implemented in the area of model-based control of semi-active vibration suppression systems.

Sign in / Sign up

Export Citation Format

Share Document