An Integrative Neural Network for Detecting Inertial Motion and Head Orientation

2004 ◽  
Vol 92 (2) ◽  
pp. 905-925 ◽  
Author(s):  
Andrea M. Green ◽  
Dora E. Angelaki
Keyword(s):  
Neural Network ◽  
Semicircular Canals ◽  
Head Orientation ◽  
Inertial Motion ◽  
Proposed Model ◽  
Spatial Reference Frame ◽  
Experimental Protocols ◽  
Nonlinear Vector ◽  
Physical Laws ◽  
The Brain

The ability to navigate in the world and execute appropriate behavioral responses depends critically on the contribution of the vestibular system to the detection of motion and spatial orientation. A complicating factor is that otolith afferents equivalently encode inertial and gravitational accelerations. Recent studies have demonstrated that the brain can resolve this sensory ambiguity by combining signals from both the otoliths and semicircular canal sensors, although it remains unknown how the brain integrates these sensory contributions to perform the nonlinear vector computations required to accurately detect head movement in space. Here, we illustrate how a physiologically relevant, nonlinear integrative neural network could be used to perform the required computations for inertial motion detection along the interaural head axis. The proposed model not only can simulate recent behavioral observations, including a translational vestibuloocular reflex driven by the semicircular canals, but also accounts for several previously unexplained characteristics of central neural responses such as complex otolith–canal convergence patterns and the prevalence of dynamically processed otolith signals. A key model prediction, implied by the required computations for tilt–translation discrimination, is a coordinate transformation of canal signals from a head-fixed to a spatial reference frame. As a result, cell responses may reflect canal signal contributions that cannot be easily detected or distinguished from otolith signals. New experimental protocols are proposed to characterize these cells and identify their contributions to spatial motion estimation. The proposed theoretical framework makes an essential first link between the computations for inertial acceleration detection derived from the physical laws of motion and the neural response properties predicted in a physiologically realistic network implementation.

scholarly journals Semi-Supervised Support Vector Machine for Digital Twins Based Brain Image Fusion

2021 ◽  
Vol 15 ◽  
Author(s):  
Zhibo Wan ◽  
Youqiang Dong ◽  
Zengchen Yu ◽  
Haibin Lv ◽  
Zhihan Lv
Keyword(s):  
Neural Network ◽  
Support Vector Machine ◽  
Image Fusion ◽  
Feature Recognition ◽  
Support Vector ◽  
Brain Images ◽  
Brain Image ◽  
Digital Twins ◽  
Proposed Model ◽  
The Brain

The purpose is to explore the feature recognition, diagnosis, and forecasting performances of Semi-Supervised Support Vector Machines (S3VMs) for brain image fusion Digital Twins (DTs). Both unlabeled and labeled data are used regarding many unlabeled data in brain images, and semi supervised support vector machine (SVM) is proposed. Meantime, the AlexNet model is improved, and the brain images in real space are mapped to virtual space by using digital twins. Moreover, a diagnosis and prediction model of brain image fusion digital twins based on semi supervised SVM and improved AlexNet is constructed. Magnetic Resonance Imaging (MRI) data from the Brain Tumor Department of a Hospital are collected to test the performance of the constructed model through simulation experiments. Some state-of-art models are included for performance comparison: Long Short-Term Memory (LSTM), Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), AlexNet, and Multi-Layer Perceptron (MLP). Results demonstrate that the proposed model can provide a feature recognition and extraction accuracy of 92.52%, at least an improvement of 2.76% compared to other models. Its training lasts for about 100 s, and the test takes about 0.68 s. The Root Mean Square Error (RMSE) and Mean Absolute Error (MAE) of the proposed model are 4.91 and 5.59%, respectively. Regarding the assessment indicators of brain image segmentation and fusion, the proposed model can provide a 79.55% Jaccard coefficient, a 90.43% Positive Predictive Value (PPV), a 73.09% Sensitivity, and a 75.58% Dice Similarity Coefficient (DSC), remarkably better than other models. Acceleration efficiency analysis suggests that the improved AlexNet model is suitable for processing massive brain image data with a higher speedup indicator. To sum up, the constructed model can provide high accuracy, good acceleration efficiency, and excellent segmentation and recognition performances while ensuring low errors, which can provide an experimental basis for brain image feature recognition and digital diagnosis.

scholarly journals An Efficient Methodology for Brain MRI Classification Based on DWT and Convolutional Neural Network

Sensors ◽  
2021 ◽  
Vol 21 (22) ◽  
pp. 7480
Author(s):  
Muhammad Fayaz ◽  
Nurlan Torokeldiev ◽  
Samat Turdumamatov ◽  
Muhammad Shuaib Qureshi ◽  
Muhammad Bilal Qureshi ◽  
...  
Keyword(s):  
Neural Network ◽  
Performance Evaluation ◽  
Wavelet Transform ◽  
Convolutional Neural Network ◽  
Discrete Wavelet Transform ◽  
Median Filter ◽  
Brain Mri ◽  
Discrete Wavelet ◽  
Proposed Model ◽  
The Brain

In this paper, a model based on discrete wavelet transform and convolutional neural network for brain MR image classification has been proposed. The proposed model is comprised of three main stages, namely preprocessing, feature extraction, and classification. In the preprocessing, the median filter has been applied to remove salt-and-pepper noise from the brain MRI images. In the discrete wavelet transform, discrete Harr wavelet transform has been used. In the proposed model, 3-level Harr wavelet decomposition has been applied on the images to remove low-level detail and reduce the size of the images. Next, the convolutional neural network has been used for classifying the brain MR images into normal and abnormal. The convolutional neural network is also a prevalent classification method and has been widely used in different areas. In this study, the convolutional neural network has been used for brain MRI classification. The proposed methodology has been applied to the standard dataset, and for performance evaluation, we have used different performance evaluation measures. The results indicate that the proposed method provides good results with 99% accuracy. The proposed method results are then presented for comparison with some state-of-the-art algorithms where simply the proposed method outperforms the counterpart algorithms. The proposed model has been developed to be used for practical applications.

scholarly journals Brain Tumor identification by Convolution Neural Network with Fuzzy C-mean Model Using MR Brain Images

2021 ◽  
Vol 14 ◽  
pp. 1096-1102
Author(s):  
Abd El Kader Isselmou ◽  
Guizhi Xu ◽  
Zhang Shuai ◽  
Sani Saminu ◽  
Imran Javaid ◽  
...  
Keyword(s):  
Neural Network ◽  
Brain Tumor ◽  
Convolution Neural Network ◽  
Brain Images ◽  
Proposed Model ◽  
Tumor Identification ◽  
Mr Brain Images ◽  
Sensitivity Specificity ◽  
The Brain ◽  
Mr Brain

Medical image computing techniques are essential in helping the doctors to support their decision in the diagnosis of the patients. Due to the complexity of the brain structure, we choose to use MR brain images because of their quality and the highest resolution. The objective of this article is to detect brain tumor using convolution neural network with fuzzy c-means model, the advantage of the proposed model is the ability to achieve excellent performance using accuracy, sensitivity, specificity, overall dice and recall values better than the previous models that are already published. In addition, the novel model can identify the brain tumor, using different types of MR images. The proposed model obtained accuracy with 98%.

scholarly journals Nodule Detection with Convolutional Neural Network Using Apache Spark and GPU Frameworks

2021 ◽  
Vol 11 (6) ◽  
pp. 2838
Author(s):  
Nikitha Johnsirani Venkatesan ◽  
Dong Ryeol Shin ◽  
Choon Sung Nam
Keyword(s):  
Neural Network ◽  
Radiation Dose ◽  
Convolutional Neural Network ◽  
Model Performance ◽  
Performance Comparison ◽  
Apache Spark ◽  
Training Time ◽  
Learning Framework ◽  
Proposed Model

In the pharmaceutical field, early detection of lung nodules is indispensable for increasing patient survival. We can enhance the quality of the medical images by intensifying the radiation dose. High radiation dose provokes cancer, which forces experts to use limited radiation. Using abrupt radiation generates noise in CT scans. We propose an optimal Convolutional Neural Network model in which Gaussian noise is removed for better classification and increased training accuracy. Experimental demonstration on the LUNA16 dataset of size 160 GB shows that our proposed method exhibit superior results. Classification accuracy, specificity, sensitivity, Precision, Recall, F1 measurement, and area under the ROC curve (AUC) of the model performance are taken as evaluation metrics. We conducted a performance comparison of our proposed model on numerous platforms, like Apache Spark, GPU, and CPU, to depreciate the training time without compromising the accuracy percentage. Our results show that Apache Spark, integrated with a deep learning framework, is suitable for parallel training computation with high accuracy.

scholarly journals Natural Disasters Intensity Analysis and Classification Based on Multispectral Images Using Multi-Layered Deep Convolutional Neural Network

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2648
Author(s):  
Muhammad Aamir ◽  
Tariq Ali ◽  
Muhammad Irfan ◽  
Ahmad Shaf ◽  
Muhammad Zeeshan Azam ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Natural Disasters ◽  
Deep Convolutional Neural Network ◽  
Multispectral Images ◽  
Learning Techniques ◽  
Proposed Model ◽  
Disaster Intensity ◽  
And Performance

Natural disasters not only disturb the human ecological system but also destroy the properties and critical infrastructures of human societies and even lead to permanent change in the ecosystem. Disaster can be caused by naturally occurring events such as earthquakes, cyclones, floods, and wildfires. Many deep learning techniques have been applied by various researchers to detect and classify natural disasters to overcome losses in ecosystems, but detection of natural disasters still faces issues due to the complex and imbalanced structures of images. To tackle this problem, we propose a multilayered deep convolutional neural network. The proposed model works in two blocks: Block-I convolutional neural network (B-I CNN), for detection and occurrence of disasters, and Block-II convolutional neural network (B-II CNN), for classification of natural disaster intensity types with different filters and parameters. The model is tested on 4428 natural images and performance is calculated and expressed as different statistical values: sensitivity (SE), 97.54%; specificity (SP), 98.22%; accuracy rate (AR), 99.92%; precision (PRE), 97.79%; and F1-score (F1), 97.97%. The overall accuracy for the whole model is 99.92%, which is competitive and comparable with state-of-the-art algorithms.

scholarly journals Predicting the Energy Consumption of a Robot in an Exploration Task Using Optimized Neural Networks

Electronics ◽  
2021 ◽  
Vol 10 (8) ◽  
pp. 920
Author(s):  
Liesle Caballero ◽  
Álvaro Perafan ◽  
Martha Rinaldy ◽  
Winston Percybrooks
Keyword(s):  
Neural Network ◽  
Energy Consumption ◽  
Mobile Robot ◽  
Energy Budget ◽  
Dynamic Models ◽  
Pearson Correlation ◽  
Experimental Conditions ◽  
Grid Map ◽  
Proposed Model ◽  
Exploration Task

This paper deals with the problem of determining a useful energy budget for a mobile robot in a given environment without having to carry out experimental measures for every possible exploration task. The proposed solution uses machine learning models trained on a subset of possible exploration tasks but able to make predictions on untested scenarios. Additionally, the proposed model does not use any kinematic or dynamic models of the robot, which are not always available. The method is based on a neural network with hyperparameter optimization to improve performance. Tabu List optimization strategy is used to determine the hyperparameter values (number of layers and number of neurons per layer) that minimize the percentage relative absolute error (%RAE) while maximize the Pearson correlation coefficient (R) between predicted data and actual data measured under a number of experimental conditions. Once the optimized artificial neural network is trained, it can be used to predict the performance of an exploration algorithm on arbitrary variations of a grid map scenario. Based on such prediction, it is possible to know the energy needed for the robot to complete the exploration task. A total of 128 tests were carried out using a robot executing two exploration algorithms in a grid map with the objective of locating a target whose location is not known a priori by the robot. The experimental energy consumption was measured and compared with the prediction of our model. A success rate of 96.093% was obtained, measured as the percentage of tests where the energy budget suggested by the model was enough to actually carry out the task when compared to the actual energy consumed in the test, suggesting that the proposed model could be useful for energy budgeting in actual mobile robot applications.

scholarly journals Tomato Leaf Disease Diagnosis Based on Improved Convolution Neural Network by Attention Module

Agriculture ◽  
2021 ◽  
Vol 11 (7) ◽  
pp. 651
Author(s):  
Shengyi Zhao ◽  
Yun Peng ◽  
Jizhan Liu ◽  
Shuo Wu
Keyword(s):  
Neural Network ◽  
High Performance ◽  
Model Comparison ◽  
Research Direction ◽  
Disease Diagnosis ◽  
Tomato Leaf ◽  
Identification Accuracy ◽  
Main Research ◽  
Proposed Model ◽  
Complex Features

Crop disease diagnosis is of great significance to crop yield and agricultural production. Deep learning methods have become the main research direction to solve the diagnosis of crop diseases. This paper proposed a deep convolutional neural network that integrates an attention mechanism, which can better adapt to the diagnosis of a variety of tomato leaf diseases. The network structure mainly includes residual blocks and attention extraction modules. The model can accurately extract complex features of various diseases. Extensive comparative experiment results show that the proposed model achieves the average identification accuracy of 96.81% on the tomato leaf diseases dataset. It proves that the model has significant advantages in terms of network complexity and real-time performance compared with other models. Moreover, through the model comparison experiment on the grape leaf diseases public dataset, the proposed model also achieves better results, and the average identification accuracy of 99.24%. It is certified that add the attention module can more accurately extract the complex features of a variety of diseases and has fewer parameters. The proposed model provides a high-performance solution for crop diagnosis under the real agricultural environment.

scholarly journals Recurrent neural networks with long term temporal dependencies in machine tool wear diagnosis and prognosis

2021 ◽  
Vol 3 (4) ◽  
Author(s):  
Jianlei Zhang ◽  
Yukun Zeng ◽  
Binil Starly
Keyword(s):  
Neural Network ◽  
Tool Wear ◽  
Machine Tool ◽  
Recurrent Neural Network ◽  
Machine Tools ◽  
Prediction Performance ◽  
Sequential Data ◽  
Diagnosis And Prognosis ◽  
Proposed Model

AbstractData-driven approaches for machine tool wear diagnosis and prognosis are gaining attention in the past few years. The goal of our study is to advance the adaptability, flexibility, prediction performance, and prediction horizon for online monitoring and prediction. This paper proposes the use of a recent deep learning method, based on Gated Recurrent Neural Network architecture, including Long Short Term Memory (LSTM), which try to captures long-term dependencies than regular Recurrent Neural Network method for modeling sequential data, and also the mechanism to realize the online diagnosis and prognosis and remaining useful life (RUL) prediction with indirect measurement collected during the manufacturing process. Existing models are usually tool-specific and can hardly be generalized to other scenarios such as for different tools or operating environments. Different from current methods, the proposed model requires no prior knowledge about the system and thus can be generalized to different scenarios and machine tools. With inherent memory units, the proposed model can also capture long-term dependencies while learning from sequential data such as those collected by condition monitoring sensors, which means it can be accommodated to machine tools with varying life and increase the prediction performance. To prove the validity of the proposed approach, we conducted multiple experiments on a milling machine cutting tool and applied the model for online diagnosis and RUL prediction. Without loss of generality, we incorporate a system transition function and system observation function into the neural net and trained it with signal data from a minimally intrusive vibration sensor. The experiment results showed that our LSTM-based model achieved the best overall accuracy among other methods, with a minimal Mean Square Error (MSE) for tool wear prediction and RUL prediction respectively.

Sentence similarity evaluation using Sent2Vec and siamese neural network with parallel structure

2021 ◽  
pp. 1-10
Author(s):  
Hye-Jeong Song ◽  
Tak-Sung Heo ◽  
Jong-Dae Kim ◽  
Chan-Young Park ◽  
Yu-Seop Kim
Keyword(s):  
Neural Network ◽  
Language Processing ◽  
Short Term Memory ◽  
Parallel Structure ◽  
Short Term ◽  
Similarity Estimation ◽  
Accurate Judgment ◽  
Proposed Model ◽  
Sentence Similarity ◽  
Long Short Term Memory

Sentence similarity evaluation is a significant task used in machine translation, classification, and information extraction in the field of natural language processing. When two sentences are given, an accurate judgment should be made whether the meaning of the sentences is equivalent even if the words and contexts of the sentences are different. To this end, existing studies have measured the similarity of sentences by focusing on the analysis of words, morphemes, and letters. To measure sentence similarity, this study uses Sent2Vec, a sentence embedding, as well as morpheme word embedding. Vectors representing words are input to the 1-dimension convolutional neural network (1D-CNN) with various sizes of kernels and bidirectional long short-term memory (Bi-LSTM). Self-attention is applied to the features transformed through Bi-LSTM. Subsequently, vectors undergoing 1D-CNN and self-attention are converted through global max pooling and global average pooling to extract specific values, respectively. The vectors generated through the above process are concatenated to the vector generated through Sent2Vec and are represented as a single vector. The vector is input to softmax layer, and finally, the similarity between the two sentences is determined. The proposed model can improve the accuracy by up to 5.42% point compared with the conventional sentence similarity estimation models.

scholarly journals A Two Joint Neck Model to Identify Malposition of the Head Relative to the Thorax

Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3297
Author(s):  
Philipp M. Schmid ◽  
Christoph M. Bauer ◽  
Markus J. Ernst ◽  
Bettina Sommer ◽  
Lars Lünenburger ◽  
...  
Keyword(s):  
Neck Pain ◽  
Body Height ◽  
Biomechanical Model ◽  
The Body ◽  
Head Orientation ◽  
Neck Length ◽  
Proposed Model ◽  
Biofeedback System ◽  
Simple Measurement ◽  
The Impact

Neck pain is a frequent health complaint. Prolonged protracted malpositions of the head are associated with neck pain and headaches and could be prevented using biofeedback systems. A practical biofeedback system to detect malpositions should be realized with a simple measurement setup. To achieve this, a simple biomechanical model representing head orientation and translation relative to the thorax is introduced. To identify the parameters of this model, anthropometric data were acquired from eight healthy volunteers. In this work we determine (i) the accuracy of the proposed model when the neck length is known, (ii) the dependency of the neck length on the body height, and (iii) the impact of a wrong neck length on the models accuracy. The resulting model is able to describe the motion of the head with a maximum uncertainty of 5 mm only. To achieve this high accuracy the effective neck length must be known a priory. If however, this parameter is assumed to be a linear function of the palpable neck length, the measurement error increases. Still, the resulting accuracy can be sufficient to identify and monitor a protracted malposition of the head relative to the thorax.

Sign in / Sign up

Export Citation Format

Share Document