scholarly journals Improving Performance of Seismic Fault Detection by Fine-Tuning the Convolutional Neural Network Pre-Trained with Synthetic Samples

Energies ◽  
2021 ◽  
Vol 14 (12) ◽  
pp. 3650
Author(s):  
Zhe Yan ◽  
Zheng Zhang ◽  
Shaoyong Liu
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Fault Detection ◽  
Seismic Data ◽  
Learning Strategy ◽  
Real Data ◽  
Fine Tuning ◽  
Detection Methods ◽  
Training Dataset ◽  
Detection Accuracy

Fault interpretation is an important part of seismic structural interpretation and reservoir characterization. In the conventional approach, faults are detected as reflection discontinuity or abruption and are manually tracked in post-stack seismic data, which is time-consuming. In order to improve efficiency, a variety of automatic fault detection methods have been proposed, among which widespread attention has been given to deep learning-based methods. However, deep learning techniques require a large amount of marked seismic samples as a training dataset. Although the amount of synthetic seismic data can be guaranteed and the labels are accurate, the difference between synthetic data and real data still exists. To overcome this drawback, we apply a transfer learning strategy to improve the performance of automatic fault detection by deep learning methods. We first pre-train a deep neural network with synthetic seismic data. Then we retrain the network with real seismic samples. We use a random sample consensus (RANSAC) method to obtain real seismic samples and generate corresponding labels automatically. Three real 3D examples are included to demonstrate that the fault detection accuracy of the pre-trained network models can be greatly improved by retraining the network with a few amount of real seismic samples.

scholarly journals Automatic Handgun Detection with Deep Learning in Video Surveillance Images

2021 ◽  
Vol 11 (13) ◽  
pp. 6085
Author(s):  
Jesus Salido ◽  
Vanesa Lomas ◽  
Jesus Ruiz-Santaquiteria ◽  
Oscar Deniz
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Video Surveillance ◽  
Automatic Detection ◽  
Public Spaces ◽  
Detection Methods ◽  
Training Dataset ◽  
Average Precision ◽  
Terrorist Acts

There is a great need to implement preventive mechanisms against shootings and terrorist acts in public spaces with a large influx of people. While surveillance cameras have become common, the need for monitoring 24/7 and real-time response requires automatic detection methods. This paper presents a study based on three convolutional neural network (CNN) models applied to the automatic detection of handguns in video surveillance images. It aims to investigate the reduction of false positives by including pose information associated with the way the handguns are held in the images belonging to the training dataset. The results highlighted the best average precision (96.36%) and recall (97.23%) obtained by RetinaNet fine-tuned with the unfrozen ResNet-50 backbone and the best precision (96.23%) and F1 score values (93.36%) obtained by YOLOv3 when it was trained on the dataset including pose information. This last architecture was the only one that showed a consistent improvement—around 2%—when pose information was expressly considered during training.

scholarly journals Covid-19 detection via deep neural network and occlusion sensitivity maps

2021 ◽  
Author(s):  
Noor Ahmad ◽  
Muhammad Aminu ◽  
Mohd Halim Mohd Noor
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Deep Neural Network ◽  
State Of The Art ◽  
Color Images ◽  
Fine Tuning ◽  
Training Dataset ◽  
Learning Approaches ◽  
Learning Models ◽  
Sensitivity Maps

Deep learning approaches have attracted a lot of attention in the automatic detection of Covid-19 and transfer learning is the most common approach. However, majority of the pre-trained models are trained on color images, which can cause inefficiencies when fine-tuning the models on Covid-19 images which are often grayscale. To address this issue, we propose a deep learning architecture called CovidNet which requires a relatively smaller number of parameters. CovidNet accepts grayscale images as inputs and is suitable for training with limited training dataset. Experimental results show that CovidNet outperforms other state-of-the-art deep learning models for Covid-19 detection.

scholarly journals A Deep Learning-Based Approach for the Detection of Early Signs of Gingivitis in Orthodontic Patients Using Faster Region-Based Convolutional Neural Networks

2020 ◽  
Vol 17 (22) ◽  
pp. 8447
Author(s):  
Dima M. Alalharith ◽  
Hajar M. Alharthi ◽  
Wejdan M. Alghamdi ◽  
Yasmine M. Alsenbel ◽  
Nida Aslam ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Periodontal Disease ◽  
Convolutional Neural Network ◽  
Region Of Interest ◽  
Training Dataset ◽  
Detection Accuracy ◽  
Detection Model ◽  
Art Object ◽  
Orthodontic Patients

Computer-based technologies play a central role in the dentistry field, as they present many methods for diagnosing and detecting various diseases, such as periodontitis. The current study aimed to develop and evaluate the state-of-the-art object detection and recognition techniques and deep learning algorithms for the automatic detection of periodontal disease in orthodontic patients using intraoral images. In this study, a total of 134 intraoral images were divided into a training dataset (n = 107 [80%]) and a test dataset (n = 27 [20%]). Two Faster Region-based Convolutional Neural Network (R-CNN) models using ResNet-50 Convolutional Neural Network (CNN) were developed. The first model detects the teeth to locate the region of interest (ROI), while the second model detects gingival inflammation. The detection accuracy, precision, recall, and mean average precision (mAP) were calculated to verify the significance of the proposed model. The teeth detection model achieved an accuracy, precision, recall, and mAP of 100 %, 100%, 51.85%, and 100%, respectively. The inflammation detection model achieved an accuracy, precision, recall, and mAP of 77.12%, 88.02%, 41.75%, and 68.19%, respectively. This study proved the viability of deep learning models for the detection and diagnosis of gingivitis in intraoral images. Hence, this highlights its potential usability in the field of dentistry and aiding in reducing the severity of periodontal disease globally through preemptive non-invasive diagnosis.

scholarly journals A Sparse Spike Deconvolution Algorithm Based on a Recurrent Neural Network and the Iterative Shrinkage-Thresholding Algorithm

Energies ◽  
2020 ◽  
Vol 13 (12) ◽  
pp. 3074 ◽  
Author(s):  
Shulin Pan ◽  
Ke Yan ◽  
Haiqiang Lan ◽  
José Badal ◽  
Ziyu Qin
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Seismic Data ◽  
Real Data ◽  
Training Dataset ◽  
Reflection Coefficients ◽  
Deconvolution Algorithm ◽  
Iterative Shrinkage ◽  
Thresholding Algorithm ◽  
Iterative Shrinkage Thresholding

Conventional sparse spike deconvolution algorithms that are based on the iterative shrinkage-thresholding algorithm (ISTA) are widely used. The aim of this type of algorithm is to obtain accurate seismic wavelets. When this is not fulfilled, the processing stops being optimum. Using a recurrent neural network (RNN) as deep learning method and applying backpropagation to ISTA, we have developed an RNN-like ISTA as an alternative sparse spike deconvolution algorithm. The algorithm is tested with both synthetic and real seismic data. The algorithm first builds a training dataset from existing well-logs seismic data and then extracts wavelets from those seismic data for further processing. Based on the extracted wavelets, the new method uses ISTA to calculate the reflection coefficients. Next, inspired by the backpropagation through time (BPTT) algorithm, backward error correction is performed on the wavelets while using the errors between the calculated reflection coefficients and the reflection coefficients corresponding to the training dataset. Finally, after performing backward correction over multiple iterations, a set of acceptable seismic wavelets is obtained, which is then used to deduce the sequence of reflection coefficients of the real data. The new algorithm improves the accuracy of the deconvolution results by reducing the effect of wrong seismic wavelets that are given by conventional ISTA. In this study, we account for the mechanism and the derivation of the proposed algorithm, and verify its effectiveness through experimentation using theoretical and real data.

scholarly journals Covid-19 detection via deep neural network and occlusion sensitivity maps

2021 ◽  
Author(s):  
Noor Ahmad ◽  
Muhammad Aminu ◽  
Mohd Halim Mohd Noor
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Deep Neural Network ◽  
State Of The Art ◽  
Color Images ◽  
Fine Tuning ◽  
Training Dataset ◽  
Learning Approaches ◽  
Learning Models ◽  
Sensitivity Maps

Deep learning approaches have attracted a lot of attention in the automatic detection of Covid-19 and transfer learning is the most common approach. However, majority of the pre-trained models are trained on color images, which can cause inefficiencies when fine-tuning the models on Covid-19 images which are often grayscale. To address this issue, we propose a deep learning architecture called CovidNet which requires a relatively smaller number of parameters. CovidNet accepts grayscale images as inputs and is suitable for training with limited training dataset. Experimental results show that CovidNet outperforms other state-of-the-art deep learning models for Covid-19 detection.

scholarly journals Automatic Detection of Display Defects for Smart Meters based on Deep Learning

2021 ◽  
Vol 28 (4) ◽  
pp. 241-254
Author(s):  
Ye Chen ◽  
Zhihu Hong ◽  
Yaohua Liao ◽  
Mengmeng Zhu ◽  
Tong Han ◽  
...  
Keyword(s):  
Deep Learning ◽  
Fault Detection ◽  
Defect Detection ◽  
Automatic Detection ◽  
Detection Task ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Smart Meter ◽  
Smart Meters ◽  
The Common

The smart meter is an essential part of an intelligent grid system. Defects in the LCD screen the smart meters affect their use. Therefore, detection of LCD screen defects of smart meters is of great significance for management and use of smart electricity meters. At present, detection methods are mainly realized by manual detection and automatic detection based on machine vision. However, performance of these two methods is not satisfactory. The fault detection task of a smart meter LCD screen can be divided into two parts: smart meter LCD localization and LCD fault detection. Therefore, this paper proposes a twostage system based on deep learning, which combines YOLOv5 with ResNet34. YOLOv5 is used for smart meter LCD localization and the classification network based on ResNet34 for LCD fault detection. We have constructed an LCD screen localization dataset and an LCD screen defect detection dataset to train and test our model. As a result, our model achieves a defect detection accuracy of 98.9% on the dataset proposed in this paper and can accurately detect the common defects of an LCD screen.

Fault Detection Method of Power Insulator Based on Deep Convolution Neural Network

2021 ◽  
Author(s):  
Yan Wang ◽  
Weijie Zhang
Keyword(s):  
Neural Network ◽  
Fault Detection ◽  
Detection Method ◽  
Convolution Neural Network ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Region Selection ◽  
Function Design ◽  
Deep Convolution Neural Network ◽  
Anchor Design

Aiming at the problem of low detection accuracy of traditional power insulator fault detection methods, a power insulator fault detection method based on deep convolution neural network is designed. For the training of deep convolution neural network, the fault detection of power insulator based on deep convolution neural network is realized by anchor design, loss function design, candidate region selection mechanism establishment and sharing convolution features. The experimental results show that the fault detection method of power insulator based on deep convolution neural network is more accurate than the traditional method, and the detection time is less.

De-aliased seismic data interpolation using a deep learning-based prediction-error filter

Geophysics ◽  
2021 ◽  
pp. 1-63
Author(s):  
Wenqian Fang ◽  
Lihua Fu ◽  
Shaoyong Liu ◽  
Hongwei Li
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Seismic Data ◽  
Prediction Error ◽  
Training Data ◽  
Training Dataset ◽  
Data Interpolation ◽  
Filter Methods ◽  
The Neural Network ◽  
Trained Network

Deep learning (DL) technology has emerged as a new approach for seismic data interpolation. DL-based methods can automatically learn the mapping between regularly subsampled and complete data from a large training dataset. Subsequently, the trained network can be used to directly interpolate new data. Therefore, compared with traditional methods, DL-based methods reduce the manual workload and render the interpolation process efficient and automatic by avoiding the selection of hyperparameters. However, two limitations of DL-based approaches exist. First, the generalization performance of the neural network is inadequate when processing new data with a different structure compared to the training data. Second, the interpretation of the trained networks is very difficult. To overcome these limitations, we combine the deep neural network and classic prediction-error filter methods, proposing a novel seismic data de-aliased interpolation framework termed PEFNet (Prediction-Error Filters Network). The PEFNet designs convolutional neural networks to learn the relationship between the subsampled data and the prediction-error filters. Thus, the filters estimated by the trained network are used for the recovery of missing traces. The learning of filters enables the network to better extract the local dip of seismic data and has a good generalization ability. In addition, PEFNet has the same interpretability as traditional prediction error-filter based methods. The applicability and the effectiveness of the proposed method are demonstrated here by synthetic and field data examples.

scholarly journals Effectiveness of transfer learning for enhancing tumor classification with a convolutional neural network on frozen sections

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Young-Gon Kim ◽  
Sungchul Kim ◽  
Cristina Eunbee Cho ◽  
In Hye Song ◽  
Hee Jin Lee ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Frozen Section ◽  
Medical Center ◽  
External Validation ◽  
Model Performance ◽  
Classification Model ◽  
Training Dataset

AbstractFast and accurate confirmation of metastasis on the frozen tissue section of intraoperative sentinel lymph node biopsy is an essential tool for critical surgical decisions. However, accurate diagnosis by pathologists is difficult within the time limitations. Training a robust and accurate deep learning model is also difficult owing to the limited number of frozen datasets with high quality labels. To overcome these issues, we validated the effectiveness of transfer learning from CAMELYON16 to improve performance of the convolutional neural network (CNN)-based classification model on our frozen dataset (N = 297) from Asan Medical Center (AMC). Among the 297 whole slide images (WSIs), 157 and 40 WSIs were used to train deep learning models with different dataset ratios at 2, 4, 8, 20, 40, and 100%. The remaining, i.e., 100 WSIs, were used to validate model performance in terms of patch- and slide-level classification. An additional 228 WSIs from Seoul National University Bundang Hospital (SNUBH) were used as an external validation. Three initial weights, i.e., scratch-based (random initialization), ImageNet-based, and CAMELYON16-based models were used to validate their effectiveness in external validation. In the patch-level classification results on the AMC dataset, CAMELYON16-based models trained with a small dataset (up to 40%, i.e., 62 WSIs) showed a significantly higher area under the curve (AUC) of 0.929 than those of the scratch- and ImageNet-based models at 0.897 and 0.919, respectively, while CAMELYON16-based and ImageNet-based models trained with 100% of the training dataset showed comparable AUCs at 0.944 and 0.943, respectively. For the external validation, CAMELYON16-based models showed higher AUCs than those of the scratch- and ImageNet-based models. Model performance for slide feasibility of the transfer learning to enhance model performance was validated in the case of frozen section datasets with limited numbers.

Sign in / Sign up

Export Citation Format

Share Document