Scale Buildup Detection and Characterization in Production Wells by Deep Learning Methods

2021 ◽  
Author(s):  
Jingru Cheng ◽  
Deming Mao ◽  
Majid Salamah ◽  
Roland Horne
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Three Dimensional ◽  
High Sensitivity ◽  
Segment Length ◽  
Learning Methods ◽  
Model Combining ◽  
Well Data ◽  
Fully Connected ◽  
Scale Deposition

Abstract This study developed an analytical tool for the detection and characterization of scale buildup from well data using deep learning methods. The developed method allows for a sensitive detection of the initiation of scaling as well as an accurate prediction of the magnitude of existing scale buildup. Scale deposition causes tubing ID decreases and therefore results in production declines, so a sensitive approach to detect the scale deposition is valuable to reduce the damage and losses due to this problem. The underlying deep learning methods are both single- and multioutput, deep neural networks that consist of a combination of convolutional, long short-term memory (LSTM) and fully connected layers. We trained the networks on more than 30 sets of well data, with the objective of predicting the presence and the magnitude of scale. We started with cases of full scale deposition over the whole wellbore depth, and then extended our study to partial depth scale deposition. We built up a point-wise neural network model combining two blocks, which each contain several fully-connected layers followed by an LSTM layer specifically focusing on relatively smaller or larger tubing ID changes, corresponding to more or less scale deposition. To characterize the segmented scale deposition, we transformed to a three-dimensional problem, which can be solved by extracting the tubing ID changes and the scale deposition segment length. The multioutput model was able to predict the tubing ID and volume changes at the same time, using a combination of convolutional and LSTM layers with residual network blocks and updated using a loss function that we defined. Tubing ID changes were extracted accurately with metric R-square more than 90%, while the length of the scale deposit could be classified into two classes (high scaling or low scaling) with good accuracy. Though existing physical and chemical methods can be used to analyze scale deposition, the methods are often applied after considerable production decrease has already occurred. By using deep learning algorithms, our study came up with a new way to predict the scaling problem in advance with high sensitivity.

scholarly journals A deep learning based approach for prediction of Chlamydomonas reinhardtii phosphorylation sites

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Niraj Thapa ◽  
Meenal Chaudhari ◽  
Anthony A. Iannetta ◽  
Clarence White ◽  
Kaushik Roy ◽  
...  
Keyword(s):  
Deep Learning ◽  
Chlamydomonas Reinhardtii ◽  
Protein Phosphorylation ◽  
Short Term Memory ◽  
Phosphorylation Site ◽  
Specific Protein ◽  
Training Dataset ◽  
Phosphorylation Sites ◽  
Site Prediction ◽  
Model Combining

AbstractProtein phosphorylation, which is one of the most important post-translational modifications (PTMs), is involved in regulating myriad cellular processes. Herein, we present a novel deep learning based approach for organism-specific protein phosphorylation site prediction in Chlamydomonas reinhardtii, a model algal phototroph. An ensemble model combining convolutional neural networks and long short-term memory (LSTM) achieves the best performance in predicting phosphorylation sites in C. reinhardtii. Deemed Chlamy-EnPhosSite, the measured best AUC and MCC are 0.90 and 0.64 respectively for a combined dataset of serine (S) and threonine (T) in independent testing higher than those measures for other predictors. When applied to the entire C. reinhardtii proteome (totaling 1,809,304 S and T sites), Chlamy-EnPhosSite yielded 499,411 phosphorylated sites with a cut-off value of 0.5 and 237,949 phosphorylated sites with a cut-off value of 0.7. These predictions were compared to an experimental dataset of phosphosites identified by liquid chromatography-tandem mass spectrometry (LC–MS/MS) in a blinded study and approximately 89.69% of 2,663 C. reinhardtii S and T phosphorylation sites were successfully predicted by Chlamy-EnPhosSite at a probability cut-off of 0.5 and 76.83% of sites were successfully identified at a more stringent 0.7 cut-off. Interestingly, Chlamy-EnPhosSite also successfully predicted experimentally confirmed phosphorylation sites in a protein sequence (e.g., RPS6 S245) which did not appear in the training dataset, highlighting prediction accuracy and the power of leveraging predictions to identify biologically relevant PTM sites. These results demonstrate that our method represents a robust and complementary technique for high-throughput phosphorylation site prediction in C. reinhardtii. It has potential to serve as a useful tool to the community. Chlamy-EnPhosSite will contribute to the understanding of how protein phosphorylation influences various biological processes in this important model microalga.

scholarly journals Indicator Selection for Topic Popularity Definition Based on AHP and Deep Learning Models

2020 ◽  
Vol 2020 ◽  
pp. 1-11 ◽  
Author(s):  
Yuling Hong ◽  
Qishan Zhang
Keyword(s):  
Deep Learning ◽  
Social Network ◽  
Evaluation Method ◽  
Short Term Memory ◽  
Selection Model ◽  
Learning Technology ◽  
Prevention Measures ◽  
Learning Methods ◽  
Indicator Selection ◽  
The Social

Purpose. The purpose of this article is to predict the topic popularity on the social network accurately. Indicator selection model for a new definition of topic popularity with degree of grey incidence (DGI) is undertook based on an improved analytic hierarchy process (AHP). Design/Methodology/Approach. Through screening the importance of indicators by the deep learning methods such as recurrent neural networks (RNNs), long short-term memory (LSTM), and gated recurrent unit (GRU), a selection model of topic popularity indicators based on AHP is set up. Findings. The results show that when topic popularity is being built quantitatively based on the DGI method and different weights of topic indicators are obtained from the help of AHP, the average accuracy of topic popularity prediction can reach 97.66%. The training speed is higher and the prediction precision is higher. Practical Implications. The method proposed in the paper can be used to calculate the popularity of each hot topic and generate the ranking list of topics’ popularities. Moreover, its future popularity can be predicted by deep learning methods. At the same time, a new application field of deep learning technology has been further discovered and verified. Originality/Value. This can lay a theoretical foundation for the formulation of topic popularity tendency prevention measures on the social network and provide an evaluation method which is consistent with the actual situation.

scholarly journals Comparative analysis of Kernel-based versus BFGS-ANN and deep learning methods in monthly reference evaporation estimation

2020 ◽  
Author(s):  
Mohammad Taghi Sattari ◽  
Halit Apaydin ◽  
Shahab Shamshirband ◽  
Amir Mosavi
Keyword(s):  
Deep Learning ◽  
Minimum Temperature ◽  
Meteorological Parameters ◽  
Short Term Memory ◽  
Sunshine Duration ◽  
Gaussian Process Regression ◽  
Support Vector ◽  
Ann Model ◽  
Learning Methods ◽  
Average Maximum

Abstract. Proper estimation of the reference evapotranspiration (ET0) amount is an indispensable matter for agricultural water management in the efficient use of water. The aim of study is to estimate the amount of ET0 with a different machine and deep learning methods by using minimum meteorological parameters in the Corum region which is an arid and semi-arid climate with an important agricultural center of Turkey. In this context, meteorological variables of average, maximum and minimum temperature, sunshine duration, wind speed, average, maximum, and minimum relative humidity are used as input data monthly. Two different kernel-based (Gaussian Process Regression (GPR) and Support Vector Regression (SVR)) methods, BFGS-ANN and Long short-term memory models were used to estimate ET0 amounts in 10 different combinations. According to the results obtained, all four methods used predicted ET0 amounts in acceptable accuracy and error levels. BFGS-ANN model showed higher success than the others. In kernel-based GPR and SVR methods, Pearson VII function-based universal kernel was the most successful kernel function. Besides, the scenario that is related to temperature in all scenarios used, including average temperature, maximum and minimum temperature, and sunshine duration gave the best results. The second-best scenario was the one that covers only the sunshine duration. In this case, the ANN (BFGS-ANN) model, which is optimized with the BFGS method that uses only the sunshine duration, can be estimated with the 0.971 correlation coefficient of ET0 without the need for other meteorological parameters.

PP15 Predicting variations of calls to an ambulance service in the UK caused by circulating infections using-deep learning methods

2019 ◽  
Vol 36 (10) ◽  
pp. e7.2-e7
Author(s):  
Thilo Reich ◽  
Marcin Budka
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Prehospital Care ◽  
Machine Learning Algorithms ◽  
Ambulance Service ◽  
Percentage Error ◽  
Learning Methods ◽  
Average Percentage ◽  
Average Percentage Error ◽  
The Uk

BackgroundDigital patient records in the ambulance service have opened up new opportunities for prehospital care. Previously it was demonstrated that prehospital pyrexia numbers are linked to an increase in overall calls to the ambulance service. This study aims to predict the future number of calls using deep-learning methods.MethodsTemperature readings for 280,447 patients were generously provided by the South Western Ambulance Service Trust. The data covered the time between 05/01/2016 and 30/04/2017 with overall 44,472 patients being pyretic. A rolling window of 10 days was applied to daily sums for both pyretic and apyretic patients. These windows were used as input features to train machine-learning algorithms predicting the number of calls 10 days ahead. Algorithms tested include Linear Regression (LR), basic Recurrent Neural Networks (RNN), Long Short Term Memory (LSTM) and Gated Recurrent Unit (GRU) architectures. A genetic approach was used to optimise the architecture, in which parameters were randomly modified and over several generations the best performing algorithm will be selected to be further manipulated. To assess performance the Mean Average Percentage Error (MAPE) was used.ResultsThe initial analysis showed that the total patient number and pyretic patient numbers are correlated. The best performing algorithms with varying numbers of hidden units had the following MAPE in comparison to simple LR: LR=19.4%, LSTM (104 units) = 6.1%, RNN (79 units)=6.01%, GRU (80 units)=5.97%.ConclusionsThese preliminary results suggest that deep-learning methods allow to predict the variations in total number of calls caused by circulating infections. Further investigations will aim to confirm these findings. Once fully verified these algorithms could play a major role in operational planning of any ambulance service by predicting increases in demand.

scholarly journals A Comparative Study of Bitcoin Price Prediction Using Deep Learning

Mathematics ◽  
2019 ◽  
Vol 7 (10) ◽  
pp. 898 ◽  
Author(s):  
Suhwan Ji ◽  
Jongmin Kim ◽  
Hyeonseung Im
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Prediction Models ◽  
Short Term Memory ◽  
Learning Methods ◽  
The Public ◽  
Price Prediction ◽  
Profitability Analysis ◽  
The Media ◽  
Long Short Term Memory

Bitcoin has recently received a lot of attention from the media and the public due to its recent price surge and crash. Correspondingly, many researchers have investigated various factors that affect the Bitcoin price and the patterns behind its fluctuations, in particular, using various machine learning methods. In this paper, we study and compare various state-of-the-art deep learning methods such as a deep neural network (DNN), a long short-term memory (LSTM) model, a convolutional neural network, a deep residual network, and their combinations for Bitcoin price prediction. Experimental results showed that although LSTM-based prediction models slightly outperformed the other prediction models for Bitcoin price prediction (regression), DNN-based models performed the best for price ups and downs prediction (classification). In addition, a simple profitability analysis showed that classification models were more effective than regression models for algorithmic trading. Overall, the performances of the proposed deep learning-based prediction models were comparable.

scholarly journals Voxel-based 3D Point Cloud Semantic Segmentation: Unsupervised Geometric and Relationship Featuring vs Deep Learning Methods

2019 ◽  
Vol 8 (5) ◽  
pp. 213 ◽  
Author(s):  
Florent Poux ◽  
Roland Billen
Keyword(s):  
Deep Learning ◽  
Point Cloud ◽  
Semantic Representation ◽  
Structural Connectivity ◽  
Three Dimensional ◽  
Strong Support ◽  
Semantic Segmentation ◽  
Point Clouds ◽  
Learning Methods ◽  
Cloud Data

Automation in point cloud data processing is central in knowledge discovery within decision-making systems. The definition of relevant features is often key for segmentation and classification, with automated workflows presenting the main challenges. In this paper, we propose a voxel-based feature engineering that better characterize point clusters and provide strong support to supervised or unsupervised classification. We provide different feature generalization levels to permit interoperable frameworks. First, we recommend a shape-based feature set (SF1) that only leverages the raw X, Y, Z attributes of any point cloud. Afterwards, we derive relationship and topology between voxel entities to obtain a three-dimensional (3D) structural connectivity feature set (SF2). Finally, we provide a knowledge-based decision tree to permit infrastructure-related classification. We study SF1/SF2 synergy on a new semantic segmentation framework for the constitution of a higher semantic representation of point clouds in relevant clusters. Finally, we benchmark the approach against novel and best-performing deep-learning methods while using the full S3DIS dataset. We highlight good performances, easy-integration, and high F1-score (> 85%) for planar-dominant classes that are comparable to state-of-the-art deep learning.

scholarly journals Applying Deep Learning Methods on Time-Series Data for Forecasting COVID-19 in Egypt, Kuwait, and Saudi Arabia

Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Nahla F. Omran ◽  
Sara F. Abd-el Ghany ◽  
Hager Saleh ◽  
Abdelmgeid A. Ali ◽  
Abdu Gumaei ◽  
...  
Keyword(s):  
Time Series ◽  
Saudi Arabia ◽  
Deep Learning ◽  
Time Series Data ◽  
Short Term Memory ◽  
Disease Outbreaks ◽  
Handling Time ◽  
Series Data ◽  
Learning Methods ◽  
Death Cases

The novel coronavirus disease (COVID-19) is regarded as one of the most imminent disease outbreaks which threaten public health on various levels worldwide. Because of the unpredictable outbreak nature and the virus’s pandemic intensity, people are experiencing depression, anxiety, and other strain reactions. The response to prevent and control the new coronavirus pneumonia has reached a crucial point. Therefore, it is essential—for safety and prevention purposes—to promptly predict and forecast the virus outbreak in the course of this troublesome time to have control over its mortality. Recently, deep learning models are playing essential roles in handling time-series data in different applications. This paper presents a comparative study of two deep learning methods to forecast the confirmed cases and death cases of COVID-19. Long short-term memory (LSTM) and gated recurrent unit (GRU) have been applied on time-series data in three countries: Egypt, Saudi Arabia, and Kuwait, from 1/5/2020 to 6/12/2020. The results show that LSTM has achieved the best performance in confirmed cases in the three countries, and GRU has achieved the best performance in death cases in Egypt and Kuwait.

scholarly journals A Statistics and Deep Learning Hybrid Method for Multivariate Time Series Forecasting and Mortality Modeling

Forecasting ◽  
2021 ◽  
Vol 4 (1) ◽  
pp. 1-25
Author(s):  
Thabang Mathonsi ◽  
Terence L. van Zyl
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Recurrent Neural Network ◽  
Short Term Memory ◽  
Hybrid Methods ◽  
Prediction Interval ◽  
Hybrid Approach ◽  
Computational Cost ◽  
Exponential Smoothing ◽  
Learning Methods

Hybrid methods have been shown to outperform pure statistical and pure deep learning methods at forecasting tasks and quantifying the associated uncertainty with those forecasts (prediction intervals). One example is Exponential Smoothing Recurrent Neural Network (ES-RNN), a hybrid between a statistical forecasting model and a recurrent neural network variant. ES-RNN achieves a 9.4% improvement in absolute error in the Makridakis-4 Forecasting Competition. This improvement and similar outperformance from other hybrid models have primarily been demonstrated only on univariate datasets. Difficulties with applying hybrid forecast methods to multivariate data include (i) the high computational cost involved in hyperparameter tuning for models that are not parsimonious, (ii) challenges associated with auto-correlation inherent in the data, as well as (iii) complex dependency (cross-correlation) between the covariates that may be hard to capture. This paper presents Multivariate Exponential Smoothing Long Short Term Memory (MES-LSTM), a generalized multivariate extension to ES-RNN, that overcomes these challenges. MES-LSTM utilizes a vectorized implementation. We test MES-LSTM on several aggregated coronavirus disease of 2019 (COVID-19) morbidity datasets and find our hybrid approach shows consistent, significant improvement over pure statistical and deep learning methods at forecast accuracy and prediction interval construction.

scholarly journals Application of deep learning methods to predict ionosphere parameters in real time

2020 ◽  
Vol 196 ◽  
pp. 02007
Author(s):  
Vladimir Mochalov ◽  
Anastasia Mochalova
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real Time ◽  
Network Architecture ◽  
Short Term Memory ◽  
Neural Network Architecture ◽  
Short Term ◽  
Learning Methods ◽  
Term Memory ◽  
Long Short Term Memory

In this paper, the previously obtained results on recognition of ionograms using deep learning are expanded to predict the parameters of the ionosphere. After the ionospheric parameters have been identified on the ionogram using deep learning in real time, we can predict the parameters for some time ahead on the basis of the new data obtained Examples of predicting the ionosphere parameters using an artificial recurrent neural network architecture long short-term memory are given. The place of the block for predicting the parameters of the ionosphere in the system for analyzing ionospheric data using deep learning methods is shown.

scholarly journals Deep Learning Methods In Predicting Indonesia Composite Stock Price Index (IHSG)

2021 ◽  
Vol 10 (5) ◽  
Author(s):  
Arief Fadhlurrahman Rasyid ◽  
Dewi Agushinta R. ◽  
Dharma Tintri Ediraras
Keyword(s):  
Deep Learning ◽  
Stock Price ◽  
Price Index ◽  
Time Series Data ◽  
Short Term Memory ◽  
Series Data ◽  
Analysis Model ◽  
Accuracy Rate ◽  
Learning Methods ◽  
Stock Price Index

The stock price changes at any time within seconds. The stock price is a time series data. Thus, it is necessary to have the best analysis model in predicting the stock price to make decisions to avoid losses in investing. In this research, the method used two models Deep Learning namely Long Short Term Memory (LSTM) and Gated Recurrent Unit (GRU) in predicting Indonesia Composite Stock Price Index (IHSG). The dataset used is historical data from the Jakarta Composite Index (^JKSE) stock price in 2013-2020 obtained through Yahoo Finance. The results suggest that Deep learning methods with LSTM and GRU models can predict Indonesia Composite Stock Price Index (IHSG). Based on the test results obtained RMSE value of 71.28959454502723 with an accuracy rate of 92.39% for LSTM models and obtained RMSE value of 70.61870739073838 with an accuracy rate of 96.77% on GRU models.

Sign in / Sign up

Export Citation Format

Share Document