scholarly journals A Real-Time Data Analysis Platform for Short-Term Water Consumption Forecasting with Machine Learning

Forecasting ◽  
2021 ◽  
Vol 3 (4) ◽  
pp. 682-694
Author(s):  
Aida Boudhaouia ◽  
Patrice Wira
Keyword(s):  
Machine Learning ◽  
Data Analysis ◽  
Real Time ◽  
Water Consumption ◽  
Short Term Memory ◽  
Back Propagation ◽  
Time Data ◽  
Short Term ◽  
Real Time Data ◽  
Analysis Platform

This article presents a real-time data analysis platform to forecast water consumption with Machine-Learning (ML) techniques. The strategy fully relies on a web-oriented architecture to ensure better management and optimized monitoring of water consumption. This monitoring is carried out through a communicating system for collecting data in the form of unevenly spaced time series. The platform is completed by learning capabilities to analyze and forecast water consumption. The analysis consists of checking the data integrity and inconsistency, in looking for missing data, and in detecting abnormal consumption. Forecasting is based on the Long Short-Term Memory (LSTM) and the Back-Propagation Neural Network (BPNN). After evaluation, results show that the ML approaches can predict water consumption without having prior knowledge about the data and the users. The LSTM approach, by being able to grab the long-term dependencies between time steps of water consumption, allows the prediction of the amount of consumed water in the next hour with an error of some liters and the instants of the 5 next consumed liters in some milliseconds.

Real-time data analysis using a machine learning model significantly improves prediction of successful vaginal deliveries

2020 ◽  
Vol 223 (3) ◽  
pp. 437.e1-437.e15
Author(s):  
Joshua Guedalia ◽  
Michal Lipschuetz ◽  
Michal Novoselsky-Persky ◽  
Sarah M. Cohen ◽  
Amihai Rottenstreich ◽  
...  
Keyword(s):  
Machine Learning ◽  
Data Analysis ◽  
Real Time ◽  
Learning Model ◽  
Time Data ◽  
Machine Learning Model ◽  
Vaginal Deliveries ◽  
Real Time Data

scholarly journals Machine Learning based Improved Gaussian Mixture Model for IoT Real-Time Data Analysis

2020 ◽  
Vol 16 (1) ◽  
Author(s):  
Sivadi Sivadi ◽  
Moorthy Moorthy ◽  
Vijender Solanki
Keyword(s):  
Machine Learning ◽  
Data Analysis ◽  
Real Time ◽  
Gaussian Mixture Model ◽  
Gaussian Mixture ◽  
Sensor Data ◽  
Cloud Platform ◽  
Time Data ◽  
Huge Amount ◽  
Real Time Data

Introduction: The article is the product of the research “Due to the increase in popularity of Internet of Things (IoT), a huge amount of sensor data is being generated from various smart city applications”, developed at Pondicherry University in the year 2019. Problem:To acquire and analyze the huge amount of sensor-generated data effectively is a significant problem when processing the data. Objective:  To propose a novel framework for IoT sensor data analysis using machine learning based improved Gaussian Mixture Model (GMM) by acquired real-time data.  Methodology:In this paper, the clustering based GMM models are used to find the density patterns on a daily or weekly basis for user requirements. The ThingSpeak cloud platform used for performing analysis and visualizations. Results:An analysis has been performed on the proposed mechanism implemented on real-time traffic data with Accuracy, Precision, Recall, and F-Score as measures. Conclusions:The results indicate that the proposed mechanism is efficient when compared with the state-of-the-art schemes. Originality:Applying GMM and ThingSpeak Cloud platform to perform analysis on IoT real-time data is the first approach to find traffic density patterns on busy roads. Restrictions:There is a need to develop the application for mobile users to find the optimal traffic routes based on density patterns. The authors could not concentrate on the security aspect for finding density patterns.

Machine Learning for Real-time Data Reduction in Cloud of Things

2020 ◽  
Author(s):  
Atheer Alahmed ◽  
Amal Alrasheedi ◽  
Maha Alharbi ◽  
Norah Alrebdi ◽  
Marwan Aleasa ◽  
...  
Keyword(s):  
Machine Learning ◽  
Real Time ◽  
Data Reduction ◽  
Time Data ◽  
Real Time Data

scholarly journals An LSTM-Based Method Considering History and Real-Time Data for Passenger Flow Prediction

2020 ◽  
Vol 10 (11) ◽  
pp. 3788 ◽  
Author(s):  
Qi Ouyang ◽  
Yongbo Lv ◽  
Jihui Ma ◽  
Jing Li
Keyword(s):  
Feature Extraction ◽  
Real Time ◽  
Short Term Memory ◽  
Historical Data ◽  
Time Interval ◽  
Information Coding ◽  
Time Data ◽  
Passenger Flow ◽  
Flow Prediction ◽  
Real Time Data

With the development of big data and deep learning, bus passenger flow prediction considering real-time data becomes possible. Real-time traffic flow prediction helps to grasp real-time passenger flow dynamics, provide early warning for a sudden passenger flow and data support for real-time bus plan changes, and improve the stability of urban transportation systems. To solve the problem of passenger flow prediction considering real-time data, this paper proposes a novel passenger flow prediction network model based on long short-term memory (LSTM) networks. The model includes four parts: feature extraction based on Xgboost model, information coding based on historical data, information coding based on real-time data, and decoding based on a multi-layer neural network. In the feature extraction part, the data dimension is increased by fusing bus data and points of interest to improve the number of parameters and model accuracy. In the historical information coding part, we use the date as the index in the LSTM structure to encode historical data and provide relevant information for prediction; in the real-time data coding part, the daily half-hour time interval is used as the index to encode real-time data and provide real-time prediction information; in the decoding part, the passenger flow data for the next two 30 min interval outputs by decoding all the information. To our best knowledge, it is the first time to real-time information has been taken into consideration in passenger flow prediction based on LSTM. The proposed model can achieve better accuracy compared to the LSTM and other baseline methods.

A Novel Well Test Data Analyzer and Process Optimizer Using Artificial Intelligence and Machine Learning Techniques

2021 ◽  
Author(s):  
Nagaraju Reddicharla ◽  
Subba Ramarao Rachapudi ◽  
Indra Utama ◽  
Furqan Ahmed Khan ◽  
Prabhker Reddy Vanam ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Real Time ◽  
Test Data ◽  
Oil Field ◽  
Well Testing ◽  
Well Test ◽  
Time Data ◽  
Real Time Data ◽  
Well Tests

Abstract Well testing is one of the vital process as part of reservoir performance monitoring. As field matures with increase in number of well stock, testing becomes tedious job in terms of resources (MPFM and test separators) and this affect the production quota delivery. In addition, the test data validation and approval follow a business process that needs up to 10 days before to accept or reject the well tests. The volume of well tests conducted were almost 10,000 and out of them around 10 To 15 % of tests were rejected statistically per year. The objective of the paper is to develop a methodology to reduce well test rejections and timely raising the flag for operator intervention to recommence the well test. This case study was applied in a mature field, which is producing for 40 years that has good volume of historical well test data is available. This paper discusses the development of a data driven Well test data analyzer and Optimizer supported by artificial intelligence (AI) for wells being tested using MPFM in two staged approach. The motivating idea is to ingest historical, real-time data, well model performance curve and prescribe the quality of the well test data to provide flag to operator on real time. The ML prediction results helps testing operations and can reduce the test acceptance turnaround timing drastically from 10 days to hours. In Second layer, an unsupervised model with historical data is helping to identify the parameters that affecting for rejection of the well test example duration of testing, choke size, GOR etc. The outcome from the modeling will be incorporated in updating the well test procedure and testing Philosophy. This approach is being under evaluation stage in one of the asset in ADNOC Onshore. The results are expected to be reducing the well test rejection by at least 5 % that further optimize the resources required and improve the back allocation process. Furthermore, real time flagging of the test Quality will help in reduction of validation cycle from 10 days hours to improve the well testing cycle process. This methodology improves integrated reservoir management compliance of well testing requirements in asset where resources are limited. This methodology is envisioned to be integrated with full field digital oil field Implementation. This is a novel approach to apply machine learning and artificial intelligence application to well testing. It maximizes the utilization of real-time data for creating advisory system that improve test data quality monitoring and timely decision-making to reduce the well test rejection.

scholarly journals Real-time data analysis for medical diagnosis using FPGA-accelerated neural networks

2018 ◽  
Vol 19 (S18) ◽  
Author(s):  
Ahmed Sanaullah ◽  
Chen Yang ◽  
Yuri Alexeev ◽  
Kazutomo Yoshii ◽  
Martin C. Herbordt
Keyword(s):  
Neural Networks ◽  
Data Analysis ◽  
Real Time ◽  
Medical Diagnosis ◽  
Time Data ◽  
Real Time Data

scholarly journals Drilling Efficiency Improvement and Rate of Penetration Optimization by Machine Learning and Data Analytics

2020 ◽  
Vol 5 (3) ◽  
pp. 381-394
Author(s):  
Sridharan Chandrasekaran ◽  
G. Suresh Kumar
Keyword(s):  
Machine Learning ◽  
Real Time ◽  
Data Storage ◽  
Predictive Accuracy ◽  
Empirical Models ◽  
Operational Parameters ◽  
Time Data ◽  
Bottom Line ◽  
Rate Of Penetration ◽  
Real Time Data

Rate of Penetration (ROP) is one of the important factors influencing the drilling efficiency. Since cost recovery is an important bottom line in the drilling industry, optimizing ROP is essential to minimize the drilling operational cost and capital cost. Traditional the empirical models are not adaptive to new lithology changes and hence the predictive accuracy is low and subjective. With advancement in big data technologies, real- time data storage cost is lowered, and the availability of real-time data is enhanced. In this study, it is shown that optimization methods together with data models has immense potential in predicting ROP based on real time measurements on the rig. A machine learning based data model is developed by utilizing the offset vertical wells’ real time operational parameters while drilling. Data pre-processing methods and feature engineering methods modify the raw data into a processed data so that the model learns effectively from the inputs. A multi – layer back propagation neural network is developed, cross-validated and compared with field measurements and empirical models.

Sign in / Sign up

Export Citation Format

Share Document