scholarly journals Deep Learning for Precipitation Estimation from Satellite and Rain Gauges Measurements

2019 ◽  
Vol 11 (21) ◽  
pp. 2463
Author(s):  
Arthur Moraux ◽  
Steven Dewitte ◽  
Bruno Cornelis ◽  
Adrian Munteanu
Keyword(s):  
Deep Learning ◽  
Multiscale Analysis ◽  
Mean Squared Error ◽  
Rain Gauge ◽  
Probability Of Detection ◽  
Precipitation Rate ◽  
Rain Gauges ◽  
Squared Error ◽  
Precipitation Estimation ◽  
Deep Learning Model

This paper proposes a multimodal and multi-task deep-learning model for instantaneous precipitation rate estimation. Using both thermal infrared satellite radiometer and automatic rain gauge measurements as input, our encoder–decoder convolutional neural network performs a multiscale analysis of these two modalities to estimate simultaneously the rainfall probability and the precipitation rate value. Precipitating pixels are detected with a Probability Of Detection (POD) of 0.75 and a False Alarm Ratio (FAR) of 0.3. Instantaneous precipitation rate is estimated with a Root Mean Squared Error (RMSE) of 1.6 mm/h.

Deep Learning for Precipitation Estimation from Satellite and Rain Gauges Measurements

2020 ◽  
Author(s):  
Arthur Moraux ◽  
Steven Dewitte ◽  
Bruno Cornelis ◽  
Adrian Munteanu
Keyword(s):  
Deep Learning ◽  
Rain Gauge ◽  
High Expectations ◽  
Rain Gauges ◽  
Weather And Climate ◽  
Learning Technique ◽  
Precipitation Estimation ◽  
The Many ◽  
Weather Observation

<p><span>In the coming years, Artificial Intelligence (AI), for which Deep Learning (DL) is an essential component, is expected to transform society in a way that is compared to the introduction of electricity or the introduction of the internet. The high expectations are founded on the many impressive results of recent DL studies for AI tasks (e.g. computer vision, text translation, image or text generation...). Also for weather and climate observations, a large potential for </span><span>AI</span><span> application exists. </span></p><p><span>We present the results of the recent paper [Moraux et al, 2019], which is one of the first demonstrations of the application </span><span>of </span><span>cutting edge deep learning technique</span><span>s</span><span> to a practical weather observation problem. We developed a multiscale encoder-decoder convolutional neural network using the three most relevant SEVIRI/MSG spectral images at 8.7, 10.8 and 12.0 micron and in situ rain gauge measurements as input. The network is trained to reproduce precipitation measured by rain gauges in Belgium, the Netherlands and Germany. Precipitating pixels are detected with a POD of 0.75 and a FAR of 0.3. Instantaneous precipitation rate is estimated with a RMSE of 1.6 mm/h.</span></p><p> </p><p><span>Reference:</span></p><p><span>[Moraux et al, 2019] Moraux, A.; Dewitte, S.; Cornelis, B.; Munteanu, A. Deep Learning for Precipitation Estimation from Satellite and Rain Gauges Measurements. </span><em><span>Remote Sens.</span></em> <span><strong>2019</strong></span><span>, </span><em><span>11</span></em><span>, 2463. </span></p>

scholarly journals Deep learning can accelerate and quantify simulated localized correlated spectroscopy

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Zohaib Iqbal ◽  
Dan Nguyen ◽  
Michael Albert Thomas ◽  
Steve Jiang
Keyword(s):  
Deep Learning ◽  
Compressed Sensing ◽  
Mean Squared Error ◽  
Learning Model ◽  
The Body ◽  
Resonance Spectroscopy ◽  
Atomic Structures ◽  
Squared Error ◽  
Deep Learning Model ◽  
Cosy Spectra

AbstractNuclear magnetic resonance spectroscopy (MRS) allows for the determination of atomic structures and concentrations of different chemicals in a biochemical sample of interest. MRS is used in vivo clinically to aid in the diagnosis of several pathologies that affect metabolic pathways in the body. Typically, this experiment produces a one dimensional (1D) 1H spectrum containing several peaks that are well associated with biochemicals, or metabolites. However, since many of these peaks overlap, distinguishing chemicals with similar atomic structures becomes much more challenging. One technique capable of overcoming this issue is the localized correlated spectroscopy (L-COSY) experiment, which acquires a second spectral dimension and spreads overlapping signal across this second dimension. Unfortunately, the acquisition of a two dimensional (2D) spectroscopy experiment is extremely time consuming. Furthermore, quantitation of a 2D spectrum is more complex. Recently, artificial intelligence has emerged in the field of medicine as a powerful force capable of diagnosing disease, aiding in treatment, and even predicting treatment outcome. In this study, we utilize deep learning to: (1) accelerate the L-COSY experiment and (2) quantify L-COSY spectra. All training and testing samples were produced using simulated metabolite spectra for chemicals found in the human body. We demonstrate that our deep learning model greatly outperforms compressed sensing based reconstruction of L-COSY spectra at higher acceleration factors. Specifically, at four-fold acceleration, our method has less than 5% normalized mean squared error, whereas compressed sensing yields 20% normalized mean squared error. We also show that at low SNR (25% noise compared to maximum signal), our deep learning model has less than 8% normalized mean squared error for quantitation of L-COSY spectra. These pilot simulation results appear promising and may help improve the efficiency and accuracy of L-COSY experiments in the future.

scholarly journals A Deep Learning Multimodal Method for Precipitation Estimation

2021 ◽  
Vol 13 (16) ◽  
pp. 3278
Author(s):  
Arthur Moraux ◽  
Steven Dewitte ◽  
Bruno Cornelis ◽  
Adrian Munteanu
Keyword(s):  
Deep Learning ◽  
Satellite Imagery ◽  
Daily Rainfall ◽  
Radar Data ◽  
Rain Gauge ◽  
Precipitation Rate ◽  
Estimation Accuracy ◽  
Rate Estimation ◽  
The North ◽  
Precipitation Estimation

To improve precipitation estimation accuracy, new methods, which are able to merge different precipitation measurement modalities, are necessary. In this study, we propose a deep learning method to merge rain gauge measurements with a ground-based radar composite and thermal infrared satellite imagery. The proposed convolutional neural network, composed of an encoder–decoder architecture, performs a multiscale analysis of the three input modalities to estimate simultaneously the rainfall probability and the precipitation rate value with a spatial resolution of 2 km. The training of our model and its performance evaluation are carried out on a dataset spanning 5 years from 2015 to 2019 and covering Belgium, the Netherlands, Germany and the North Sea. Our results for instantaneous precipitation detection, instantaneous precipitation rate estimation, and for daily rainfall accumulation estimation show that the best accuracy is obtained for the model combining all three modalities. The ablation study, done to compare every possible combination of the three modalities, shows that the combination of rain gauges measurements with radar data allows for a considerable increase in the accuracy of the precipitation estimation, and the addition of satellite imagery provides precipitation estimates where rain gauge and radar coverage are lacking. We also show that our multi-modal model significantly improves performance compared to the European radar composite product provided by OPERA and the quasi gauge-adjusted radar product RADOLAN provided by the DWD for precipitation rate estimation.

scholarly journals A Comprehensive Evaluation of Latest GPM IMERG V06 Early, Late and Final Precipitation Products across China

2021 ◽  
Vol 13 (6) ◽  
pp. 1208
Author(s):  
Linfei Yu ◽  
Guoyong Leng ◽  
Andre Python ◽  
Jian Peng
Keyword(s):  
Comprehensive Evaluation ◽  
Probability Of Detection ◽  
Light Rain ◽  
Spatial And Temporal Scales ◽  
Rain Gauges ◽  
Precipitation Estimation ◽  
Major River ◽  
Low Levels ◽  
Rain Events ◽  
Early Late

This study evaluated the performance of the early, late and final runs of IMERG version 06 precipitation products at various spatial and temporal scales in China from 2008 to 2017, against observations from 696 rain gauges. The results suggest that the three IMERG products can well reproduce the spatial patterns of precipitation, but exhibit a gradual decrease in the accuracy from the southeast to the northwest of China. Overall, the three runs show better performances in the eastern humid basins than the western arid basins. Compared to the early and late runs, the final run shows an improvement in the performance of precipitation estimation in terms of correlation coefficient, Kling–Gupta Efficiency and root mean square error at both daily and monthly scales. The three runs show similar daily precipitation detection capability over China. The biases of the three runs show a significantly positive (p < 0.01) correlation with elevation, with higher accuracy observed with an increase in elevation. However, the categorical metrics exhibit low levels of dependency on elevation, except for the probability of detection. Over China and major river basins, the three products underestimate the frequency of no/tiny rain events (P < 0.1 mm/day) but overestimate the frequency of light rain events (0.1 ≤ P < 10 mm/day). The three products converge with ground-based observation with regard to the frequency of rainstorm (P ≥ 50 mm/day) in the southern part of China. The revealed uncertainties associated with the IMERG products suggests that sustaining efforts are needed to improve their retrieval algorithms in the future.

scholarly journals Linear Regression Algorithm in Machine Learning through MATLAB

2021 ◽  
Vol 9 (12) ◽  
pp. 989-995
Author(s):  
Kalva Sindhu Priya
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Deep Learning ◽  
Linear Regression ◽  
Mean Squared Error ◽  
Critical Part ◽  
Squared Error ◽  
Master Level ◽  
Predicted Model ◽  
The Given

Abstract: In the present scenario, it is quite aware that almost every field is moving into machine based automation right from fundamentals to master level systems. Among them, Machine Learning (ML) is one of the important tool which is most similar to Artificial Intelligence (AI) by allowing some well known data or past experience in order to improve automatically or estimate the behavior or status of the given data through various algorithms. Modeling a system or data through Machine Learning is important and advantageous as it helps in the development of later and newer versions. Today most of the information technology giants such as Facebook, Uber, Google maps made Machine learning as a critical part of their ongoing operations for the better view of users. In this paper, various available algorithms in ML is given briefly and out of all the existing different algorithms, Linear Regression algorithm is used to predict a new set of values by taking older data as reference. However, a detailed predicted model is discussed clearly by building a code with the help of Machine Learning and Deep Learning tool in MATLAB/ SIMULINK. Keywords: Machine Learning (ML), Linear Regression algorithm, Curve fitting, Root Mean Squared Error

scholarly journals Sub3DNet1.0: a deep-learning model for regional-scale 3D subsurface structure mapping

2021 ◽  
Vol 14 (6) ◽  
pp. 3421-3435
Author(s):  
Zhenjiao Jiang ◽  
Dirk Mallants ◽  
Lei Gao ◽  
Tim Munday ◽  
Gregoire Mariethoz ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Land Surface ◽  
Regional Scale ◽  
Learning Model ◽  
Generic Structure ◽  
Squared Error ◽  
The Neural Network ◽  
Deep Learning Model ◽  
Surface Observations

Abstract. This study introduces an efficient deep-learning model based on convolutional neural networks with joint autoencoder and adversarial structures for 3D subsurface mapping from 2D surface observations. The method was applied to delineate paleovalleys in an Australian desert landscape. The neural network was trained on a 6400 km2 domain by using a land surface topography as 2D input and an airborne electromagnetic (AEM)-derived probability map of paleovalley presence as 3D output. The trained neural network has a squared error <0.10 across 99 % of the training domain and produces a squared error <0.10 across 93 % of the validation domain, demonstrating that it is reliable in reconstructing 3D paleovalley patterns beyond the training area. Due to its generic structure, the neural network structure designed in this study and the training algorithm have broad application potential to construct 3D geological features (e.g., ore bodies, aquifer) from 2D land surface observations.

scholarly journals Impact of the Altitudinal Gradients of Precipitation on the Radar QPE Bias in the French Alps

Atmosphere ◽  
2019 ◽  
Vol 10 (6) ◽  
pp. 306 ◽  
Author(s):  
Dominique Faure ◽  
Guy Delrieu ◽  
Nicolas Gaussiat
Keyword(s):  
Ground Level ◽  
Radar Data ◽  
Rain Gauge ◽  
Altitudinal Gradients ◽  
French Alps ◽  
Rain Gauges ◽  
Quantitative Precipitation Estimation ◽  
Precipitation Estimation ◽  
Radar Data Processing

In the French Alps the quality of the radar Quantitative Precipitation Estimation (QPE) is limited by the topography and the vertical structure of precipitation. A previous study realized in all the French Alps, has shown a general bias between values of the national radar QPE composite and the rain gauge measurements: a radar QPE over-estimation at low altitude (+20% at 200 m a.s.l.), and an increasing underestimation at high altitudes (until −40% at 2100 m a.s.l.). This trend has been linked to altitudinal gradients of precipitation observed at ground level. This paper analyzes relative altitudinal gradients of precipitation estimated with rain gauges measurements in 2016 for three massifs around Grenoble, and for different temporal accumulations (yearly, seasonal, monthly, daily). Comparisons of radar and rain gauge accumulations confirm the bias previously observed. The parts of the current radar data processing affecting the bias value are pointed out. The analysis shows a coherency between the relative gradient values estimated at the different temporal accumulations. Vertical profiles of precipitation detected by a research radar installed at the bottom of the valley also show how the wide horizontal variability of precipitation inside the valley can affect the gradient estimation.

scholarly journals Precipitation Estimation Methods in Continuous, Distributed Urban Hydrologic Modeling

Water ◽  
2019 ◽  
Vol 11 (7) ◽  
pp. 1340
Author(s):  
Woodson ◽  
Adams ◽  
Dymond
Keyword(s):  
Hydrological Modeling ◽  
Mean Squared Error ◽  
Uniform Estimate ◽  
Mean Field ◽  
Radar Data ◽  
Rain Gauge ◽  
Hydrologic Model ◽  
Estimation Methods ◽  
Urban Watersheds ◽  
Precipitation Estimation

Quantitative precipitation estimation (QPE) remains a key area of uncertainty in hydrological modeling and prediction, particularly in small, urban watersheds, which respond rapidly to precipitation and can experience significant spatial variability in rainfall fields. Few studies have compared QPE methods in small, urban watersheds, and studies that have examined this topic only compared model results on an event basis using a small number of storms. This study sought to compare the efficacy of multiple QPE methods when simulating discharge in a small, urban watershed on a continuous basis using an operational hydrologic model and QPE forcings. The research distributed hydrologic model (RDHM) was used to model a basin in Roanoke, Virginia, USA, forced with QPEs from four methods: mean field bias (MFB) correction of radar data, kriging of rain gauge data, uncorrected radar data, and a basin-uniform estimate from a single gauge inside the watershed. Based on comparisons between simulated and observed discharge at the basin outlet for a six-month period in 2018, simulations forced with the uncorrected radar QPE had the highest accuracy, as measured by root mean squared error (RMSE) and peak flow relative error, despite systematic underprediction of the mean areal precipitation (MAP). Simulations forced with MFB-corrected radar data consistently and significantly overpredicted discharge, but had the highest accuracy in predicting the timing of peak flows.

scholarly journals Enhancing PMW Satellite Precipitation Estimation: Detecting Convective Class

2019 ◽  
Vol 36 (12) ◽  
pp. 2349-2363 ◽  
Author(s):  
Veljko Petković ◽  
Marko Orescanin ◽  
Pierre Kirstetter ◽  
Christian Kummerow ◽  
Ralph Ferraro
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Large Scale ◽  
Model Development ◽  
Precipitation Rate ◽  
Neural Network Approach ◽  
Satellite Precipitation ◽  
Precipitation Estimation ◽  
Microwave Imager ◽  
Deep Learning Neural Network

AbstractA decades-long effort in observing precipitation from space has led to continuous improvements of satellite-derived passive microwave (PMW) large-scale precipitation products. However, due to a limited ability to relate observed radiometric signatures to precipitation type (convective and stratiform) and associated precipitation rate variability, PMW retrievals are prone to large systematic errors at instantaneous scales. The present study explores the use of deep learning approach in extracting the information content from PMW observation vectors to help identify precipitation types. A deep learning neural network model (DNN) is developed to retrieve the convective type in precipitating systems from PMW observations. A 12-month period of Global Precipitation Measurement mission Microwave Imager (GMI) observations is used as a dataset for model development and verification. The proposed DNN model is shown to accurately predict precipitation types for 85% of total precipitation volume. The model reduces precipitation rate bias associated with convective and stratiform precipitation in the GPM operational algorithm by a factor of 2 while preserving the correlation with reference precipitation rates, and is insensitive to surface type variability. Based on comparisons against currently used convective schemes, it is concluded that the neural network approach has the potential to address regime-specific PMW satellite precipitation biases affecting GPM operations.

scholarly journals HiCNN2: Enhancing the Resolution of Hi-C Data Using an Ensemble of Convolutional Neural Networks

Genes ◽  
2019 ◽  
Vol 10 (11) ◽  
pp. 862
Author(s):  
Tong Liu ◽  
Zheng Wang
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
High Resolution ◽  
Convolutional Neural Network ◽  
Mean Squared Error ◽  
Correlation Coefficients ◽  
Chromatin Interactions ◽  
Squared Error ◽  
Genome Wide

We present a deep-learning package named HiCNN2 to learn the mapping between low-resolution and high-resolution Hi-C (a technique for capturing genome-wide chromatin interactions) data, which can enhance the resolution of Hi-C interaction matrices. The HiCNN2 package includes three methods each with a different deep learning architecture: HiCNN2-1 is based on one single convolutional neural network (ConvNet); HiCNN2-2 consists of an ensemble of two different ConvNets; and HiCNN2-3 is an ensemble of three different ConvNets. Our evaluation results indicate that HiCNN2-enhanced high-resolution Hi-C data achieve smaller mean squared error and higher Pearson’s correlation coefficients with experimental high-resolution Hi-C data compared with existing methods HiCPlus and HiCNN. Moreover, all of the three HiCNN2 methods can recover more significant interactions detected by Fit-Hi-C compared to HiCPlus and HiCNN. Based on our evaluation results, we would recommend using HiCNN2-1 and HiCNN2-3 if recovering more significant interactions from Hi-C data is of interest, and HiCNN2-2 and HiCNN if the goal is to achieve higher reproducibility scores between the enhanced Hi-C matrix and the real high-resolution Hi-C matrix.

Sign in / Sign up

Export Citation Format

Share Document