scholarly journals Seamless rainfall prediction skill comparison between GLOSEA5 and NEPS-G ensemble prediction systems

2021 ◽  
Author(s):  
Seshagirirao Kolusu ◽  
Marion Mittermaier ◽  
Joanne Robbins ◽  
Caroline Jones ◽  
Raghavendra Ashrit ◽  
...  

<p>The southwest monsoon rains in 2019 were the heaviest over India in a quarter of a century. The 2019 seasonal JJAS precipitation over the whole country was 110 % of its long period average (LPA) of 880mm. Precipitation is a cumulative field driven by many atmospheric processes both within nature and numerical prediction.  It’s a weather variable that impacts everyone’s life and hence is used routinely to assess the skill of modelling systems. In this study, we have analyzed the 2019 JJAS seasonal precipitation forecast skill of two global ensemble models: (1) the UK Met Office GloSea5 and (2) the National Center for Medium Range Weather Forecasting (NCMRWF) Global Ensemble Prediction System (NEPS-G). The Integrated Multi-satellite Retrievals for Global Precipitation Measurement (IMERG-GPM) rainfall and ERA5 winds with high spatial resolution and temporal data are used for verification of the model forecasts across a seamless range of time scales.  In order to compare a seamless range of time scales, we have summed forecast fields over time windows of forecast lead time from 1 day to 2 weeks. We also computed the actual skill and potential skill of the model ensemble forecasts at different lead windows. Our results for both models show large precipitation biases and reduced precipitation skills with forecast lead windows. We also found that the models’ actual and potential skill are sensitive to the number of ensemble members and type of ensemble generation. Moreover, the GloSea5 model actual skill is higher than the NEPS-G model over Indian homogeneous regions. To use the GloSea5 NWP forecast model ensemble members for more quantitative applications in downstream hazard and/or impact-based modelling and applications the between-ensemble-member bias introduced by the lagging needs to be addressed.</p>

2021 ◽  
Author(s):  
Marion Mittermaier ◽  
Seonaid Anderson ◽  
Ric Crocker ◽  
Steven Cole ◽  
Robert Moore ◽  
...  

<p>Forecasting the potential for flood-producing precipitation and any subsequent flooding is a challenging task; the process is highly non-linear and inherently uncertain. Acknowledging and accounting for the uncertainty in precipitation and flood forecasts has become increasingly important with the move to risk-based warning and guidance services which combine the likelihood of flooding with the potential impact on society and the environment.</p><p>A standard approach to accounting for uncertainty is to generate ensemble forecasts. Here the national Grid-to-Grid (G2G) model is coupled to a Best Medium Range (BMR) ensemble which consists of three models spanning different time horizons: an ensemble nowcast for the first 6h, which is blended with the short-range 2.2 km Met Office Global Regional Ensemble Prediction System (MOGREPS-UK) ensemble up to 36h and the ~20 km global MOGREPS-G up to day 6. The G2G model is driven by 15-minute accumulations on a 1 km grid.</p><p>16-months of precipitation and river flow ensemble forecasts have been processed to develop and assess a joint verification framework which can facilitate the evaluation of the end-to-end forecasting chain. Analysis concluded the following: (1) daily precipitation accumulations provide the best guidance in terms of rain volume for hydrological impacts. One reason may be because it removes the impact of timing errors at the sub-daily scale. However, sub-daily precipitation can be more closely related to river flow on an ensemble member-by-member basis. (2) Observation uncertainty is important. The same forecasts verified against three different observed precipitation sources (raingauge, radar or merged) can provide markedly different results and interpretations. G2G river flow performance can also be affected, when driven by these datasets rather than forecasts. (3) The change in precipitation-intensity with model is evident and has an impact on downstream modelling and verification. (4) The period used for ensemble verification should be at least two years. The 16-month test period was sufficient for generating enough precipitation threshold-exceedances for the 95th percentile: but insufficient for higher thresholds and for river flow thresholds above half the median annual maximum flood at sub-regional scales. (5) A new method of presenting Time-Window Probabilities (TWPs) has been developed for precipitation thresholds that are hydrologically relevant. Verification of these shows that probabilities are larger, and more reliable so that users can have greater confidence in them. (6) Overall precipitation forecast skill was far more uniform than for river-flow, primarily because the atmosphere is a continuum whilst catchments are finite and subject to external, non-atmospheric factors including antecedent moisture. (7) Though G2G can be sensitive to precipitation outliers, the precipitation ensemble is generally under-spread and spread does not appear to amplify or propagate to enhance the river flow ensemble spread, so spread is reduced rather than increased in the downstream application.</p>


2010 ◽  
Vol 138 (1) ◽  
pp. 176-189 ◽  
Author(s):  
Felix Fundel ◽  
Andre Walser ◽  
Mark A. Liniger ◽  
Christoph Frei ◽  
Christof Appenzeller

Abstract The calibration of numerical weather forecasts using reforecasts has been shown to increase the skill of weather predictions. Here, the precipitation forecasts from the Consortium for Small Scale Modeling Limited Area Ensemble Prediction System (COSMO-LEPS) are improved using a 30-yr-long set of reforecasts. The probabilistic forecasts are calibrated on the exceedance of return periods, independently from available observations. Besides correcting for systematic model errors, the spatial and temporal variability in the amplitude of rare precipitation events is implicitly captured when issuing forecasts of return periods. These forecast products are especially useful for issuing warnings of upcoming events. A way to visualize those calibrated ensemble forecasts conveniently for end users and to present verification results of the return period–based forecasts for Switzerland is proposed. It is presented that, depending on the lead time and return period, calibrating COSMO-LEPS with reforecasts increases the precipitation forecast skill substantially (about 1 day in forecast lead time). The largest improvements are achieved during winter months. The reasonable choice of the length of the reforecast climatology is estimated for an efficient use of this computational expensive calibration method.


2013 ◽  
Vol 17 (6) ◽  
pp. 2107-2120 ◽  
Author(s):  
S. Davolio ◽  
M. M. Miglietta ◽  
T. Diomede ◽  
C. Marsigli ◽  
A. Montani

Abstract. Numerical weather prediction models can be coupled with hydrological models to generate streamflow forecasts. Several ensemble approaches have been recently developed in order to take into account the different sources of errors and provide probabilistic forecasts feeding a flood forecasting system. Within this framework, the present study aims at comparing two high-resolution limited-area meteorological ensembles, covering short and medium range, obtained via different methodologies, but implemented with similar number of members, horizontal resolution (about 7 km), and driving global ensemble prediction system. The former is a multi-model ensemble, based on three mesoscale models (BOLAM, COSMO, and WRF), while the latter, following a single-model approach, is the operational ensemble forecasting system developed within the COSMO consortium, COSMO-LEPS (limited-area ensemble prediction system). The meteorological models are coupled with a distributed rainfall-runoff model (TOPKAPI) to simulate the discharge of the Reno River (northern Italy), for a recent severe weather episode affecting northern Apennines. The evaluation of the ensemble systems is performed both from a meteorological perspective over northern Italy and in terms of discharge prediction over the Reno River basin during two periods of heavy precipitation between 29 November and 2 December 2008. For each period, ensemble performance has been compared at two different forecast ranges. It is found that, for the intercomparison undertaken in this specific study, both mesoscale model ensembles outperform the global ensemble for application at basin scale. Horizontal resolution is found to play a relevant role in modulating the precipitation distribution. Moreover, the multi-model ensemble provides a better indication concerning the occurrence, intensity and timing of the two observed discharge peaks, with respect to COSMO-LEPS. This seems to be ascribable to the different behaviour of the involved meteorological models. Finally, a different behaviour comes out at different forecast ranges. For short ranges, the impact of boundary conditions is weaker and the spread can be mainly attributed to the different characteristics of the models. At longer forecast ranges, the similar behaviour of the multi-model members forced by the same large-scale conditions indicates that the systems are governed mainly by the boundary conditions, although the different limited area models' characteristics may still have a non-negligible impact.


2015 ◽  
Vol 8 (7) ◽  
pp. 2355-2377 ◽  
Author(s):  
M. Rautenhaus ◽  
C. M. Grams ◽  
A. Schäfler ◽  
R. Westermann

Abstract. We present the application of interactive three-dimensional (3-D) visualization of ensemble weather predictions to forecasting warm conveyor belt situations during aircraft-based atmospheric research campaigns. Motivated by forecast requirements of the T-NAWDEX-Falcon 2012 (THORPEX – North Atlantic Waveguide and Downstream Impact Experiment) campaign, a method to predict 3-D probabilities of the spatial occurrence of warm conveyor belts (WCBs) has been developed. Probabilities are derived from Lagrangian particle trajectories computed on the forecast wind fields of the European Centre for Medium Range Weather Forecasts (ECMWF) ensemble prediction system. Integration of the method into the 3-D ensemble visualization tool Met.3D, introduced in the first part of this study, facilitates interactive visualization of WCB features and derived probabilities in the context of the ECMWF ensemble forecast. We investigate the sensitivity of the method with respect to trajectory seeding and grid spacing of the forecast wind field. Furthermore, we propose a visual analysis method to quantitatively analyse the contribution of ensemble members to a probability region and, thus, to assist the forecaster in interpreting the obtained probabilities. A case study, revisiting a forecast case from T-NAWDEX-Falcon, illustrates the practical application of Met.3D and demonstrates the use of 3-D and uncertainty visualization for weather forecasting and for planning flight routes in the medium forecast range (3 to 7 days before take-off).


2007 ◽  
Vol 12 ◽  
pp. 5-18 ◽  
Author(s):  
S. Federico ◽  
E. Avolio ◽  
C. Bellecci ◽  
A. Lavagnini ◽  
R. L. Walko

Abstract. This study investigates the sensitivity of a moderate-intense storm that occurred over Calabria, southern Italy, to upper-tropospheric forcing from a Potential Vorticity (PV) perspective. A prominent mid-troposheric trough can be identified for this event, which occurred between 22–24 May 2002, and serves as the precursor agent for the moderate-intense precipitation recorded. The working hypothesis is that the uncertainty in the representation of the upper-level disturbance has a major impact on the precipitation forecast and we test the hypothesis in a two-step approach. First, we examine the degree of uncertainty by comparing five different scenarios in a Limited area model Ensemble Prediction System (LEPS) framework which utilizes the height of the dynamical tropopause as the discriminating variable. Pseudo water vapour images of different scenarios are compared to the corresponding METEOSAT 7 water vapour image at a specific time, antecedent to the rain occurrence over Calabria, in order to evaluate the reliability of the different precipitation scenarios simulated by the LEPS. Second, we examine the impact of upper tropospheric PV variations on precipitation by comparing model simulations with slightly different initial PV fields. Initial velocity and mass fields in each case are balanced with the chosen PV perturbation using a PV inversion technique. The results of this study support the working hypothesis.


Author(s):  
Jingzhuo Wang ◽  
Jing Chen ◽  
Hanbin Zhang ◽  
Hua Tian ◽  
Yining Shi

AbstractEnsemble forecast is a method to faithfully describe initial and model uncertainties in a weather forecasting system. Initial uncertainties are much more important than model uncertainties in the short-range numerical prediction. Currently, initial uncertainties are described by Ensemble Transform Kalman Filter (ETKF) initial perturbation method in Global and Regional Assimilation and Prediction Enhanced System-Regional Ensemble Prediction System (GRAPES-REPS). However, an initial perturbation distribution similar to the analysis error cannot be yielded in the ETKF method of the GRAPES-REPS. To improve the method, we introduce a regional rescaling factor into the ETKF method (we call it ETKF_R). We also compare the results between the ETKF and ETKF_R methods and further demonstrate how rescaling can affect the initial perturbation characteristics as well as the ensemble forecast skills. The characteristics of the initial ensemble perturbation improve after applying the ETKF_R method. For example, the initial perturbation structures become more reasonable, the perturbations are better able to explain the forecast errors at short lead times, and the lower kinetic energy spectrum as well as perturbation energy at the initial forecast times can lead to a higher growth rate of themselves. Additionally, the ensemble forecast verification results suggest that the ETKF_R method has a better spread-skill relationship, a faster ensemble spread growth rate and a more reasonable rank histogram distribution than ETKF. Furthermore, the rescaling has only a minor impact on the assessment of the sharpness of probabilistic forecasts. The above results all suggest that ETKF_R can be effectively applied to the operational GRAPES-REPS.


2007 ◽  
Vol 10 ◽  
pp. 139-144 ◽  
Author(s):  
B. Ahrens ◽  
S. Jaun

Abstract. Spatial interpolation of precipitation data is uncertain. How important is this uncertainty and how can it be considered in evaluation of high-resolution probabilistic precipitation forecasts? These questions are discussed by experimental evaluation of the COSMO consortium's limited-area ensemble prediction system COSMO-LEPS. The applied performance measure is the often used Brier skill score (BSS). The observational references in the evaluation are (a) analyzed rain gauge data by ordinary Kriging and (b) ensembles of interpolated rain gauge data by stochastic simulation. This permits the consideration of either a deterministic reference (the event is observed or not with 100% certainty) or a probabilistic reference that makes allowance for uncertainties in spatial averaging. The evaluation experiments show that the evaluation uncertainties are substantial even for the large area (41 300 km2) of Switzerland with a mean rain gauge distance as good as 7 km: the one- to three-day precipitation forecasts have skill decreasing with forecast lead time but the one- and two-day forecast performances differ not significantly.


2021 ◽  
Author(s):  
Carlos Velasco-Forero ◽  
Jayaram Pudashine ◽  
Mark Curtis ◽  
Alan Seed

<div> <p>Short-term precipitation forecast plays a vital role for minimizing the adverse effects of heavy precipitation events such as flash flooding.  Radar rainfall nowcasting techniques based on statistical extrapolations are used to overcome current limitations of precipitation forecasts from numerical weather models, as they provide high spatial and temporal resolutions forecasts within minutes of the observation time. Among various algorithms, the Short-Term Ensemble Prediction System (STEPS) provides rainfall fields nowcasts in a probabilistic sense by accounting the uncertainty in the precipitation forecasts by means of ensembles, with spatial and temporal characteristic very similar to those in the observed radar rainfall fields. The Australian Bureau of Meteorology uses STEPS to generate ensembles of forecast rainfall ensembles in real-time from its extensive weather radar network. </p> </div><div> <p>In this study, results of a large probabilistic verification exercise to a new version of STEPS (hereafter named STEPS-3) are reported. An extensive dataset of more than 47000 individual 5-minute radar rainfall fields (the equivalent of more than 163 days of rain) from ten weather radars across Australia (covering tropical to mid-latitude regions) were used to generate (and verify) 96-member rainfall ensembles nowcasts with up to a 90-minute lead time. STEPS-3 was found to be more than 15-times faster in delivering results compared with previous version of STEPS and an open-source algorithm called pySTEPS. Interestingly, significant variations were observed in the quality of predictions and verification results from one radar to other, from one event to other, depending on the characteristics and location of the radar, nature of the rainfall event, accumulation threshold and lead time. For example, CRPS and RMSE of ensembles of 5-min rainfall forecasts for radars located in mid-latitude regions are better (lower) than those ones from radars located in tropical areas for all lead-times. Also, rainfall fields from S-band radars seem to produce rainfall forecasts able to successfully identify extreme rainfall events for lead times up to 10 minutes longer than those produced using C-band radar datasets for the same rain rate thresholds. Some details of the new STEPS-3 version, case studies and examples of the verification results will be presented. </p> </div>


2015 ◽  
Vol 30 (1) ◽  
pp. 217-237 ◽  
Author(s):  
Jing-Shan Hong ◽  
Chin-Tzu Fong ◽  
Ling-Feng Hsiao ◽  
Yi-Chiang Yu ◽  
Chian-You Tzeng

Abstract In this study, an ensemble typhoon quantitative precipitation forecast (ETQPF) model was developed to provide typhoon rainfall forecasts for Taiwan. The ETQPF rainfall forecast is obtained by averaging the pick-out cases, which are screened using certain criterion based on given typhoon tracks from an ensemble prediction system (EPS). Therefore, the ETQPF model resembles a climatology model. However, the ETQPF model uses the quantitative precipitation forecasts (QPFs) from an EPS instead of historical rainfall observations. Two typhoon cases, Fanapi (2010) and Megi (2010), are used to evaluate the ETQPF model performance. The results show that the rainfall forecast from the ETQPF model, which is qualitatively compared and quantitatively verified, provides reasonable typhoon rainfall forecasts and is valuable for real-time operational applications. By applying the forecast track to the ETQPF model, better track forecasts lead to better ETQPF rainfall forecasts. Moreover, the ETQPF model provides the “scenario” of the typhoon QPFs according to the uncertainty of the forecast tracks. Such a scenario analysis can provide valuable information for risk assessment and decision making in disaster prevention and reduction. Deficiencies of the ETQPF model are also presented, including that the average over the pick-out case usually offsets the extremes and reduces the maximum ETQPF rainfall, the underprediction is especially noticeable for weak phase-locked rainfall systems, and the ETQPF rainfall error is related to the model bias. Therefore, reducing model bias is an important issue in further improving the ETQPF model performance.


2013 ◽  
Vol 141 (10) ◽  
pp. 3498-3516 ◽  
Author(s):  
Luca Delle Monache ◽  
F. Anthony Eckel ◽  
Daran L. Rife ◽  
Badrinath Nagarajan ◽  
Keith Searight

Abstract This study explores an analog-based method to generate an ensemble [analog ensemble (AnEn)] in which the probability distribution of the future state of the atmosphere is estimated with a set of past observations that correspond to the best analogs of a deterministic numerical weather prediction (NWP). An analog for a given location and forecast lead time is defined as a past prediction, from the same model, that has similar values for selected features of the current model forecast. The AnEn is evaluated for 0–48-h probabilistic predictions of 10-m wind speed and 2-m temperature over the contiguous United States and against observations provided by 550 surface stations, over the 23 April–31 July 2011 period. The AnEn is generated from the Environment Canada (EC) deterministic Global Environmental Multiscale (GEM) model and a 12–15-month-long training period of forecasts and observations. The skill and value of AnEn predictions are compared with forecasts from a state-of-the-science NWP ensemble system, the 21-member Regional Ensemble Prediction System (REPS). The AnEn exhibits high statistical consistency and reliability and the ability to capture the flow-dependent behavior of errors, and it has equal or superior skill and value compared to forecasts generated via logistic regression (LR) applied to both the deterministic GEM (as in AnEn) and REPS [ensemble model output statistics (EMOS)]. The real-time computational cost of AnEn and LR is lower than EMOS.


Sign in / Sign up

Export Citation Format

Share Document