scholarly journals Seasonal forecast verification and application in times of change

2016 ◽  
Author(s):  
Yoav Levi ◽  
Itzhak Carmona

Abstract. Seasonal forecast is being promoted as one of the climate services given to the public and decision makers also in the extra-tropics. However seasonal forecast is a scientific challenge. Rapid changes in climate and the socio-economic environment in the past 30 years introduce even a bigger challenge for the end-users of seasonal forecasts based on the past 30 years. Decision makers should relay on a forecast only if they fully understand the forecast skill and the forecast will not be a completely erroneous.Therefore, the percentage of forecasts for above normal condition that realized to be below normal conditions and vice versa is measured straightforwardly by the "Fiasco score". To overcome the climate and socio-economic environment changes an attempt to relate the next seasonal forecast to the previous season forecast and observed values was tested.The findings indicate that ECMWF system-4 seasonal forecast skill for June-July-August (JJA) temperatures for the marine tropics is very promising as indicated by all the skill scores, including using the previous JJA forecast as the base for the next JJA season. However for the boreal summer temperatures forecast over land, the main source of the model predictability originates from the warming trend along the hindcast period. Over the Middle East and Mongolia removing the temperature trend eliminated the high forecast skill. Evaluation of the ability of the next season forecast to predict the changes relative to the previous year's season has shown a positive skill in some areas compared to the traditional 30 years based climatology after both forecasts and observed data were de-trend.

2020 ◽  
Vol 101 (8) ◽  
pp. E1413-E1426 ◽  
Author(s):  
Antje Weisheimer ◽  
Daniel J. Befort ◽  
Dave MacLeod ◽  
Tim Palmer ◽  
Chris O’Reilly ◽  
...  

Abstract Forecasts of seasonal climate anomalies using physically based global circulation models are routinely made at operational meteorological centers around the world. A crucial component of any seasonal forecast system is the set of retrospective forecasts, or hindcasts, from past years that are used to estimate skill and to calibrate the forecasts. Hindcasts are usually produced over a period of around 20–30 years. However, recent studies have demonstrated that seasonal forecast skill can undergo pronounced multidecadal variations. These results imply that relatively short hindcasts are not adequate for reliably testing seasonal forecasts and that small hindcast sample sizes can potentially lead to skill estimates that are not robust. Here we present new and unprecedented 110-year-long coupled hindcasts of the next season over the period 1901–2010. Their performance for the recent period is in good agreement with those of operational forecast models. While skill for ENSO is very high during recent decades, it is markedly reduced during the 1930s–1950s. Skill at the beginning of the twentieth century is, however, as high as for recent high-skill periods. Consistent with findings in atmosphere-only hindcasts, a midcentury drop in forecast skill is found for a range of atmospheric fields, including large-scale indices such as the NAO and the PNA patterns. As with ENSO, skill scores for these indices recover in the early twentieth century, suggesting that the midcentury drop in skill is not due to a lack of good observational data. A public dissemination platform for our hindcast data is available, and we invite the scientific community to explore them.


2020 ◽  
Author(s):  
Lisa Degenhardt ◽  
Gregor Leckebusch ◽  
Adam Scaife

<p>Severe Atlantic winter storms are affecting densely populated regions of Europe (e.g. UK, France, Germany, etc.). Consequently, different parts of the society, financial industry (e.g., insurance) and last but not least the general public are interested in skilful forecasts for the upcoming storm season (usually December to March). To allow for a best possible use of steadily improved seasonal forecasts, the understanding which factors contribute to realise forecast skill is essential and will allow for an assessment whether to expect a forecast to be skilful or not.</p><p>This study analyses the predictability of the seasonal forecast model of the UK MetOffice, the GloSea5. Windstorm events are identified and tracked following Leckebusch et al. (2008) via the exceedance of the 98<sup>th</sup> percentile of the near surface wind speed.</p><p>Seasonal predictability of windstorm frequency in comparison to observations (based e.g., on ERA5 reanalysis) are calculated and different statistical methods (skill scores) are compared.</p><p>Large scale patterns (e.g., NAO, AO, EAWR, etc.) and dynamical factors (e.g., Eady Growth Rate) are analysed and their predictability is assessed in comparison to storm frequency forecast skill. This will lead to an idea how the forecast skill of windstorms is depending on the forecast skill of forcing factors conditional to the phase of large-scale variability modes. Thus, we deduce information, which factors are most important to generate seasonal forecast skill for severe extra-tropical windstorms.</p><p>The results can be used to get a better understanding of the resulting skill for the upcoming windstorm season.</p>


2019 ◽  
Vol 147 (2) ◽  
pp. 607-625 ◽  
Author(s):  
Sarah Strazzo ◽  
Dan C. Collins ◽  
Andrew Schepen ◽  
Q. J. Wang ◽  
Emily Becker ◽  
...  

Abstract Recent research demonstrates that dynamical models sometimes fail to represent observed teleconnection patterns associated with predictable modes of climate variability. As a result, model forecast skill may be reduced. We address this gap in skill through the application of a Bayesian postprocessing technique—the calibration, bridging, and merging (CBaM) method—which previously has been shown to improve probabilistic seasonal forecast skill over Australia. Calibration models developed from dynamical model reforecasts and observations are employed to statistically correct dynamical model forecasts. Bridging models use dynamical model forecasts of relevant climate modes (e.g., ENSO) as predictors of remote temperature and precipitation. Bridging and calibration models are first developed separately using Bayesian joint probability modeling and then merged using Bayesian model averaging to yield an optimal forecast. We apply CBaM to seasonal forecasts of North American 2-m temperature and precipitation from the North American Multimodel Ensemble (NMME) hindcast. Bridging is done using the model-predicted Niño-3.4 index. Overall, the fully merged CBaM forecasts achieve higher Brier skill scores and better reliability compared to raw NMME forecasts. Bridging enhances forecast skill for individual NMME member model forecasts of temperature, but does not result in significant improvements in precipitation forecast skill, possibly because the models of the NMME better represent the ENSO–precipitation teleconnection pattern compared to the ENSO–temperature pattern. These results demonstrate the potential utility of the CBaM method to improve seasonal forecast skill over North America.


2021 ◽  
Author(s):  
Nicola Cortesi ◽  
Verónica Torralba ◽  
Llorenó Lledó ◽  
Andrea Manrique-Suñén ◽  
Nube Gonzalez-Reviriego ◽  
...  

AbstractIt is often assumed that weather regimes adequately characterize atmospheric circulation variability. However, regime classifications spanning many months and with a low number of regimes may not satisfy this assumption. The first aim of this study is to test such hypothesis for the Euro-Atlantic region. The second one is to extend the assessment of sub-seasonal forecast skill in predicting the frequencies of occurrence of the regimes beyond the winter season. Two regime classifications of four regimes each were obtained from sea level pressure anomalies clustered from October to March and from April to September respectively. Their spatial patterns were compared with those representing the annual cycle. Results highlight that the two regime classifications are able to reproduce most part of the patterns of the annual cycle, except during the transition weeks between the two periods, when patterns of the annual cycle resembling Atlantic Low regime are not also observed in any of the two classifications. Forecast skill of Atlantic Low was found to be similar to that of NAO+, the regime replacing Atlantic Low in the two classifications. Thus, although clustering yearly circulation data in two periods of 6 months each introduces a few deviations from the annual cycle of the regime patterns, it does not negatively affect sub-seasonal forecast skill. Beyond the winter season and the first ten forecast days, sub-seasonal forecasts of ECMWF are still able to achieve weekly frequency correlations of r = 0.5 for some regimes and start dates, including summer ones. ECMWF forecasts beat climatological forecasts in case of long-lasting regime events, and when measured by the fair continuous ranked probability skill score, but not when measured by the Brier skill score. Thus, more efforts have to be done yet in order to achieve minimum skill necessary to develop forecast products based on weather regimes outside winter season.


2011 ◽  
Vol 47 (2) ◽  
pp. 205-240 ◽  
Author(s):  
JAMES W. HANSEN ◽  
SIMON J. MASON ◽  
LIQIANG SUN ◽  
ARAME TALL

SUMMARYWe review the use and value of seasonal climate forecasting for agriculture in sub-Saharan Africa (SSA), with a view to understanding and exploiting opportunities to realize more of its potential benefits. Interaction between the atmosphere and underlying oceans provides the basis for probabilistic forecasts of climate conditions at a seasonal lead-time, including during cropping seasons in parts of SSA. Regional climate outlook forums (RCOF) and national meteorological services (NMS) have been at the forefront of efforts to provide forecast information for agriculture. A survey showed that African NMS often go well beyond the RCOF process to improve seasonal forecast information and disseminate it to the agricultural sector. Evidence from a combination of understanding of how climatic uncertainty impacts agriculture, model-based ex-ante analyses, subjective expressions of demand or value, and the few well-documented evaluations of actual use and resulting benefit suggests that seasonal forecasts may have considerable potential to improve agricultural management and rural livelihoods. However, constraints related to legitimacy, salience, access, understanding, capacity to respond and data scarcity have so far limited the widespread use and benefit from seasonal prediction among smallholder farmers. Those constraints that reflect inadequate information products, policies or institutional process can potentially be overcome. Additional opportunities to benefit rural communities come from expanding the use of seasonal forecast information for coordinating input and credit supply, food crisis management, trade and agricultural insurance. The surge of activity surrounding seasonal forecasting in SSA following the 1997/98 El Niño has waned in recent years, but emerging initiatives, such as the Global Framework for Climate Services and ClimDev-Africa, are poised to reinvigorate support for seasonal forecast information services for agriculture. We conclude with a discussion of institutional and policy changes that we believe will greatly enhance the benefits of seasonal forecasting to agriculture in SSA.


2020 ◽  
Vol 101 (2) ◽  
pp. E237-E252 ◽  
Author(s):  
C. D. Hewitt ◽  
E. Allis ◽  
S. J. Mason ◽  
M. Muth ◽  
R. Pulwarty ◽  
...  

Abstract There is growing awareness among governments, businesses, and the general public of risks arising from changes to our climate on time scales from months through to decades. Some climatic changes could be unprecedented in their harmful socioeconomic impacts, while others with adequate forewarning and planning could offer benefits. There is therefore a pressing need for decision-makers, including policy-makers, to have access to and to use high-quality, accessible, relevant, and credible climate information about the past, present, and future to help make better-informed decisions and policies. We refer to the provision and use of such information as climate services. Established programs of research and operational activities are improving observations and climate monitoring, our understanding of climate processes, climate variability and change, and predictions and projections of the future climate. Delivering climate information (including data and knowledge) in a way that is usable and useful for decision-makers has had less attention, and society has yet to optimally benefit from the available information. While weather services routinely help weather-sensitive decision-making, similar services for decisions on longer time scales are less well established. Many organizations are now actively developing climate services, and a growing number of decision-makers are keen to benefit from such services. This article describes progress made over the past decade developing, delivering, and using climate services, in particular from the worldwide effort galvanizing around the Global Framework for Climate Services under the coordination of UN agencies. The article highlights challenges in making further progress and proposes potential new directions to address such challenges.


2017 ◽  
Vol 32 (6) ◽  
pp. 2159-2174 ◽  
Author(s):  
Yuejian Zhu ◽  
Xiaqiong Zhou ◽  
Malaquias Peña ◽  
Wei Li ◽  
Christopher Melhauser ◽  
...  

Abstract The Global Ensemble Forecasting System (GEFS) is being extended from 16 to 35 days to cover the subseasonal period, bridging weather and seasonal forecasts. In this study, the impact of SST forcing on the extended-range land-only global 2-m temperature, continental United States (CONUS) accumulated precipitation, and MJO skill are explored with version 11 of the GEFS (GEFSv11) under various SST forcing configurations. The configurations consist of 1) the operational GEFS 90-day e-folding time of the observed real-time global SST (RTG-SST) anomaly relaxed to climatology, 2) an optimal AMIP configuration using the observed daily RTG-SST analysis, 3) a two-tier approach using the CFSv2-predicted daily SST, and 4) a two-tier approach using bias-corrected CFSv2-predicted SST, updated every 24 h. The experimental period covers the fall of 2013 and the winter of 2013/14. The results indicate that there are small differences in the ranked probability skill scores (RPSSs) between the various SST forcing experiments. The improvements in forecast skill of the Northern Hemisphere 2-m temperature and precipitation for weeks 3 and 4 are marginal, especially for North America. The bias-corrected CFSv2-predicted SST experiment generally delivers superior performance with statistically significant improvement in spatially and temporally aggregated 2-m temperature RPSSs over North America. Improved representation of the SST forcing (AMIP) increased the forecast skill for MJO indices up through week 2, but there is no significant improvement of the MJO forecast skill for weeks 3 and 4. These results are obtained over a short period with weak MJO activity and are also subject to internal model weaknesses in representing the MJO. Additional studies covering longer periods with upgraded model physics are warranted.


2013 ◽  
Vol 141 (9) ◽  
pp. 3154-3169 ◽  
Author(s):  
XiaoJing Jia ◽  
Hai Lin

Abstract The climate trend in a dynamical seasonal forecasting system is examined using 33-yr multimodel ensemble (MME) forecasts from the second phase of the Canadian Historical Forecasting Project (HFP2). It is found that the warming trend of the seasonal forecast in March–May (MAM) over the Eurasian continent is in a good agreement with that in the observations. However, the seasonal forecast failed to reproduce the observed pronounced surface air temperature (SAT) trend in December–February (DJF). The possible reasons responsible for the different behaviors of the HFP2 models in MAM and DJF are investigated. Results show that the initial conditions used for the HFP2 forecast system in MAM have a warming trend over the Eurasian continent, which may come from high-frequency weather systems, whereas the initial conditions for the DJF seasonal forecast do not have such a trend. This trend in the initial condition contributes to the trend of the seasonal forecast in the first month. On the other hand, an examination of the lower boundary SST anomaly forcing shows that the SST trend in MAM has a negative SST anomaly along the central equatorial Pacific, which is favorable for a positive phase of the North Atlantic Oscillation atmospheric response and a warming over the Eurasian continent. The long-term SST trend used for the seasonal forecast in DJF, however, has a negative trend in the tropical eastern Pacific, which is associated with a Pacific–North American pattern–like atmospheric response that has little contribution to a warming in the Eurasian continent.


2020 ◽  
Author(s):  
Ignacio Martin Santos ◽  
Mathew Herrnegger ◽  
Hubert Holzmann ◽  
Kristina Fröhlich ◽  
Jennifer Ostermüller

<p>In the last years, the demand of reliable seasonal streamflow forecasts has increased with the aim of incorporating them into decision support systems for e.g. river navigation, power plant operation  or drought risk management. Recently, the concept of “climate services” has gained stronger attention in Europe, thereby incorporating useful information derived from climate predictions and projections that support adaptation, mitigation and disaster risk management. In the frame of one of these climate services currently in development, Clim2Power project, a seasonal forecast system for discharge in the Upper Danube upstream Vienna has been established.</p><p>Seasonal forecasts are generated using a dynamical approach running a hydrological model (COSERO) with forecasted climate input provided by DWD (Germany's National Meterological Service). The climate forecasts are based on a large ensemble of predictions, available up to 6 months. After the application of a statistical downscaling method, the climate forecasts have a spatial resolution of 6km. The predictability is related to two main contributions: meteorological forcings (i.e. temperature and precipitation predictability) and initial basin states at the time the forecast is issued.</p><p>The Upper Danube basin with a catchment area of approx. 100.000 km<sup>2</sup> is characterized by complex topography dominated by the Alps, elevations range from about 150 m to slightly under 4000 m. Therefore, the skill of the seasonal forecast is highly influenced by the resolution of the meteorological data, and likewise by the hydrological processes that take place, especially, regarding melting processes. Downscaled hindcasts over the last 20 years, generated with the identical setup as the seasonal forecasts, are used in this contribution to assess the skill of the seasonal forecasts. In addition, some post-processing corrections, based on historical observations, are used to adjust the bias of the forecasts. Nevertheless, remaining non-systematic error patterns do not allow complete bias correction. Apart from the biases, also the correlation patterns show a limited skill. We conclude that the seasonal discharge forecasting is still not sufficient to incorporate the results into water resources decision support systems within the studied Alpine basins.</p>


Sign in / Sign up

Export Citation Format

Share Document