scholarly journals On the Sensitivity Equations of Four-Dimensional Variational (4D-Var) Data Assimilation

2008 ◽  
Vol 136 (8) ◽  
pp. 3050-3065 ◽  
Author(s):  
Dacian N. Daescu
Keyword(s):  
Data Assimilation ◽  
Forecast Error ◽  
Computational Effort ◽  
Water Model ◽  
Error Statistics ◽  
Background Error ◽  
Practical Applications ◽  
Error Covariance ◽  
Sensitivity Equations ◽  
The Impact

Abstract The equations of the forecast sensitivity to observations and to the background estimate in a four-dimensional variational data assimilation system (4D-Var DAS) are derived from the first-order optimality condition in unconstrained minimization. Estimation of the impact of uncertainties in the specification of the error statistics is considered by evaluating the sensitivity to the observation and background error covariance matrices. The information provided by the error covariance sensitivity analysis is used to identify the input components for which improved estimates of the statistical properties of the errors are of most benefit to the analysis and forecast. A close relationship is established between the sensitivities within each input pair data/error covariance such that once the observation and background sensitivities are available the evaluation of the sensitivity to the specification of the corresponding error statistics requires little additional computational effort. The relevance of the 4D-Var sensitivity equations to assess the data impact in practical applications is discussed. Computational issues are addressed and idealized 4D-Var experiments are set up with a finite-volume shallow-water model to illustrate the theoretical concepts. Time-dependent observation sensitivity and potential applications to improve the model forecast are presented. Guidance provided by the sensitivity fields is used to adjust a 4D-Var DAS to achieve forecast error reduction through assimilation of supplementary data and through an accurate specification of a few of the background error variances.

scholarly journals Multivariate Error Covariance Estimates by Monte Carlo Simulation for Assimilation Studies in the Pacific Ocean

2005 ◽  
Vol 133 (8) ◽  
pp. 2310-2334 ◽  
Author(s):  
Anna Borovikov ◽  
Michele M. Rienecker ◽  
Christian L. Keppenne ◽  
Gregory C. Johnson
Keyword(s):  
Monte Carlo ◽  
Data Assimilation ◽  
Forecast Error ◽  
Independent Set ◽  
Velocity Fields ◽  
Optimal Interpolation ◽  
Model Errors ◽  
Error Statistics ◽  
Practical Applications ◽  
Monte Carlo Techniques

Abstract One of the most difficult aspects of ocean-state estimation is the prescription of the model forecast error covariances. The paucity of ocean observations limits our ability to estimate the covariance structures from model–observation differences. In most practical applications, simple covariances are usually prescribed. Rarely are cross covariances between different model variables used. Here a comparison is made between a univariate optimal interpolation (UOI) scheme and a multivariate OI algorithm (MvOI) in the assimilation of ocean temperature profiles. In the UOI case only temperature is updated using a Gaussian covariance function. In the MvOI, salinity, zonal, and meridional velocities as well as temperature are updated using an empirically estimated multivariate covariance matrix. Earlier studies have shown that a univariate OI has a detrimental effect on the salinity and velocity fields of the model. Apparently, in a sequential framework it is important to analyze temperature and salinity together. For the MvOI an estimate of the forecast error statistics is made by Monte Carlo techniques from an ensemble of model forecasts. An important advantage of using an ensemble of ocean states is that it provides a natural way to estimate cross covariances between the fields of different physical variables constituting the model-state vector, at the same time incorporating the model’s dynamical and thermodynamical constraints as well as the effects of physical boundaries. Only temperature observations from the Tropical Atmosphere–Ocean array have been assimilated in this study. To investigate the efficacy of the multivariate scheme, two data assimilation experiments are validated with a large independent set of recently published subsurface observations of salinity, zonal velocity, and temperature. For reference, a control run with no data assimilation is used to check how the data assimilation affects systematic model errors. While the performance of the UOI and MvOI is similar with respect to the temperature field, the salinity and velocity fields are greatly improved when the multivariate correction is used, as is evident from the analyses of the rms differences between these fields and independent observations. The MvOI assimilation is found to improve upon the control run in generating water masses with properties close to the observed, while the UOI fails to maintain the temperature and salinity structure.

scholarly journals Interpretation of Adaptive Observing Guidance for Atlantic Tropical Cyclones

2007 ◽  
Vol 135 (12) ◽  
pp. 4006-4029 ◽  
Author(s):  
C. A. Reynolds ◽  
M. S. Peng ◽  
S. J. Majumdar ◽  
S. D. Aberson ◽  
C. H. Bishop ◽  
...  
Keyword(s):  
Data Assimilation ◽  
Total Energy ◽  
Tropical Cyclones ◽  
Error Variance ◽  
Naval Research ◽  
Error Statistics ◽  
Background Error ◽  
Analysis Error ◽  
The Impact ◽  
Perturbation Growth

Abstract Adaptive observing guidance products for Atlantic tropical cyclones are compared using composite techniques that allow one to quantitatively examine differences in the spatial structures of the guidance maps and relate these differences to the constraints and approximations of the respective techniques. The guidance maps are produced using the ensemble transform Kalman filter (ETKF) based on ensembles from the National Centers for Environmental Prediction and the European Centre for Medium-Range Weather Forecasts (ECMWF), and total-energy singular vectors (TESVs) produced by ECMWF and the Naval Research Laboratory. Systematic structural differences in the guidance products are linked to the fact that TESVs consider the dynamics of perturbation growth only, while the ETKF combines information on perturbation evolution with error statistics from an ensemble-based data assimilation scheme. The impact of constraining the SVs using different estimates of analysis error variance instead of a total-energy norm, in effect bringing the two methods closer together, is also assessed. When the targets are close to the storm, the TESV products are a maximum in an annulus around the storm, whereas the ETKF products are a maximum at the storm location itself. When the targets are remote from the storm, the TESVs almost always indicate targets northwest of the storm, whereas the ETKF targets are more scattered relative to the storm location and often occur over the northern North Atlantic. The ETKF guidance often coincides with locations in which the ensemble-based analysis error variance is large. As the TESV method is not designed to consider spatial differences in the likely analysis errors, it will produce targets over well-observed regions, such as the continental United States. Constraining the SV calculation using analysis error variance values from an operational 3D variational data assimilation system (with stationary, quasi-isotropic background error statistics) results in a modest modulation of the target areas away from the well-observed regions, and a modest reduction of perturbation growth. Constraining the SVs using the ETKF estimate of analysis error variance produces SV targets similar to ETKF targets and results in a significant reduction in perturbation growth, due to the highly localized nature of the analysis error variance estimates. These results illustrate the strong sensitivity of SVs to the norm (and to the analysis error variance estimate used to define it) and confirm that discrepancies between target areas computed using different methods reflect the mathematical and physical differences between the methods themselves.

scholarly journals Improvements in Forecasting Intense Rainfall: Results from the FRANC (Forecasting Rainfall Exploiting New Data Assimilation Techniques and Novel Observations of Convection) Project

Atmosphere ◽  
2019 ◽  
Vol 10 (3) ◽  
pp. 125 ◽  
Author(s):  
Sarah Dance ◽  
Susan Ballard ◽  
Ross Bannister ◽  
Peter Clark ◽  
Hannah Cloke ◽  
...  
Keyword(s):  
Data Assimilation ◽  
Doppler Radar ◽  
Weather Prediction ◽  
Observation Error ◽  
Error Statistics ◽  
Convective Rainfall ◽  
Background Error ◽  
Spatially Correlated ◽  
Operational Forecasts ◽  
The Impact

The FRANC project (Forecasting Rainfall exploiting new data Assimilation techniques and Novel observations of Convection) has researched improvements in numerical weather prediction of convective rainfall via the reduction of initial condition uncertainty. This article provides an overview of the project’s achievements. We highlight new radar techniques: correcting for attenuation of the radar return; correction for beams that are over 90% blocked by trees or towers close to the radar; and direct assimilation of radar reflectivity and refractivity. We discuss the treatment of uncertainty in data assimilation: new methods for estimation of observation uncertainties with novel applications to Doppler radar winds, Atmospheric Motion Vectors, and satellite radiances; a new algorithm for implementation of spatially-correlated observation error statistics in operational data assimilation; and innovative treatment of moist processes in the background error covariance model. We present results indicating a link between the spatial predictability of convection and convective regimes, with potential to allow improved forecast interpretation. The research was carried out as a partnership between University researchers and the Met Office (UK). We discuss the benefits of this approach and the impact of our research, which has helped to improve operational forecasts for convective rainfall events.

Reducing TC Position Uncertainty in an Ensemble Data Assimilation and Prediction System: A Case Study of Typhoon Fanapi (2010)

2018 ◽  
Vol 33 (2) ◽  
pp. 561-582 ◽  
Author(s):  
Kuan-Jen Lin ◽  
Shu-Chih Yang ◽  
Shuyi S. Chen
Keyword(s):  
Data Assimilation ◽  
Negative Impact ◽  
Wrf Model ◽  
Track Forecast ◽  
Background Error ◽  
Position Uncertainty ◽  
Background Error Covariance ◽  
Error Covariance ◽  
The Impact

Abstract Ensemble-based data assimilation (EDA) has been used for tropical cyclone (TC) analysis and prediction with some success. However, the TC position spread determines the structure of the TC-related background error covariance and affects the performance of EDA. With an idealized experiment and a real TC case study, it is demonstrated that observations in the core region cannot be optimally assimilated when the TC position spread is large. To minimize the negative impact from large position uncertainty, a TC-centered EDA approach is implemented in the Weather Research and Forecasting (WRF) Model–local ensemble transform Kalman filter (WRF-LETKF) assimilation system. The impact of TC-centered EDA on TC analysis and prediction of Typhoon Fanapi (2010) is evaluated. Using WRF Model nested grids with 4-km grid spacing in the innermost domain, the focus is on EDA using dropsonde data from the Impact of Typhoons on the Ocean in the Pacific field campaign. The results show that the TC structure in the background mean state is improved and that unrealistically large ensemble spread can be alleviated. The characteristic horizontal scale in the background error covariance is smaller and narrower compared to those derived from the conventional EDA approach. Storm-scale corrections are improved using dropsonde data, which is more favorable for TC development. The analysis using the TC-centered EDA is in better agreement with independent observations. The improved analysis ameliorates model shock and improves the track forecast during the first 12 h and landfall at 72 h. The impact on intensity prediction is mixed with a better minimum sea level pressure and overestimated peak winds.

Evaluating Ensemble Kalman Filter Analyses of Severe Hailstorms on 8 May 2017 in Colorado: Effects of State Variable Updating and Multimoment Microphysics Schemes on State Variable Cross Covariances

2020 ◽  
Vol 148 (6) ◽  
pp. 2365-2389
Author(s):  
Jonathan Labriola ◽  
Nathan Snook ◽  
Youngsun Jung ◽  
Ming Xue
Keyword(s):  
Kalman Filter ◽  
Ensemble Kalman Filter ◽  
Forecast Error ◽  
Variable Cross ◽  
Background Error ◽  
Mixing Ratios ◽  
State Variable ◽  
Error Covariance ◽  
Thermodynamic Variables ◽  
The Impact

Abstract Ensemble Kalman filter (EnKF) analyses of the storms associated with the 8 May 2017 Colorado severe hail event using either the Milbrandt and Yau (MY) or the NSSL double-moment bulk microphysics scheme in the forecast model are evaluated. With each scheme, two experiments are conducted in which the reflectivity (Z) observations update in addition to dynamic and thermodynamic variables: 1) only the hydrometeor mixing ratios or 2) all microphysical variables. With fewer microphysical variables directly constrained by the Z observations, only updating hydrometeor mixing ratios causes the forecast error covariance structure to become unreliable, and results in larger errors in the analysis. Experiments that update all microphysical variables produce analyses with the lowest Z root-mean-square innovations; however, comparing the estimated hail size against hydrometeor classification algorithm output suggests that further constraint from observations is needed to more accurately estimate surface hail size. Ensemble correlation analyses are performed to determine the impact of hail growth assumptions in the MY and NSSL schemes on the forecast error covariance between microphysical and thermodynamic variables. In the MY scheme, Z is negatively correlated with updraft intensity because the strong updrafts produce abundant small hail aloft. The NSSL scheme predicts the growth of large hail aloft; consequently, Z is positively correlated with storm updraft intensity and hail state variables. Hail production processes are also shown to alter the background error covariance for liquid and frozen hydrometeor species. Results in this study suggest that EnKF analyses are sensitive to the choice of MP scheme (e.g., the treatment of hail growth processes).

scholarly journals Impact of variational assimilation using multivariate background error covariances on the simulation of monsoon depressions over India

2016 ◽  
Vol 34 (2) ◽  
pp. 187-201 ◽  
Author(s):  
M. Dhanya ◽  
A. Chandrasekar
Keyword(s):  
Data Assimilation ◽  
Rainfall Simulation ◽  
Initial Time ◽  
Temperature Structure ◽  
Error Statistics ◽  
Background Error ◽  
Skill Scores ◽  
Correlation Information ◽  
Monsoon Depressions ◽  
The Impact

Abstract. The background error covariance structure influences a variational data assimilation system immensely. The simulation of a weather phenomenon like monsoon depression can hence be influenced by the background correlation information used in the analysis formulation. The Weather Research and Forecasting Model Data assimilation (WRFDA) system includes an option for formulating multivariate background correlations for its three-dimensional variational (3DVar) system (cv6 option). The impact of using such a formulation in the simulation of three monsoon depressions over India is investigated in this study. Analysis and forecast fields generated using this option are compared with those obtained using the default formulation for regional background error correlations (cv5) in WRFDA and with a base run without any assimilation. The model rainfall forecasts are compared with rainfall observations from the Tropical Rainfall Measurement Mission (TRMM) and the other model forecast fields are compared with a high-resolution analysis as well as with European Centre for Medium-Range Weather Forecasts (ECMWF) ERA-Interim reanalysis. The results of the study indicate that inclusion of additional correlation information in background error statistics has a moderate impact on the vertical profiles of relative humidity, moisture convergence, horizontal divergence and the temperature structure at the depression centre at the analysis time of the cv5/cv6 sensitivity experiments. Moderate improvements are seen in two of the three depressions investigated in this study. An improved thermodynamic and moisture structure at the initial time is expected to provide for improved rainfall simulation. The results of the study indicate that the skill scores of accumulated rainfall are somewhat better for the cv6 option as compared to the cv5 option for at least two of the three depression cases studied, especially at the higher threshold levels. Considering the importance of utilising improved flow-dependent correlation structures for efficient data assimilation, the need for more studies on the impact of background error covariances is obvious.

scholarly journals Generalized background error covariance matrix model (GEN_BE v2.0)

2015 ◽  
Vol 8 (3) ◽  
pp. 669-696 ◽  
Author(s):  
G. Descombes ◽  
T. Auligné ◽  
F. Vandenberghe ◽  
D. M. Barker ◽  
J. Barré
Keyword(s):  
Data Assimilation ◽  
Covariance Matrix ◽  
Chemical Species ◽  
Variational Data Assimilation ◽  
Control Variables ◽  
Background Error ◽  
Error Covariance Matrix ◽  
Background Error Covariance ◽  
Error Covariance ◽  
The Impact

Abstract. The specification of state background error statistics is a key component of data assimilation since it affects the impact observations will have on the analysis. In the variational data assimilation approach, applied in geophysical sciences, the dimensions of the background error covariance matrix (B) are usually too large to be explicitly determined and B needs to be modeled. Recent efforts to include new variables in the analysis such as cloud parameters and chemical species have required the development of the code to GENerate the Background Errors (GEN_BE) version 2.0 for the Weather Research and Forecasting (WRF) community model. GEN_BE allows for a simpler, flexible, robust, and community-oriented framework that gathers methods used by some meteorological operational centers and researchers. We present the advantages of this new design for the data assimilation community by performing benchmarks of different modeling of B and showing some of the new features in data assimilation test cases. As data assimilation for clouds remains a challenge, we present a multivariate approach that includes hydrometeors in the control variables and new correlated errors. In addition, the GEN_BE v2.0 code is employed to diagnose error parameter statistics for chemical species, which shows that it is a tool flexible enough to implement new control variables. While the generation of the background errors statistics code was first developed for atmospheric research, the new version (GEN_BE v2.0) can be easily applied to other domains of science and chosen to diagnose and model B. Initially developed for variational data assimilation, the model of the B matrix may be useful for variational ensemble hybrid methods as well.

scholarly journals Representing model error in ensemble data assimilation

2014 ◽  
Vol 21 (5) ◽  
pp. 971-985 ◽  
Author(s):  
C. Cardinali ◽  
N. Žagar ◽  
G. Radnoti ◽  
R. Buizza
Keyword(s):  
Data Assimilation ◽  
Covariance Matrix ◽  
Model Error ◽  
The Other ◽  
Error Statistics ◽  
Model Uncertainties ◽  
Background Error ◽  
Error Covariance ◽  
Ensemble Data ◽  
Assimilation System

Abstract. The paper investigates a method to represent model error in the ensemble data assimilation (EDA) system. The ECMWF operational EDA simulates the effect of both observations and model uncertainties. Observation errors are represented by perturbations with statistics characterized by the observation error covariance matrix whilst the model uncertainties are represented by stochastic perturbations added to the physical tendencies to simulate the effect of random errors in the physical parameterizations (ST-method). In this work an alternative method (XB-method) is proposed to simulate model uncertainties by adding perturbations to the model background field. In this way the error represented is not just restricted to model error in the usual sense but potentially extends to any form of background error. The perturbations have the same correlation as the background error covariance matrix and their magnitude is computed from comparing the high-resolution operational innovation variances with the ensemble variances when the ensemble is obtained by perturbing only the observations (OBS-method). The XB-method has been designed to represent the short range model error relevant for the data assimilation window. Spread diagnostic shows that the XB-method generates a larger spread than the ST-method that is operationally used at ECMWF, in particular in the extratropics. Three-dimensional normal-mode diagnostics indicate that XB-EDA spread projects more than the spread from the other EDAs onto the easterly inertia-gravity modes associated with equatorial Kelvin waves, tropical dynamics and, in general, model error sources. The background error statistics from the above described EDAs have been employed in the assimilation system. The assimilation system performance showed that the XB-method background error statistics increase the observation influence in the analysis process. The other EDA background error statistics, when inflated by a global factor, generate analyses with 30–50% smaller degree of freedom of signal. XB-EDA background error variances have not been inflated. The presented EDAs have been used to generate the initial perturbations of the ECMWF ensemble prediction system (EPS) of which the XB-EDA induces the largest EPS spread, also in the medium range, leading to a more reliable ensemble. Compared to ST-EDA, XB-EDA leads to a small improvement of the EPS ignorance skill score at day 3 and 7.

scholarly journals Forecast Sensitivity Observation Impact in the 4DVAR and Hybrid-4DVAR Data Assimilation Systems

2019 ◽  
Vol 36 (8) ◽  
pp. 1563-1575 ◽  
Author(s):  
Sung-Min Kim ◽  
Hyun Mee Kim
Keyword(s):  
Data Assimilation ◽  
East Asia ◽  
Forecast Error ◽  
Integration Time ◽  
Ensemble Forecasts ◽  
Background Error ◽  
Error Covariance ◽  
Atmospheric Motion ◽  
Observation Impact ◽  
Atmospheric Motion Vectors

AbstractIn this study, the observation impacts on 24-h forecast error reduction (FER), based on the adjoint method in the four-dimensional variational (4DVAR) data assimilation (DA) and hybrid-4DVAR DA systems coupled with the Unified Model, were evaluated from 0000 UTC 5 August to 1800 UTC 26 August 2014. The nonlinear FER in hybrid-4DVAR was 12.2% greater than that in 4DVAR due to the use of flow-dependent background error covariance (BEC), which was a weighted combination of the static BEC and the ensemble BEC based on ensemble forecasts. In hybrid-4DVAR, the observation impacts (i.e., the approximated nonlinear FER) for most observation types increase compared to those in 4DVAR. The increased observation impact from using hybrid-4DVAR instead of 4DVAR changes depending on the analysis time and regions. To calculate the ensemble BEC in hybrid-4DVAR, analyses at 0600 and 1800 UTC (0000 and 1200 UTC) used 3-h (9-h) ensemble forecasts. Greater observation impact was obtained when 3-h ensemble forecasts were used for the ensemble BEC at 0600 and 1800 UTC, than with 9-h ensemble forecasts at 0000 and 1200 UTC. Different from other observations, the atmospheric motion vectors (AMVs) deduced from geostationary satellite are more frequently observed in the same area. When the ensemble forecasts with longer integration times were used for the ensemble BEC in hybrid-4DVAR, the observation impact of the AMVs decreased the most in East Asia. This implies that the observation impact of AMVs in East Asia shows the highest sensitivity to the integration time of the ensemble members used for deducing the flow-dependent BEC in hybrid-4DVAR.

Comparisons of Hybrid En3DVar with 3DVar and EnKF for Radar Data Assimilation: Tests with the 10 May 2010 Oklahoma Tornado Outbreak

2021 ◽  
Vol 149 (1) ◽  
pp. 21-40
Author(s):  
Rong Kong ◽  
Ming Xue ◽  
Chengsi Liu ◽  
Youngsun Jung
Keyword(s):  
Data Assimilation ◽  
Radial Velocity ◽  
Forecast Error ◽  
Radar Data ◽  
Separate Analysis ◽  
Background Error ◽  
Mixing Ratios ◽  
Error Covariance ◽  
Radial Velocity Data ◽  
Made In

AbstractIn this study, a hybrid En3DVar data assimilation (DA) scheme is compared with 3DVar, EnKF, and pure En3DVar for the assimilation of radar data in a real tornadic storm case. Results using hydrometeor mixing ratios (CVq) or logarithmic mixing ratios (CVlogq) as the control variables are compared in the variational DA framework. To address the lack of radial velocity impact issues when using CVq, a procedure that assimilates reflectivity and radial velocity data in two separate analysis passes is adopted. Comparisons are made in terms of the root-mean-square innovations (RMSIs) as well as the intensity and structure of the analyzed and forecast storms. For pure En3DVar that uses 100% ensemble covariance, CVlogq and CVq have similar RMSIs in the velocity analyses, but errors grow faster during forecasts when using CVlogq. Introducing static background error covariance at 5% in hybrid En3DVar (with CVlogq) significantly reduces the forecast error growth. Pure En3DVar produces more intense reflectivity analyses than EnKF that more closely match the observations. Hybrid En3DVar with 50% outperforms other weights in terms of the RMSIs and forecasts of updraft helicity and is thus used in the final comparison with 3DVar and EnKF. The hybrid En3DVar is found to outperform EnKF in better capturing the intensity and structure of the analyzed and forecast storms and outperform 3DVAR in better capturing the intensity and evolution of the rotating updraft.

Sign in / Sign up

Export Citation Format

Share Document