journal article·2025-06-06Open access

An Adaptive Variance Adjustment Strategy for a Static Background Error Covariance Matrix—Part I: Verification in the Lorenz-96 Model

Lilan Huang, Hongze Leng, Junqiang Song, Dongzi Wang, Wuxin Wang, Ruisheng Hu, Hang Cao

Applied Sciences· Volume 15· Issue 12

Abstract

Accurate initial conditions are crucial for improving numerical weather prediction (NWP). Variational data assimilation relies on a static background error covariance matrix (B), yet its variance estimation is often inaccurate, affecting assimilation and forecast performance. This study introduces DRL-AST, a deep reinforcement learning-based adaptive variance rescaling strategy that dynamically adjusts the variances of B to optimize forecast skill through improved assimilation performance. By formulating variance rescaling as a Markov Decision Process and employing an actor–critic framework with Proximal Policy Optimization, DRL-AST autonomously selects spatio-temporal rescaling factors, enhancing assimilation and forecast accuracy without additional computational cost. As a new paradigm for adaptive variance tuning, DRL-AST demonstrates competitive improvements in forecast skill in experiments with the Lorenz-96 model by generating initial states that better conform to model dynamical consistency. Given its adaptability and efficiency, DRL-AST holds great potential for application in high-dimensional NWP models, where deep learning-based dimensionality reduction and reinforcement learning techniques could further enhance its feasibility and effectiveness in complex assimilation frameworks.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Statistical and numerical algorithms · Structural Health Monitoring Techniques · Meteorological Phenomena and Simulations

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China

College of Meteorology and Oceanography, National University of Defense Technology, Changsha 410073, China

Funding

National Key R&D Program of China · National Natural Science Foundation of China · Natural Science Foundation of Hunan Province, China

References (75)

Show source-provided references
1. The quiet revolution of numerical weather prediction10.1038/nature14956 ↗
2. The physical basis of long-range weather forecasts10.1175/1520-0493(1901)29[551c:TPBOLW]2.0.CO;2 ↗
3. Verhulst, F. (2012). Nonlinear Differential Equations and Dynamical Systems, Springer Science & Business Media.10.1007/978-1-4614-2407-9_9 ↗
4. Richardson, L.F. (1922). Weather Prediction by Numerical Process, Cambridge University Press.
5. Determining Lyapunov exponents from a time series10.1016/0167-2789(85)90011-9 ↗
6. Small denominators and problems of stability of motion in classical and celestial mechanics10.1070/RM1963v018n06ABEH001143 ↗
7. Arnold, V.I. (2012). Geometrical Methods in the Theory of Ordinary Differential Equations, Springer Science & Business Media.
8. Synchronization in chaotic systems10.1103/PhysRevLett.64.821 ↗
9. Data assimilation and its applications10.1073/pnas.97.21.11143 ↗
10. Assimilation of observations, an introduction10.2151/jmsj1965.75.1B_191 ↗
11. Daley, R. (1993). Atmospheric Data Analysis, Cambridge University Press.
12. Asch, M., Bocquet, M., and Nodet, M. (2016). Data Assimilation: Methods, Algorithms, and Applications, SIAM.10.1137/1.9781611974546 ↗
13. The future of Earth system prediction: Advances in model-data fusion10.1126/sciadv.abn3488 ↗
14. Data assimilation in the geosciences: An overview of methods, issues, and perspectives10.1002/wcc.535 ↗
15. A North American hourly assimilation and model forecast cycle: The Rapid Refresh10.1175/MWR-D-15-0242.1 ↗
16. The High-Resolution Rapid Refresh (HRRR): An hourly updating convection-allowing forecast model. Part I: Motivation and system description10.1175/WAF-D-21-0151.1 ↗
17. A review of operational methods of variational and ensemble-variational data assimilation10.1002/qj.2982 ↗
18. A review of forecast error covariance statistics in atmospheric variational data assimilation. II: Modelling the forecast error covariance statistics
19. A review of forecast error covariance statistics in atmospheric variational data assimilation. I: Characteristics and measurements of forecast error covariances
20. A hybrid variational ensemble data assimilation for the HIgh Resolution Limited Area Model (HIRLAM)10.5194/npg-21-303-2014 ↗
21. A review of innovation-based methods to jointly estimate model and observation error covariance matrices in ensemble data assimilation10.1175/MWR-D-19-0240.1 ↗
22. The National Meteorological Center’s spectral statistical-interpolation analysis system
23. On the use of EDA background error variances in the ECMWF 4D-Var10.1002/qj.1899 ↗
24. Enhancing the impact of IASI observations through an updated observation-error covariance matrix10.1002/qj.2774 ↗
25. Three-dimensional variational assimilation with a multivariate background error covariance for the Model for Prediction Across Scales—Atmosphere with the Joint Effort for Data assimilation Integration (JEDI-MPAS 2.0. 0-beta)10.5194/gmd-17-3879-2024 ↗
26. Reinforcement learning
27. Deep reinforcement learning: A brief survey10.1109/MSP.2017.2743240 ↗
28. A Markovian decision process10.1512/iumj.1957.6.56038 ↗
29. A reformulation of the background error covariance in the ECMWF global data assimilation system10.3402/tellusa.v51i2.12316 ↗
30. Diagnosis of observation, background and analysis-error statistics in observation space
31. Background error covariance iterative updating with invariant observation measures for data assimilation10.1007/s00477-019-01743-6 ↗
32. Formulation and use of 3D-hybrid and 4D-hybrid ensemble covariances in the Météo-France global data assimilation system10.1002/qj.4603 ↗
33. Deep learning and process understanding for data-driven Earth system science10.1038/s41586-019-0912-1 ↗
34. Physics-informed machine learning10.1038/s42254-021-00314-5 ↗
35. Learning skillful medium-range global weather forecasting10.1126/science.adi2336 ↗
36. Skilful nowcasting of extreme precipitation with NowcastNet10.1038/s41586-023-06184-4 ↗
37. Accurate medium-range global weather forecasting with 3D neural networks10.1038/s41586-023-06185-3 ↗
38. Machine learning with data assimilation and uncertainty quantification for dynamical systems: A review10.1109/JAS.2023.123537 ↗
39. Observation error covariance specification in dynamical systems for data assimilation using recurrent neural networks10.1007/s00521-021-06739-4 ↗
40. Data assimilation in chaotic systems using deep reinforcement learning10.1029/2023MS004178 ↗
41. Review of the ensemble Kalman filter for atmospheric data assimilation
42. Data assimilation for urban stormwater and water quality simulations using deep reinforcement learning10.1016/j.jhydrol.2023.129973 ↗
43. A novel dynamic ensemble of numerical weather prediction for multi-step wind speed forecasting with deep reinforcement learning and error sequence modeling10.1016/j.energy.2024.131787 ↗
44. A Reinforcement Learning-Based Ensemble Forecasting Framework for Renewable Energy Forecasting10.1016/j.renene.2025.122692 ↗
45. Saxena, D.M., Bae, S., Nakhaei, A., Fujimura, K., and Likhachev, M. (August, January 31). Driving in dense traffic with model-free reinforcement learning. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.10.1109/ICRA40945.2020.9197132 ↗
46. Mastering the game of Go with deep neural networks and tree search10.1038/nature16961 ↗
47. Deep direct reinforcement learning for financial signal representation and trading10.1109/TNNLS.2016.2522401 ↗
48. Optimal sites for supplementary weather observations: Simulation with a small model10.1175/1520-0469(1998)055<0399:OSFSWO>2.0.CO;2 ↗
49. A statistical hypothesis testing strategy for adaptively blending particle filters and ensemble Kalman filters for data assimilation10.1175/MWR-D-22-0108.1 ↗
50. The Gaussian approach to adaptive covariance inflation and its implementation with the local ensemble transform Kalman filter10.1175/2010MWR3570.1 ↗
51. Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning: An Introduction, MIT Press.10.1109/TNN.1998.712192 ↗
52. Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2015). Continuous control with deep reinforcement learning. arXiv.
53. Duan, Y., Chen, X., Houthooft, R., Schulman, J., and Abbeel, P. (2016, January 19–24). Benchmarking deep reinforcement learning for continuous control. Proceedings of the ICML’16: Proceedings of the 33rd International Conference on International Conference on Machine Learning, New York, NY, USA.
54. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal policy optimization algorithms. arXiv.
55. Schulman, J., Moritz, P., Levine, S., Jordan, M., and Abbeel, P. (2015). High-dimensional continuous control using generalized advantage estimation. arXiv.
56. Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., and Meger, D. (2018, January 2–7). Deep reinforcement learning that matters. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.10.1609/aaai.v32i1.11694 ↗
57. Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25–29). Learning phrase representations using RNN encoder-decoder for statistical machine translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1179 ↗
58. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified linear units improve restricted boltzmann machines. Proceedings of the 27th International Conference on Machine Learning (ICML-10), Haifa, Israel.
59. Ba, J.L., Kiros, J.R., and Hinton, G.E. (2016). Layer normalization. arXiv.
60. On serial observation processing in localized ensemble Kalman filters10.1175/MWR-D-14-00182.1 ↗
61. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8–14). PyTorch: An Imperative Style, High-Performance Deep Learning Library. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.
62. A four-dimensional variational constrained neural network-based data assimilation method10.1029/2023MS003687 ↗
63. Assessing the fidelity of predictability estimates10.1007/s00382-017-3903-7 ↗
64. Combining data assimilation and machine learning to infer unresolved scale parametrization10.1098/rsta.2020.0086 ↗
65. The impact of data assimilation length scales on analysis and prediction of convective storms10.1175/MWR-D-13-00304.1 ↗
66. Haarnoja, T., Zhou, A., Abbeel, P., and Levine, S. (2018, January 10–15). Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. Proceedings of the International Conference on Machine Learning, Vancouver, BC, Canada.
67. Progress and future prospects of decadal prediction and data assimilation: A review10.1016/j.aosl.2023.100441 ↗
68. Attractor inspired deep learning for modelling chaotic systems10.1007/s44230-023-00045-z ↗
69. Recent developments and applications in quantum neural network: A review10.1007/s11831-018-9269-0 ↗
70. Atmospheric simulations using a GCM with simplified physical parametrizations. I: Model climatology and variability in multi-decadal experiments10.1007/s00382-002-0268-2 ↗
71. A description of the advanced research WRF model version 4
72. Software for ensemble-based data assimilation systems—Implementation strategies and scalability10.1016/j.cageo.2012.03.026 ↗
73. The weather research and forecasting model’s community variational/ensemble data assimilation system: WRFDA10.1175/BAMS-D-11-00167.1 ↗
74. LPT-QPN: A lightweight physics-informed transformer for quantitative precipitation nowcasting
75. MMF-RNN: A Multimodal Fusion Model for Precipitation Nowcasting Using Radar and Ground Station Data