journal article·2021-08-27Open access

Improving Forecast Accuracy with an Auto Machine Learning Post-Correction Technique in Northern Xinjiang

Junjian Liu, Hailiang Zhang, Huoqing Li, Ali Mamtimin

Applied Sciences· Volume 11· Issue 17

Abstract

Reliable meteorological forecasts of temperature and relative humidity are critically important to take necessary measures to avoid potential damage and losses. An operational meteorological forecast model based on the Weather Research and Forecast (WRF) model has been built in Xinjiang. Numerical forecasts usually have significant uncertainties and errors due to imperfections in models themselves. In this study, a straightforward automated machine learning (AutoML) approach has been developed to post-process the raw forecasts of the WRF model. The method was implemented and evaluated to post-process forecasts from 13 stations in northern Xinjiang. The post-processed temperature forecasts were significantly improved from the raw forecasts, with average RMSE values in the 13 stations decreasing from 3.24 °C to 2.34 °C by a large margin of 28%. As for relative humidity, the mean RMSE at 13 stations decreased from 19.54% to 11.54%, or it showed a percentage decrease of 41%. Meanwhile, biases were also significantly decreased, with average ME values being reduced from around 2 °C to ~0.33 °C for temperature and improved from −15.6% to ~0% for relative humidity. Moreover, forecast performance values after post-correction became much closer to each other than raw forecast performance values, improving forecast applicability at regional scales.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Meteorological Phenomena and Simulations · Climate variability and models · Hydrological Forecasting Using AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Desert Meteorology, China Meteorological Administration, Urumqi 830002, China

Funding

National Key Research and Development Program of China · National Natural Science Foundation of China · Central Scientific Research Institute of the Public Basic Scientific Research Business Professional

References (25)

Show source-provided references
1. Verification of Precipitation Forecasts from Two Limited-Area Models over Italy and Comparison with ECMWF Forecasts Using a Resampling Technique10.1175/WAF854.1 ↗
2. The Weather Research and Forecasting Model’s Community Variational/Ensemble Data Assimilation SystemWRFDA10.1175/BAMS-D-11-00167.1 ↗
3. Predicting daily urban fine particulate matter concentrations using a random forest model10.1021/acs.est.7b05381 ↗
4. Kalman filter and analog schemes to postprocess numerical weather predictions10.1175/2011MWR3653.1 ↗
5. Application of a non-linear temperature forecast post-processing technique for the optimization of powdery mildew protection on strawberry
6. Greedy function approximation: A gradient boosting machine10.1214/aos/1013203451 ↗
7. A Practical Approach to Sequential Estimation of Systematic Error on Near-Surface Mesoscale Grids10.1175/2007WAF2006102.1 ↗
8. He, Y., Lin, J., Liu, Z., Wang, H., Li, L., and Han, S. (2018, January 8–14). AMC: AutoML for Model Compression and Acceleration on Mobile Devices. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01234-2_48 ↗
9. Diurnal Corrections of Short-Term Surface Temperature Forecasts Using the Kalman Filter10.1175/1520-0434(1995)010<0689:DCOSTS>2.0.CO;2 ↗
10. Development of updateable model output statistics (umos) system for air temperature over south korea10.1007/s13143-011-0009-8 ↗
11. Analog-Based Ensemble Model Output Statistics10.1175/MWR-D-15-0095.1 ↗
12. Ensemble learning via negative correlation10.1016/S0893-6080(99)00073-8 ↗
13. Fusion Method Combining Ground-Level Observations with Chemical Transport Model Predictions Using an Ensemble Deep Learning Framework: Application in China to Estimate Spatiotemporally-Resolved PM2.5 Exposure Fields in 2014-201710.1021/acs.est.9b01117 ↗
14. Efficient and robust automated machine learning
15. Machine learning in predicting mechanical behavior of additively manufactured parts
16. Sircar, A., Yadav, K., Rayavarapu, K., Bist, N., and Oza, H. (2021). Application of machine learning and artificial intelligence in oil and gas industry. Pet. Res.10.1016/j.ptlrs.2021.05.009 ↗
17. Super learner
18. A kalman-filter bias correction of ozone deterministic, ensemble-averaged, and probabilistic forecasts
19. A strategy for operational implementation of 4d-var, using an incremental approach
20. Deep learning in neural networks: An overview10.1016/j.neunet.2014.09.003 ↗
21. Schilling, N., Wistuba, M., and Drumond, L. (2015, January 9–11). Joint Model Choice and Hyperparameter Optimization with Factorized Multilayer Perceptrons. Proceedings of the IEEE International Conference on Tools with Artificial Intelligence, Vietri sul Mare, Italy.10.1109/ICTAI.2015.24 ↗
22. Random forest: A classification and regression tool for compound classification and QSAR modeling10.1021/ci034160g ↗
23. Explicit forecasts of winter precipitation using an improved bulk microphysics scheme. part i: Description and sensitivity analysis10.1175/1520-0493(2004)132<0519:EFOWPU>2.0.CO;2 ↗
24. A machine learning model for detecting invasive ductal carcinoma with google cloud automl vision10.1016/j.compbiomed.2020.103861 ↗
25. Zenko, B., Todorovski, L., and Dzeroski, S. (2001, January 7–9). A Comparison of Stacking with Meta Decision Trees to Bagging, Boosting, and Stacking with other Methods. Proceedings of the IEEE International Conference on Tools with Artificial Intelligence, Dallas, TX, USA.