A Reproducible QA/QC, Imputation and Robust-Series Workflow for Air-Quality Monitoring Time Series
Source abstract
Abstract
This study develops a reproducible and auditable workflow to prepare regulatory air-quality monitoring time series for subsequent temporal analysis, including observational PRE/POST applications around coal-fired power plant closures in northwestern Spain. The dataset comprises daily concentrations from 28 monitoring stations (2006–2023) for PM10, PM2.5, NO, NO2, NOx, O3, SO2, and CO, affected by missingness, structural inconsistencies, and extreme values. The contribution of this study lies in integrating standardized data ingestion and QA/QC chained-equation imputation with Bayesian Ridge regression, hold-out validation, physicochemical consistency checks, and robust extreme-value handling within a traceable processing workflow. Missing values are reconstructed per pollutant using plant-level multi-station pooling to improve stability. Performance is evaluated using a 5% masked hold-out and summarized with MAE, RMSE, R2, and bias, complemented by an operational fit-quality label. Post-imputation controls enforce NO–NO2–NOx consistency and the physical constraint PM2.5 ≤ PM10, while extreme values are screened through a hierarchical robustness framework combining a Hampel filter, winsorization, and a Tukey IQR criterion. The workflow outputs documented diagnostics and robust daily series while preserving the traceability of observed values, flags, edits, and final decisions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Air Quality Monitoring and Forecasting · Atmospheric chemistry and aerosols · Air Quality and Health Impacts
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Mining Technology, Topography and Structures, University of Leon, 24071 Leon, Spain
Department of Mathematics, University of Oviedo, 33007 Oviedo, Spain
INREMIN S.L., 24008 Leon, Spain
References (64)
Show source-provided references
1. (2026, January 27). Gobierno de España Plan Nacional Integrado de Energía y Clima (PNIEC) 2021–2030. Available online: https://www.miteco.gob.es/content/dam/miteco/images/es/pnieccompleto_tcm30-508410.pdf.
2. (2026, January 27). Gobierno de España Plan Nacional Integrado de Energía y Clima (PNIEC): Actualización 2023–2030. Available online: https://www.miteco.gob.es/content/dam/miteco/es/energia/files-1/pniec-2023-2030/PNIEC_2024_240924.pdf.
3. A Practical Comparison of Single and Multiple Imputation Methods to Handle Complex Missing Data in Air Quality Datasets10.1016/j.chemolab.2014.02.007 ↗
4. Imputation of Missing Data in Time Series for Air Pollutants10.1016/j.atmosenv.2014.11.049 ↗
5. Extreme Saharan Dust Events Expand Northward over the Atlantic and Europe, Prompting Record-Breaking PM10 and PM2.5 Episodes10.5194/acp-24-12031-2024 ↗
6. Probabilistic Automatic Outlier Detection for Surface Air Quality Measurements from the China National Environmental Monitoring Network10.1007/s00376-018-8067-9 ↗
7. Imputation Methods for Addressing Missing Data in Short-Term Monitoring of Air Pollutants10.1016/j.scitotenv.2020.139140 ↗
8. Chen, M., Zhu, H., Chen, Y., and Wang, Y. (2022). A Novel Missing Data Imputation Approach for Time Series Air Quality Data Based on Logistic Regression. Atmosphere, 13.10.3390/atmos13071044 ↗
9. Hua, V., Nguyen, T., Dao, M.-S., Nguyen, H.D., and Nguyen, B.T. (2024). The Impact of Data Imputation on Air Quality Prediction Problem. PLoS ONE, 19.10.1371/journal.pone.0306303 ↗
10. Methods for Imputation of Missing Values in Air Quality Data Sets10.1016/j.atmosenv.2004.02.026 ↗
11. Menéndez García, L.A., Menéndez Fernández, M., Sokoła-Szewioła, V., Álvarez de Prado, L., Ortiz Marqués, A., Fernández López, D., and Bernardo Sánchez, A. (2022). A Method of Pruning and Random Replacing of Known Values for Comparing Missing Data Imputation Models for Incomplete Air Quality Time Series. Appl. Sci., 12.10.3390/app12136465 ↗
12. There and Back Again: Outlier Detection between Statistical Reasoning and Data Mining Algorithms10.1002/widm.1280 ↗
13. System for Automated Quality Control (SaQC) to Enable Traceable and Reproducible Data Streams in Environmental Science10.1016/j.envsoft.2023.105809 ↗
14. European Environment Agency (2026, January 27). Air Quality E-Reporting Submission Procedures for Reporting to Eionet CDR. Available online: https://www.eionet.europa.eu/aqportal/doc/AQ_IPR_submission_procedure_2018.pdf.
15. European Commission (2011). 2011/850/EU: Commission Implementing Decision of 12 December 2011 laying down rules for Directives 2004/107/EC and 2008/50/EC of the European Parliament and of the Council as regards the reciprocal exchange of information and reporting on ambient air quality (notified under document C(2011) 9068). Off. J. Eur. Union, L 335, 86–106.
16. European Commission (2015). Directive
17. (EU) 2015/1480 of 28 August 2015 amending several annexes to Directives 2004/107/EC and 2008/50/EC of the European Parliament and of the Council laying down the rules concerning reference methods, data validation and location of sampling points for the assessment of ambient air quality. Off. J. Eur. Union, L 226, 4-11.
18. Spatial Imputation for Air Pollutants Data Sets via Low Rank Matrix Completion Algorithm10.1016/j.envint.2020.105713 ↗
19. Graph Machine Learning for Improved Imputation of Missing Tropospheric Ozone Data10.1021/acs.est.3c05104 ↗
20. Advantages of the Mean Absolute Error (MAE) over the Root Mean Square Error (RMSE) in Assessing Average Model Performance10.3354/cr030079 ↗
21. New Considerations for PM, Black Carbon and Particle Number Concentration for Air Quality Monitoring across Different European Cities10.5194/acp-11-6207-2011 ↗
22. World Health Organization (2021). WHO Global Air Quality Guidelines: Particulate Matter (PM2.5 and PM10), Ozone, Nitrogen Dioxide, Sulfur Dioxide and Carbon Monoxide: Executive Summary, World Health Organization.
23. Little, R.J.A., and Rubin, D.B. (2019). Statistical Analysis with Missing Data, Wiley. [3rd ed.].10.1002/9781119482260 ↗
24. van Buuren, S. (2018). Flexible Imputation of Missing Data, Chapman and Hall/CRC. [2nd ed.].10.1201/9780429492259 ↗
25. Multiple Imputation by Chained Equations: What Is It and How Does It Work?10.1002/mpr.329 ↗
26. A Multivariate Technique for Multiply Imputing Missing Values Using a Sequence of Regression Models
27. Multiple Imputation Using Chained Equations: Issues and Guidance for Practice10.1002/sim.4067 ↗
28. Outlier Detection and Accommodation in General Spatial Models10.1007/s10260-015-0348-1 ↗
29. Outlier Detection in Urban Air Quality Sensor Networks10.1007/s11270-018-3756-7 ↗
30. European Environment Agency (2020). Air Quality Data Validation: Guidance for Monitoring Networks, EEA.
31. Identification and Influence of Spatio-Temporal Outliers in Urban Air Quality Measurements10.1016/j.scitotenv.2016.08.031 ↗
32. The European Parliament and the Council Parliament of the European Union (2008). Directive 2008/50/EC of the European Parliament and of the Council of 21 May 2008 on ambient air quality and cleaner air for Europe. Off. J. Eur. Union, L 152, 1–44.
33. Gobierno de España (2017). Plan Nacional de Calidad del Aire 2017–2019 (Plan Aire II), Ministerio de Agricultura, Pesca, Alimentación y Medioambiente.
34. Gobierno de España (2011). Real Decreto 102/2011, de 28 de enero, relativo a la mejora de la calidad del aire. Boletín Of. Estado, 25, 9574–9626.
35. (2026, January 26). Ministerio para la Transición Ecológica y el Reto Demográfico Inventario de Instalaciones—Inventario Completo|PRTR España. Available online: https://prtr-es.miteco.gob.es/Informes/InventarioInstalacionesIPPC.aspx.
36. (2026, February 01). Golder Associates Dispersion Modelling Guidance: Determining the Need for Industrial PM10 Offsets Under the National Environmental Standards for Air Quality, Available online: https://www.envirolink.govt.nz/assets/Envirolink/1285-HBRC184-Practical-Guidance-on-Dispersion-Modelling-Determining-the-need-for-PM10-offsets-under-the-NES.pdf.
37. (2026, January 27). Environmental Protection Agency Air Dispersion Modelling from Industrial Installations Guidance Note (AG4). Available online: https://www.epa.ie/publications/compliance--enforcement/air/air-guidance-notes/EPA-Air-Dispersion-Modelling-Guidance-Note-(AG4)-2020.pdf.
38. (2026, January 26). Datos Horarios de Calidad del Aire—Datos Abiertos MITECO. Available online: https://catalogo.datosabiertos.miteco.gob.es/catalogo/dataset/19458583-9953-4fe7-a494-e2cc26e89e58.
39. Gobierno de España (2023). Real Decreto 34/2023, de 24 de Enero, por el que se modifican el Real Decreto 102/2011, de 28 de Enero, relativo a la mejora de la calidad del aire; el Reglamento de emisiones industriales y de desarrollo de la Ley 16/2002, de 1 de Julio, de prevención y control integrados de la contaminación, aprobado mediante el Real Decreto 815/2013, de 18 de Octubre; y el Real Decreto 208/2022, de 22 de Marzo, sobre las garantías financieras en materia de residuos. Boletín Of. Estado, 21, 10326–10348.
40. Use of Data Imputation Tools to Reconstruct Incomplete Air Quality Datasets: A Case-Study in Temuco, Chile10.1016/j.atmosenv.2018.11.053 ↗
41. Lu, P., Deng, S., Li, G., Tuheti, A., and Liu, J. (2023). Regional Transport of PM2.5 from Coal-Fired Power Plants in the Fenwei Plain, China. Int. J. Environ. Res. Public Health, 20.10.3390/ijerph20032170 ↗
42. Alsaber, A.R., Pan, J., and Al-Hurban, A. (2021). Handling Complex Missing Data Using Random Forest Approach for an Air Quality Monitoring Dataset: A Case Study of Kuwait Environmental Data (2012 to 2018). Int. J. Environ. Res. Public Health, 18.10.3390/ijerph18031333 ↗
43. Rodríguez-Barranco, M., Tobías, A., Redondo, D., Molina-Portillo, E., and Sánchez, M.J. (2017). Standardizing Effect Size from Linear Regression Models with Log-Transformed Variables for Meta-Analysis. BMC Med. Res. Methodol., 17.10.1186/s12874-017-0322-8 ↗
44. Multiple Imputation for Missing Data in Epidemiological and Clinical Research: Potential and Pitfalls10.1136/bmj.b2393 ↗
45. Smearing Estimate: A Nonparametric Retransformation Method10.1080/01621459.1983.10478017 ↗
46. Outliers in Process Modeling and Identification10.1109/87.974338 ↗
47. The power of outliers (and why researchers should ALWAYS check for them)
48. Outlier Management in Data Analysis: A Checklist for Authors and Reviewers10.1007/s11676-025-01967-z ↗
49. An R Package for Identification of Outliers in Environmental Time Series Data10.1016/j.envsoft.2022.105435 ↗
50. Tukey, J.W. (1977). Exploratory Data Analysis, Addison-Wesley.
51. Functional Data Analysis of Air Quality Time Series in Madrid Using FPCA and Splines10.1016/j.atmosenv.2025.121741 ↗
52. A Protocol for Data Exploration to Avoid Common Statistical Problems10.1111/j.2041-210X.2009.00001.x ↗
53. Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., and Stahel, W.A. (1986). Robust Statistics: The Approach Based on Influence Functions, Wiley.
54. Roos-Hoefgeest Toribio, M., Garnung Menéndez, A., Roos-Hoefgeest Toribio, S., and Álvarez García, I. (2025). A Novel Approach to Speed Up Hampel Filter for Outlier Detection. Sensors, 25.10.3390/s25113319 ↗
55. Detection of Anomalous Nitrogen Dioxide (NO2) Concentration of A District in Ankara: A Reconstruction-Based Approach
56. Lagler, F., Belis, C., and Borowiak, A. (2011). A Quality Assurance and Control Program for PM2.5 and PM10 Measurements in European Air Quality Monitoring Networks, Publications Office of the European Union.
57. Alastuey, A., Minguillón, M.C., Pérez, N., Querol, X., Viana, M., and Leeuw, F. (2011). PM10 Measurement Methods and Correction Factors: 2009 Status Report, European Topic Centre on Air Pollution and Climate Change Mitigation (ETC/ACM).
58. Traceability Issue in PM2.5 and PM10 Measurements10.1007/s12647-013-0073-x ↗
59. New Directions: The Future of European Urban Air Quality Monitoring10.1016/j.atmosenv.2014.01.012 ↗
60. A New Data-Standardization Procedure for Comprehensive Outlier Detection in Correlated Meteorological Sensor Data10.5194/ascmo-11-133-2025 ↗
61. European Environment Agency (2026, January 06). Air Quality in Europe: 2020 Report. Available online: https://data.europa.eu/doi/10.2800/786656.
62. European Environment Agency (2019). Air Quality in Europe—2019 Report, Publications Office of the European Union. EEA Report No. 10/2019.
63. Tropospheric Ozone and Its Precursors from the Urban to the Global Scale from Air Quality to Short-Lived Climate Forcer10.5194/acp-15-8889-2015 ↗
64. Measurement Report: Long-Term Variations in Carbon Monoxide at a Background Station in China’s Yangtze River Delta Region10.5194/acp-20-15969-2020 ↗