VDMS: An Improved Vision Transformer-Based Model for PM2.5 Concentration Prediction

China’s accelerating industrialization has led to worsening air pollution, characterized by recurrent haze episodes. The accurate quantification of PM2.5 distribution is crucial for air quality assessment and public health management. Although traditional prediction models can effectively identify PM2.5 concentration fluctuations with moderate accuracy, their dependence relies heavily on extensive ground-based monitoring station data, limiting their applicability in areas with sparse monitoring coverage. To address this limitation, this study proposes a novel algorithm for high-precision PM2.5 concentration prediction, termed VDMS (Vision Transformer with DLSTM Multi-Head Self-Attention and Self-supervision). Based on the traditional Vision Transformer (ViT) architecture, VDMS incorporates a Double-Layered Long Short-Term Memory (DLSTM) network and a Multi-Head Self-Attention mechanism to enhance the model’s capacity to capture temporal sequence features and global dependencies. These enhancements contribute to greater stability and robustness in feature representation, ultimately improving prediction performance. Cross-validation experimental results show that the VDMS model outperforms benchmark models in PM2.5 concentration prediction tasks, achieving a coefficient of determination (R2) of 0.93, a root mean square error (RMSE) of 4.05 μg/m3, and a mean absolute error (MAE) of 3.23 μg/m3. Furthermore, experiments conducted in areas with sparse ground monitoring stations demonstrate that the model maintains high predictive accuracy, further validating its applicability and generalization capability in data-limited scenarios. Moreover, the VDMS model adopts a modular design, offering strong scalability that allows its architecture to be adjusted according to specific requirements. This adaptability renders it suitable for monitoring various atmospheric pollutants, providing essential technical support for precise environmental management and air quality forecasting.