journal article·2024-10-22Open access

An Improved Random Forest Approach on GAN-Based Dataset Augmentation for Fog Observation

Yucan Cao, Panpan Zhao, Balin Xu, Jingshu Liang

Applied Sciences· Volume 14· Issue 21

Abstract

The monitoring of fog density is of great importance in meteorology and its applications in environment, aviation and transportation. Nowadays, vision-based fog estimation from images taken with surveillance cameras has made a great supplementary contribution to the scarcely traditional meteorological fog observation. In this paper, we propose a new Random Forest (RF) approach for image-based fog estimation. In order to reduce the impact of data imbalance on recognition, the StyleGAN2-ADA (generative adversarial network with adaptive discriminator augmentation) algorithm is used to generate virtual images to expand the data of low proportions. Key image features related to fog are extracted, and an RF method, integrated with the hierarchical and k-medoid clustering, is deployed to estimate the fog density. The experiment conducted in Sichuan in February 2024 shows that the improved RF model has achieved an average accuracy of fog density observation of 93%, 6.4% higher than the RF model without data expansion, 3–6% higher than the VGG16, the VGG19, the ResNet50, and the DenseNet169 with or without data expansion. What is more, the improved RF method exhibits a very good convergence as a cost-effective solution.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Image Enhancement Techniques · Advanced Image Fusion Techniques · Atmospheric aerosols and clouds

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Electronic and Information Engineering, Tongji University, Shanghai 200804, China

Meteorological Observation Center, China Meteorological Administration, Beijing 100081, China

Yunnan Meteorological Bureau, Kunming 651200, China

Funding

National Natural Science Foundation of China · Observational Experiment Project of Meteorological Observation. Center of China Meteorological Administration

References (42)

Show source-provided references
1. STUDIES of FOG in CHINA over THE PAST 40 YEARS
2. Bao, Z., Tang, Y., and Li, C. (2008). Road Traffic Safety Technology Series: Highway Traffic Safety and Meteorological Impact, People’s Traffic Press. [1st ed.].
3. (2011). Fog Forecast. Meteorological Standard (Standard No. GB/T 27964-2011).
4. A measurement method for slant visibility with slant path scattered radiance correction by lidar and the SBDART model10.1364/OE.409309 ↗
5. Novel lidar algorithm for horizontal visibility measurement and sea fog monitoring10.1364/OE.26.034853 ↗
6. The Present Situation and Problems on Detecting Fog by Remote Sensing with Meteorological Satellite
7. Tang, K., Yang, J., and Wang, J. (2014, January 23–28). Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.383 ↗
8. Yuan, D., Huang, J., Yang, X., and Cui, J. (2020, January 6–8). Improved random forest classification approach based on hybrid clustering selection. Proceedings of the 2020 Chinese Automation Congress (CAC), Shanghai, China.10.1109/CAC51589.2020.9326711 ↗
9. A Method of Visibility Detection Based on the Transfer Learning10.1175/JTECH-D-19-0025.1 ↗
10. Meteorology Visibility Estimation by Using Multi-Support Vector Regression Method
11. Jonnalagadda, J., and Hashemi, M. (2020, January 11–13). Forecasting Atmospheric Visibility Using Auto Regressive Recurrent Neural Network. Proceedings of the 2020 IEEE 21st International Conference on Information Reuse and Integration for Data Science, Las Vegas, NV, USA.10.1109/IRI49571.2020.00037 ↗
12. Li, J., Lo, W.L., Fu, H., and Chung, H.S.H. (2021). A Transfer Learning Method for Meteorological Visibility Estimation Based on Feature Fusion Method. Appl. Sci., 11.10.3390/app11030997 ↗
13. Lo, W.L., Shu, H., and Fu, H. (2021). Experimental Evaluation of PSO Based Transfer Learning Method for Meteorological Visibility Estimation. Atmosphere, 12.10.3390/atmos12070828 ↗
14. Li, Y., Ji, Y., Fu, J., and Chang, X. (2023). FGS-Net: A Visibility Estimation Method Based on Statistical Feature Stream in Fog Area. Res. Sq.10.21203/rs.3.rs-2284950/v1 ↗
15. Automatic Sea Fog Detection and Estimation of Visibility Distance on CCTV10.2112/SI85-177.1 ↗
16. Zhang, F., Yu, T., Li, Z., Wang, K., Chen, Y., Huang, Y., and Kuang, Q. (2022). Deep Quantified Visibility Estimation for Traffic Image. Atmosphere, 14.10.3390/atmos14010061 ↗
17. Wavelet transform for visibility analysis in fog situations10.1109/5254.736004 ↗
18. Automatic fog detection and estimation of visibility distance through use of an on board camera10.1007/s00138-005-0011-1 ↗
19. Negru, M., and Nedevschi, S. (2013, January 5–7). Image based fog detection and visibility estimation for driving assistance systems. Proceedings of the 2013 IEEE 9th International Conference on Intelligent Computer Communication and Processing (ICCP), Cluj-Napoca, Romania.10.1109/ICCP.2013.6646102 ↗
20. Visibility detection approach to road scene foggy images
21. Wauben, W., and Roth, M. (2016, January 27–30). Exploration of fog detection and visibility estimation from camera images. Proceedings of the WMO Technical Conference on Meteorological and Environmental Instruments and Methods of Observation (CIMOTECO), Madrid, Spain.
22. Image based visibility estimation algorithm for intelligent transportation systems10.1109/ACCESS.2018.2884225 ↗
23. Cheng, X., Liu, G., Hedman, A., Wang, K., and Li, H. (2018). Expressway visibility estimation based on image entropy and piecewise stationary time series analysis. arXiv.
24. A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior10.1109/TIP.2015.2446191 ↗
25. Deep learning in computer vision: A critical review of emerging techniques and application scenarios
26. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
27. He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.10.1109/CVPR.2016.90 ↗
28. Huang, G., Liu, Z., Maaten, L.v., and Weinberger, K.Q. (2016). Densely Connected Convolutional Networks. arXiv.10.1109/CVPR.2017.243 ↗
30. Multi visual feature fusion based fog visibility estimation for expressway surveillance using deep learning network10.1016/j.eswa.2023.121151 ↗
31. Visibility recognition of fog figure based on self-adaptive hybrid convolutional neural network
32. Classification and application of highway visibility based on deep learning
33. Training generative adversarial networks with limited data
34. Generative Adversarial Networks10.1145/3422622 ↗
35. Making a ’completely blind’ image quality analyzer10.1109/LSP.2012.2227726 ↗
36. The statistics of natural images10.1088/0954-898X_5_4_006 ↗
37. Single Image Haze Removal Using Dark Channel Prior
38. Measuring colorfulness in natural images10.1117/12.477378 ↗
39. Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging10.1109/TIP.2015.2456502 ↗
40. Using Free Energy Principle For Blind Image Quality Assessment10.1109/TMM.2014.2373812 ↗
41. Berns, R.S. (2021). Billmeyer and Saltzman’s Principles of Color Technology, John Wiley & Sons. [4th ed.].
42. Statistics of cone responses to natural images: Implications for visual coding10.1364/JOSAA.15.002036 ↗