journal article·2023-04-24Open access

Detection of Targets in Road Scene Images Enhanced Using Conditional GAN-Based Dehazing Model

Tsz-Yeung Chow, King-Hung Lee, Kwok-Leung Chan

Applied Sciences· Volume 13· Issue 9

Abstract

Object detection is a classic image processing problem. For instance, in autonomous driving applications, targets such as cars and pedestrians are detected in the road scene video. Many image-based object detection methods utilizing hand-crafted features have been proposed. Recently, more research has adopted a deep learning approach. Object detectors rely on useful features, such as the object’s boundary, which are extracted via analyzing the image pixels. However, the images captured, for instance, in an outdoor environment, may be degraded due to bad weather such as haze and fog. One possible remedy is to recover the image radiance through the use of a pre-processing method such as image dehazing. We propose a dehazing model for image enhancement. The framework was based on the conditional generative adversarial network (cGAN). Our proposed model was improved with two modifications. Various image dehazing datasets were employed for comparative analysis. Our proposed model outperformed other hand-crafted and deep learning-based image dehazing methods by 2dB or more in PSNR. Moreover, we utilized the dehazed images for target detection using the object detector YOLO. In the experimentations, images were degraded by two weather conditions—rain and fog. We demonstrated that the objects detected in images enhanced by our proposed dehazing model were significantly improved over those detected in the degraded images.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Image Enhancement Techniques · Video Surveillance and Tracking Methods · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical Engineering, City University of Hong Kong, Hong Kong, China

Funding

Research Grants Council of the Hong Kong Special Administrative Region, China · City University of Hong Kong Strategic Research Grant · Lexiwave Technology (Hong Kong) Ltd.

References (41)

Show source-provided references
1. Gao, M., Wang, J., Chen, Y., Du, C., Chen, C., and Zeng, Y. (2021). An improved multi-exposure image fusion method for intelligent transportation system. Electronics, 10.10.3390/electronics10040383 ↗
2. Liu, X., Zhao, C., Zhang, Q., Yang, C., and Zhang, J. (2019). Characterizing and monitoring ground settlement of marine reclamation land of Xiamen New Airport, China with Sentinel-1 SAR datasets. Remote Sens., 11.10.3390/rs11050585 ↗
3. Tarel, J.-P., Hautière, N., Cord, A., Gruyer, D., and Halmaoui, H. (2010, January 21–24). Improved visibility of road scene images under heterogeneous fog. Proceedings of the IEEE Intelligent Vehicles Symposium 2010, La Jolla, CA, USA.10.1109/IVS.2010.5548128 ↗
4. A two-step approach to see-through bad weather for surveillance video quality enhancement10.1007/s00138-012-0416-6 ↗
5. Haze removal for a single remote sensing image based on deformed haze imaging model10.1109/LSP.2015.2432466 ↗
6. A survey on analysis and implementation of state-of-the-art haze removal techniques10.1016/j.jvcir.2020.102912 ↗
7. Recent advances in image dehazing10.1109/JAS.2017.7510532 ↗
8. He, K., Sun, J., and Tang, X. (2009, January 20–25). Single image haze removal using dark channel prior. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2009, Miami, FL, USA.
9. A color enhancement scene estimation approach for single image haze removal10.1109/LGRS.2019.2951626 ↗
10. Image dehazing by artificial multiple-exposure image fusion10.1016/j.sigpro.2018.03.008 ↗
11. An improved gamma correction model for image dehazing in a multi-exposure fusion framework10.1016/j.jvcir.2021.103122 ↗
12. A framework for outdoor RGB image enhancement and dehazing10.1109/LGRS.2018.2814016 ↗
13. Combining colour and grey-level co-occurrence matrix features: A comparative study10.1049/iet-ipr.2018.6440 ↗
14. Li, B., Peng, X., Wang, Z., Xu, J., and Feng, D. (2017, January 22–29). AOD-Net: All-in-One Dehazing Network. Proceedings of the International Conference on Computer Vision 2017, Venice, Italy.10.1109/ICCV.2017.511 ↗
15. Zhang, H., and Patel, V.M. (2018, January 18–23). Densely connected pyramid dehazing network. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2018, Salt Lake City, UT, USA.10.1109/CVPR.2018.00337 ↗
16. Dong, Y., Liu, Y., Zhang, H., Chen, S., and Qiao, Y. (2020, January 7–12). FD-GAN: Generative adversarial networks with fusion-discriminator for single image dehazing. Proceedings of the AAAI Conference on Artificial Intelligence 2020, New York, NY, USA.
17. Guo, C., Yan, Q., Anwar, S., Cong, R., Ren, W., and Li, C. (2022, January 18–24). Image dehazing transformer with transmission-aware 3D position embedding. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2022, New Orleans, LA, USA.10.1109/CVPR52688.2022.00572 ↗
18. Qin, X., Wang, Z., Bai, Y., Xie, X., and Jia, H. (2020, January 7–12). FFA-Net: Feature fusion attention network for single image dehazing. Proceedings of the AAAI Conference on Artificial Intelligence 2020, New York, NY, USA.
19. Wu, H., Qu, Y., Lin, S., Zhou, J., Qiao, R., Zhang, Z., Xie, Y., and Ma, L. (2020, January 20–25). Contrastive learning for compact single image dehazing. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2021, Nashville, TN, USA.10.1109/CVPR46437.2021.01041 ↗
20. Dong, H., Pan, J., Xiang, L., Hu, Z., Zhang, X., Wang, F., and Yang, M.-H. (2020, January 13–19). Multi-scale boosted dehazing network with dense feature fusion. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020, Seattle, WA, USA.10.1109/CVPR42600.2020.00223 ↗
21. Prior guided conditional generative adversarial network for single image dehazing10.1016/j.neucom.2020.10.061 ↗
22. A GAN-based input-size flexibility model for single image dehazing10.1016/j.image.2021.116599 ↗
23. Li, R., Pan, J., Li, Z., and Tang, J. (2018, January 18–23). Single image dehazing via conditional generative adversarial network. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2018, Salt Lake City, UT, USA.10.1109/CVPR.2018.00856 ↗
24. I-HAZE: A dehazing benchmark with real hazy and haze-free indoor images10.1007/978-3-030-01449-0_52 ↗
25. Vision enhancement in homogeneous and heterogeneous fog10.1109/MITS.2012.2189969 ↗
26. Semantic foggy scene understanding with synthetic data10.1007/s11263-018-1072-8 ↗
27. Dehazing evaluation: Real-world benchmark datasets, criteria, and baselines10.1109/TIP.2020.2995264 ↗
28. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2016, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
29. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11–14). SSD: Single Shot MultiBox Detector. Proceedings of the European Conference on Computer Vision 2016, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
30. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2014, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
31. Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7–12). Faster R-CNN: Towards real-time object detection with region proposal networks. Proceedings of the Neural Information Processing Systems 2015, Montreal, QC, Canada.
32. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision 2017, Venice, Italy.10.1109/ICCV.2017.322 ↗
33. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2016, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
34. Chen, Y., Li, W., Sakaridis, C., Dai, D., and Van Gool, L. (2018, January 18–23). Domain adaptive Faster R-CNN for object detection in the wild. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2018, Salt Lake City, UT, USA.10.1109/CVPR.2018.00352 ↗
35. Wang, W., Cao, Y., Zhang, J., He, F., Zha, Z.-J., Wen, Y., and Tao, D. (2021, January 20–24). Exploring sequence feature alignment for domain adaptive detection transformers. Proceedings of the ACM International Conference on Multimedia 2021, Virtual.10.1145/3474085.3475317 ↗
36. Raj, N.B., and Venketeswaran, N. (2020, January 4–6). Single image haze removal using a Generative Adversarial Network. Proceedings of the International Conference on Wireless Communications Signal Processing and Networking 2020, Chennai, India.
37. Misra, D. (2019). Mish: A self regularized non-monotonic activation function. arXiv.
38. Silberman, N., Hoiem, D., Kohli, P., and Fergus, R. (2012, January 7–13). Indoor segmentation and support inference from RGBD images. Proceedings of the European Conference on Computer Vision 2012, Florence, Italy.10.1007/978-3-642-33715-4_54 ↗
39. Benchmarking single-image dehazing and beyond10.1109/TIP.2018.2867951 ↗
40. Meng, G., Wang, Y., Duan, J., Xiang, S., and Pan, C. (2013, January 1–8). Efficient image dehazing with boundary constraint and contextual regularization. Proceedings of the IEEE International Conference on Computer Vision 2013, Sydney, Australia.10.1109/ICCV.2013.82 ↗
41. Improved color attenuation prior based image de-fogging technique10.1007/s11042-019-08240-6 ↗