journal article·2025-06-08Open access

Pedestrian-Crossing Detection Enhanced by CyclicGAN-Based Loop Learning and Automatic Labeling

Kuan-Chieh Wang, Chao-Li Meng, Chyi-Ren Dow, Bonnie Lu

Applied Sciences· Volume 15· Issue 12

Abstract

Pedestrian safety at crosswalks remains a critical concern as traffic accidents frequently result from drivers’ failure to yield, leading to severe injuries or fatalities. In response, various jurisdictions have enacted pedestrian priority laws to regulate driver behavior. Nevertheless, intersections lacking clear traffic signage and environments with limited visibility continue to present elevated risks. The scarcity and difficulty of collecting data under such complex conditions pose significant challenges to the development of accurate detection systems. This study proposes a CyclicGAN-based loop-learning framework, in which the learning process begins with a set of manually annotated images used to train an initial labeling model. This model is then applied to automatically annotate newly generated synthetic images, which are incorporated into the training dataset for subsequent rounds of model retraining and image generation. Through this iterative process, the model progressively refines its ability to simulate and recognize diverse contextual features, thereby enhancing detection performance under varying environmental conditions. The experimental results show that environmental variations—such as daytime, nighttime, and rainy conditions—substantially affect the model performance in terms of F1-score. Training with a balanced mix of real and synthetic images yields an F1-score comparable to that obtained using real data alone. These results suggest that CycleGAN-generated images can effectively augment limited datasets and enhance model generalization. The proposed system may be integrated with in-vehicle assistance platforms as a supportive tool for pedestrian-crossing detection in data-scarce environments, contributing to improved driver awareness and road safety.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Autonomous Vehicle Technology and Safety · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Information Engineering and Computer Science, Feng Chia University, Taichung 40724, Taiwan

Funding

Ministry of Science and Technology

References (40)

Show source-provided references
1. Sinha, S., and IoT Analytics, Germany (2025, May 01). State of IoT 2024: Number of Connected IoT Devices Growing 13% to 18.8 Billion Globally. Available online: https://iot-analytics.com/number-connected-iot-devices/.
2. MOTC (2024, April 06). The Total Number of Road Traffic Accidents in Taiwan from 2008 to 2024 by Years, Available online: https://stat.motc.gov.tw/mocdb/stmain.jsp?sys=220&ym=9700&ymt=11300&kind=21&type=1&funid=b330702&cycle=4&outmode=0&compmode=0&outkind=1&fldlst=111&cod00=1&rdm=piylqkxx.
3. Intelligent transportation systems for sustainable smart cities10.1016/j.treng.2024.100252 ↗
4. Wang, G., Lin, T., Dong, X., Wang, L., Leng, Q., and Shin, S.Y. (2024). CGADNet: A Lightweight, Real-Time, and Robust Crosswalk and Guide Arrow Detection Network for Complex Scenes. Appl. Sci., 14.10.3390/app14209445 ↗
5. CDNet: A real-time and robust crosswalk detection network on Jetson nano based on YOLOv510.1007/s00521-022-07007-9 ↗
6. X-CDNet: A real-time crosswalk detector based on YOLOX10.1016/j.jvcir.2024.104206 ↗
7. Dadashev, A., and Török, Á. (2025). SmartDENM—A System for Enhancing Pedestrian Safety Through Machine Vision and V2X Communication. Electronics, 14.10.3390/electronics14051026 ↗
8. Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22–29). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.244 ↗
9. Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv.
10. ultralytics.com (2023, May 15). Ultralytics YOLOv8: The State-of-the-Art YOLO Model. Available online: https://ultralytics.com/yolov8.
11. Alif, M.A.R., and Hussain, M. (2024). YOLOv1 to YOLOv10: A comprehensive review of YOLO variants and their application in the agricultural domain. arXiv.
12. Se, S. (2000, January 15). Zebra-crossing detection for the partially sighted. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2000 (Cat. No. PR00662), Hilton Head, SC, USA.
13. Uddin, M.S., and Shioyama, T. (2005, January 28–31). Robust zebra-crossing detection using bipolarity and projective invariant. Proceedings of the Eighth International Symposium on Signal Processing and Its Applications, Sydney, NSW, Australia.
14. Block-based hough transform for recognition of zebra crossing in natural scene images10.1109/ACCESS.2019.2915639 ↗
15. Herumurti, D., Uchimura, K., Koutaki, G., and Uemura, T. (2013, January 2–5). Urban road network extraction based on zebra crossing detection from a very high resolution rgb aerial image and dsm data. Proceedings of the 2013 International Conference on Signal-Image Technology & Internet-Based Systems, Kyoto, Japan.10.1109/SITIS.2013.24 ↗
16. Sommer, L., Schmidt, N., Schumann, A., and Beyerer, J. (2018, January 7–10). Search area reduction fast-RCNN for fast vehicle detection in large aerial imagery. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.10.1109/ICIP.2018.8451189 ↗
17. Changzhen, X., Cong, W., Weixin, M., and Yanmei, S. (2016, January 13–15). A traffic sign detection algorithm based on deep convolutional neural network. Proceedings of the 2016 IEEE International Conference on Signal and Image Processing (ICSIP), Beijing, China.10.1109/SIPROCESS.2016.7888348 ↗
18. A crosswalk pedestrian recognition system by using deep learning and zebra-crossing recognition techniques10.1002/spe.2742 ↗
19. Lin, J.P., and Sun, M.T. (December, January 30). A YOLO-based traffic counting system. Proceedings of the 2018 Conference on Technologies and Applications of Artificial Intelligence (TAAI), Taichung, Taiwan.10.1109/TAAI.2018.00027 ↗
20. Liu, J., Liu, J., Xie, Z., and Li, D. (2020). Flame: A self-adaptive auto-labeling system for heterogeneous mobile processors. arXiv.
21. Lin, Z., Ding, G., and Hu, M. (2013, January 15–18). Multi-source image auto-annotation. Proceedings of the 2013 IEEE International Conference on Image Processing, Melbourne, VIC, Australia.10.1109/ICIP.2013.6738529 ↗
22. Automatic image annotation by combining generative and discriminant models10.1016/j.neucom.2016.09.108 ↗
23. Zhang, X., Liu, J., and Chi, X. (2015, January 26–28). Auto-labeling algorithms on CA based interactive segmentation for high resolution remote sensing images. Proceedings of the 2015 Sixth International Conference on Intelligent Control and Information Processing (ICICIP), Wuhan, China.10.1109/ICICIP.2015.7388198 ↗
24. Yu, W., Sun, Y., Zhou, R., and Liu, X. (2019, January 4–8). Gan based method for labeled image augmentation in autonomous driving. Proceedings of the 2019 IEEE International Conference on Connected Vehicles and Expo (ICCVE), Graz, Austria.10.1109/ICCVE45908.2019.8964902 ↗
25. Yu, C.W., Chen, Y.L., Lee, K.F., Chen, C.H., and Hsiao, C.Y. (2019, January 20–22). Efficient intelligent automatic image annotation method based on machine learning techniques. Proceedings of the 2019 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW), Yilan, Taiwan.10.1109/ICCE-TW46550.2019.8991727 ↗
26. Kage, P., Rothenberger, J.C., Andreadis, P., and Diochnos, D.I. (2024). A review of pseudo-labeling for computer vision. arXiv.
27. Riaz, M.N., Wielgosz, M., and López, A.M. (2025). Minimizing Human Labeling in Training Deep Models for Pedestrian Intention Prediction. IEEE Transactions on Intelligent Transportation Systems, IEEE.10.1109/TITS.2025.3565667 ↗
28. Adversarial Style-Irrelevant Feature Learning with Refined Soft Pseudo Labels for Domain-Adaptive Vehicle Re-Identification10.1109/TITS.2024.3480156 ↗
29. Zhao, W., Wei, Q., and Zeng, Z. (2023). A Deeply Supervised Semantic Segmentation Method Based on GAN. arXiv.10.1109/ITSC57777.2023.10422368 ↗
30. Smith, L.N. (2022). General cyclical training of neural networks. arXiv.
31. Facial feature embedded CycleGAN for VIS–NIR translation10.1007/s11045-023-00871-1 ↗
32. Zhang, H., Mou, F., Duan, S., Huang, S., Wang, S., Xu, D., and Zheng, Z. (2020, January 26). A method to create training dataset for dehazing with cyclegan. Proceedings of the IGARSS 2020–2020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA.10.1109/IGARSS39084.2020.9324099 ↗
33. Xu, Y., Yang, H., Cheng, M., and Li, S. (2019, January 22–25). Cyclone intensity estimate with context-aware cyclegan. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.10.1109/ICIP.2019.8803598 ↗
34. Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative adversarial nets. Adv. Neural Inf. Process. Syst., 27.
35. Chen, S., and Lin, W. (2019, January 1–13). Embedded system real-time vehicle detection based on improved YOLO network. Proceedings of the 2019 IEEE 3rd Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), Chongqing, China.10.1109/IMCEC46724.2019.8984055 ↗
36. Kim, W., Cho, H., Kim, J., Kim, B., and Lee, S. (2020, January 1–25). Target classification using combined YOLO-SVM in high-resolution automotive FMCW radar. Proceedings of the 2020 IEEE Radar Conference (RadarConf20), Florence, Italy.10.1109/RadarConf2043947.2020.9266477 ↗
37. Strbac, B., Gostovic, M., Lukac, Z., and Samardzija, D. (2020, January 26–27). YOLO multi-camera object detection and distance estimation. Proceedings of the 2020 Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, Serbia.10.1109/ZINC50678.2020.9161805 ↗
38. Kim, J.a., Sung, J.Y., and Park, S.h. (2020, January 1–3). Comparison of Faster-RCNN, YOLO, and SSD for real-time vehicle type recognition. Proceedings of the 2020 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), Seoul, Republic of Korea.10.1109/ICCE-Asia49877.2020.9277040 ↗
39. Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2025, May 01). CycleGAN and pix2pix in PyTorch. Available online: https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix.
40. Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., and Hochreiter, S. (2017, January 4–9). Gans trained by a two time-scale update rule converge to a local nash equilibrium. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA USA.