NRGS-Net: A Lightweight Uformer with Gated Positional and Local Context Attention for Nighttime Road Glare Suppression
Source abstract
Abstract
Existing nighttime visibility enhancement methods primarily focus on improving overall brightness under low-light conditions. However, nighttime road images are also affected by glare, glow, and flare from complex light sources such as streetlights and headlights, making it challenging to suppress locally overexposed regions and recover fine details. To address these challenges, we propose a Nighttime Road Glare Suppression Network (NRGS-Net) for glare removal and detail restoration. Specifically, to handle diverse glare disturbances caused by the uncertainty in light source positions and shapes, we designed a gated positional attention (GPA) module that integrates positional encoding with local contextual information to guide the network in accurately locating and suppressing glare regions, thereby enhancing the visibility of affected areas. Furthermore, we introduced an improved Uformer backbone named LCAtransformer, in which the downsampling layers adopt efficient depthwise separable convolutions to reduce computational cost while preserving critical spatial information. The upsampling layers incorporate a residual PixelShuffle module to achieve effective restoration in glare-affected regions. Additionally, channel attention is introduced within the Local Context-Aware Feed-Forward Network (LCA-FFN) to enable adaptive adjustment of feature weights, effectively suppressing irrelevant and interfering features. To advance the research in nighttime glare suppression, we constructed and publicly released the Night Road Glare Dataset (NRGD) captured in real nighttime road scenarios, enriching the evaluation system for this task. Experiments conducted on the Flare7K++ and NRGD, using five evaluation metrics and comparing six state-of-the-art methods, demonstrate that our method achieves superior performance in both subjective and objective metrics compared to existing advanced methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image Enhancement Techniques · Impact of Light on Environment and Health · Advanced Image Fusion Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Resources and Environment, University of Electronic Science and Technology of China, Chengdu 611731, China
Novel Product R & D Department, Truly Opto-Electronics Co., Ltd., Shanwei 516600, China
Funding
the “Yang Fan” major project in Guangdong Province
References (51)
Show source-provided references
1. Lu, L., Zhou, Y., Panetta, K., and Agaian, S. (2010, January 5–9). Comparative study of histogram equalization algorithms for image enhancement. Proceedings of the SPIE Defense, Security, and Sensing, Orlando, FL, USA. Mobile Multimedia.10.1117/12.853502 ↗
2. Retinex image enhancement based on sequential decomposition with a plug-and-play framework10.1109/TNNLS.2023.3280037 ↗
3. Proakis, J.G. (2007). Digital Signal Processing: Principles, Algorithms, and Applications, Pearson Education. [4th ed.].
4. Lyons, R.G. (1997). Understanding Digital Signal Processing, Pearson Education. [3rd ed.].
5. Jähne, B. (2005). Digital Image Processing, Springer.
6. Prince, S.J.D. (2012). Computer Vision: Models, Learning, and Inference, Cambridge University Press.10.1017/CBO9780511996504 ↗
7. Automatic flare spot artifact detection and removal in photographs10.1007/s10851-018-0859-0 ↗
8. Single image veiling glare removal10.1080/09500340.2018.1506057 ↗
9. Si, L., Wang, Z., Xu, R., Tan, C., Liu, X., and Xu, J. (2017). Image enhancement for surveillance video of coal mining face based on single-scale retinex algorithm combined with bilateral filtering. Symmetry, 9.10.3390/sym9060093 ↗
10. Real-time automotive night-vision system for drivers to inhibit headlight glare of the oncoming vehicles and enhance road visibility10.1007/s11554-021-01104-z ↗
11. Rahman, S., Rahman, M.M., Abdullah-Al-Wadud, M., Al-Quaderi, G.D., and Shoyaib, M. (2016). An adaptive gamma correction for image enhancement. EURASIP J. Image Video Process., 2016.10.1186/s13640-016-0138-1 ↗
12. Minimum mean brightness error bi-histogram equalization in contrast enhancement10.1109/TCE.2003.1261234 ↗
13. Low-light image enhancement with strong light weakening and bright halo suppressing10.1049/iet-ipr.2018.5505 ↗
14. Zhou, Y., Liang, D., Chen, S., Huang, S.J., Yang, S., and Li, C. (2023, January 1–6). Improving lens flare removal with general-purpose pipeline and multiple light sources recovery. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01192 ↗
15. Dai, Y., Li, C., Zhou, S., Feng, R., Zhu, Q., Sun, Q., Loy, C.C., Gu, J., Liu, S., and Wang, H. (2023, January 17–24). Mipi 2023 challenge on nighttime flare removal: Methods and results. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.
16. Reinhard, E. (2021). High dynamic range imaging. Computer Vision: A Reference Guide, Springer International Publishing.10.1007/978-3-030-63416-2_843 ↗
17. Wu, W., Weng, J., Zhang, P., Wang, X., Yang, W., and Jiang, J. (2022, January 18–24). Uretinex-net: Retinex-based deep unfolding network for low-light image enhancement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00581 ↗
18. Liu, R., Ma, L., Zhang, J., Fan, X., and Luo, Z. (2021, January 11–15). Retinex-inspired unrolling with cooperative prior architecture search for low-light image enhancement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01042 ↗
19. Zhang, Y., Zhang, J., and Guo, X. (2019, January 21–25). Kindling the darkness: A practical low-light image enhancer. Proceedings of the 27th ACM International Conference on Multimedia, Nice, France.10.1145/3343031.3350926 ↗
20. Enlightengan: Deep light enhancement without paired supervision10.1109/TIP.2021.3051462 ↗
21. Cui, Z., Li, K., Gu, L., Su, S., Gao, P., Jiang, Z., Qiao, Y., and Harada, T. (2022). You only need 90k parameters to adapt light: A light weight transformer for image enhancement and exposure correction. arXiv.
22. Guo, Q., Wang, H., and Yang, J. (2022). Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion. Sensors, 22.10.3390/s22197494 ↗
23. Low-light image enhancement for infrared and visible image fusion10.1049/ipr2.12857 ↗
24. Huang, W., Li, K., Xu, M., and Huang, R. (2023). Self-Supervised Non-Uniform Low-Light Image Enhancement Combining Image Inversion and Exposure Fusion. Electronics, 12.10.3390/electronics12214445 ↗
25. Liu, Y., Yan, Z., Wu, A., Ye, T., and Li, Y. (2022, January 18–24). Nighttime image dehazing based on variational decomposition model. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPRW56347.2022.00079 ↗
26. Sharma, A., and Tan, R.T. (2021, January 11–15). Nighttime visibility enhancement by increasing the dynamic range and suppression of light effects. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01180 ↗
27. Jin, Y., Yang, W., and Tan, R.T. (2022, January 23–27). Unsupervised night image enhancement: When layer decomposition meets light-effects suppression. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-19836-6_23 ↗
28. Dynamically Activated De-glaring and Detail-Recovery for Low-light Image Enhancement Directly on Smart Cameras10.1109/TETC.2024.3403935 ↗
29. Jin, Y., Lin, B., Yan, W., Yuan, Y., Ye, W., and Tan, R.T. (November, January 29). Enhancing visibility in nighttime haze images using guided apsf and gradient adaptive convolution. Proceedings of the 31st ACM International Conference on Multimedia, Ottawa, ON, Canada.
30. He, Q., Zhang, J., Chen, W., Zhang, H., Wang, Z., and Xu, T. (2024). OENet: An overexposure correction network fused with residual block and transformer. Expert Syst. Appl., 250.10.1016/j.eswa.2024.123709 ↗
31. Niu, C., Li, K., Wang, D., Zhu, W., Xu, H., and Dong, J. (2024). Gr-gan: A unified adversarial framework for single image glare removal and denoising. Pattern Recognit., 156.10.1016/j.patcog.2024.110815 ↗
32. Dai, Y., Luo, Y., Zhou, S., Li, C., and Loy, C.C. (2023, January 17–24). Nighttime smartphone reflective flare removal using optical center symmetry prior. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01991 ↗
33. Deep trident decomposition network for single license plate image glare removal10.1109/TITS.2021.3058530 ↗
34. Wu, Y., He, Q., Xue, T., Garg, R., Chen, J., Veeraraghavan, A., and Barron, J.T. (2021, January 11–15). How to train neural networks for flare removal. Proceedings of the IEEE/CVF International Conference on Computer Vision, Nashville, TN, USA.10.1109/ICCV48922.2021.00224 ↗
35. Yan, W., Tan, R.T., and Dai, D. (2020, January 23–28). Nighttime defogging using high-low frequency decomposition and grayscale-color networks. Proceedings of the European Conference on Computer Vision, Glasgow, UK.10.1007/978-3-030-58610-2_28 ↗
36. Fast user-guided single image reflection removal via edge-aware cascaded networks10.1109/TMM.2019.2951461 ↗
37. Dai, Y., Li, C., Zhou, S., Feng, R., Luo, Y., and Loy, C.C. (2023). Flare7k++: Mixing synthetic and real datasets for nighttime flare removal and beyond. arXiv.10.1109/TPAMI.2024.3406821 ↗
38. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
39. Cai, Y., Bian, H., Lin, J., Wang, H., Timofte, R., and Zhang, Y. (2023, January 2–3). Retinexformer: One-stage retinex-based transformer for low-light image enhancement. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01149 ↗
40. Wang, Z., Cun, X., Bao, J., Zhou, W., Liu, J., and Li, H. (2022, January 18–24). Uformer: A general u-shaped transformer for image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01716 ↗
41. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
42. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
43. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
44. Zhao, H., Zhang, Y., Liu, S., Shi, J., Loy, C.C., Lin, D., and Jia, J. (2018, January 8–14). Psanet: Point-wise spatial attention network for scene parsing. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01240-3_17 ↗
45. He, K., Zhang, X., Ren, S., and Sun, J. (2016). Identity mappings in deep residual networks. Computer Vision–ECCV 2016, Proceedings of the 14th European Conference, Amsterdam, The Netherlands, 11–14 October 2016, Springer International Publishing. Proceedings, Part IV.10.1007/978-3-319-46493-0_38 ↗
46. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
47. Zhang, R., Isola, P., Efros, A.A., Shechtman, E., and Wang, O. (2018, January 18–23). The unreasonable effectiveness of deep features as a perceptual metric. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00068 ↗
48. Making a “completely blind” image quality analyzer10.1109/LSP.2012.2227726 ↗
49. Zheng, S., and Gupta, G. (2022, January 3–8). Semantic-guided zero-shot learning for low-light image/video enhancement. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACVW54805.2022.00064 ↗
50. Learning to enhance low-light image via zero-reference deep curve estimation
51. Nguyen, H., Tran, D., Nguyen, K., Nguyen, H., Tran, D., Nguyen, K., and Nguyen, R. (2023, January 2–7). Psenet: Progressive self-enhancement network for unsupervised extreme-light image enhancement. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV56688.2023.00180 ↗