Effect of Droplet Contamination on Camera Lens Surfaces: Degradation of Image Quality and Object Detection Performance
Source abstract
Abstract
Recently, camera sensors have been widely used in a variety of applications, including advanced driver assistance systems (ADASs), surveillance systems, and unmanned aerial vehicles (UAVs). These sensors are often integrated with intelligent algorithms to automatically analyze information and perform specific functions. However, during rainy weather, droplets on the camera lens surface can obstruct the view, leading to degraded image quality and reduced algorithm performance. This paper quantitatively evaluates the effect of droplet contamination on image quality and object detection performance. Image quality degradation was analyzed using the modulation transfer function (MTF), with droplet volume and number as variables. Results show that the MTF50 decreased by up to 80% when the droplet volume reached 10 μL. To assess the effect on object detection, performance changes were evaluated across different detection algorithms. The findings reveal that droplet contamination can reduce the detection performance of small objects by up to 90%, as measured by the mean average precision (mAP) metric. Furthermore, degradation was more severe on hydrophilic surfaces compared to hydrophobic ones. This study demonstrates that droplet characteristics such as volume, number, and shape significantly influence both image quality and object detection performance. It provides critical insights into selecting appropriate camera lens materials by comparing hydrophilic and hydrophobic surfaces while also highlighting the susceptibility of intelligent algorithms to environmental factors and underscoring the importance of effective cleaning techniques.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrared Target Detection Methodologies · Visual Attention and Saliency Detection · Industrial Vision Systems and Defect Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Mechanical Engineering, Myongji University, Yongin 17058, Republic of Korea
Microsystems, Inc., Yongin 17058, Republic of Korea
Funding
Gyeonggi Technology Development Program
References (45)
Show source-provided references
1. Digital Camera System on a Chip10.1109/40.683047 ↗
2. Mosqueron, R., Dubois, J., and Paindavoine, M. (2007). High-Speed Smart Camera with High Resolution. Eurasip J. Embed. Syst., 2007.10.1186/1687-3963-2007-024163 ↗
3. Kandhalu, A., Rowe, A., and Rajkimar, R. (September, January 30). DSPcam: A camera sensor system for surveillance networks. Proceedings of the Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC), Como, Italy.
4. Robot-Assisted Medical Imaging: A Review10.1109/JPROC.2022.3162840 ↗
5. Menolotto, M., Komaris, D.S., Tedesco, S., O’flynn, B., and Walsh, M. (2020). Motion Capture Technology in Industrial Applications: A Systematic Review. Sensors, 20.10.3390/s20195687 ↗
6. The Sensable City: A Survey on the Deployment and Management for Smart City Monitoring10.1109/COMST.2018.2881008 ↗
7. Laufs, J., Borrion, H., and Bradford, B. (2020). Security and the Smart City: A Systematic Review. Sustain. Cities Soc., 55.10.1016/j.scs.2020.102023 ↗
8. Advanced Driver-Assistance Systems: A Path Toward Autonomous Vehicles10.1109/MCE.2018.2828440 ↗
9. A Progressive Review: Emerging Technologies for ADAS Driven Solutions10.1109/TIV.2021.3122898 ↗
10. Recent Advances in Unmanned Aerial Vehicles: A Review10.1007/s13369-022-06738-0 ↗
11. Yao, H., Qin, R., and Chen, X. (2019). Unmanned Aerial Vehicle for Remote Sensing Applications—A Review. Remote Sens., 11.10.3390/rs11121443 ↗
12. A Systematic Review on Monitoring and Advanced Control Strategies in Smart Agriculture10.1109/ACCESS.2021.3057865 ↗
13. Finn, C., and Levine, S. (June, January 29). Deep Visual Foresight for Planning Robot Motion. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Singapore.
14. A Review of Sensor Technologies for Perception in Automated Driving10.1109/MITS.2019.2907630 ↗
15. Sreenu, G., and Saleem Durai, M.A. (2019). Intelligent Video Surveillance: A Review through Deep Learning Techniques for Crowd Analysis. J. Big Data, 6.10.1186/s40537-019-0212-5 ↗
16. Ekermo, A., and Norell, V. (2013). Reducing the Need for Manual Cleaning Maintenance of Digital Surveillance Cameras–A Conceptual Study. [Master’s Thesis, Lund University].
17. Uřičář, M., Křížek, P., Sistu, G., and Yogamani, S. (2019). SoilingNet: Soiling Detection on Automotive Surround–View Cameras. arXiv.10.1109/ITSC.2019.8917178 ↗
18. Kim, Y., Kim, W., Yoon, J., Chung, S.K., and Kim, D. (2024). Deep Learning-Based Multiple Droplet Contamination Detector for Vision Systems Using a You Only Look Once Algorithm. Information, 15.10.3390/info15030134 ↗
19. Surface Contamination of Cars: A Review10.1177/0954407017695141 ↗
20. Salient Object Detection in the Deep Learning Era: An In-Depth Survey10.1109/TPAMI.2021.3051099 ↗
21. Robustness-Aware 3D Object Detection in Autonomous Driving: A Review and Outlook10.1109/TITS.2024.3439557 ↗
22. Zhang, C., Liu, T., Xiao, J., Lam, K.-M., and Wang, Q. (2023). Boosting Object Detectors via Strong-Classification Weak-Localization Pretraining in Remote Sensing Imagery. IEEE Trans. Instrum. Meas., 72.10.1109/TIM.2023.3315392 ↗
23. Zhang, C., Lam, K.-M., Liu, T., Chan, Y.-L., and Wang, Q. (2024). Structured Adversarial Self-Supervised Learning for Robust Object Detection in Remote Sensing Images. IEEE Trans. Geosci. Remote Sens., 62.10.1109/TGRS.2024.3375398 ↗
24. Zhang, C., Xiao, J., Yang, C., Zhou, J., Lam, K.-M., and Wang, Q. (2024). Integrally Mixing Pyramid Representations for Anchor-Free Object Detection in Aerial Imagery. IEEE Geosci. Remote Sens. Lett., 21.10.1109/LGRS.2024.3404481 ↗
25. Size-Selective Sliding of Sessile Drops on a Slightly Inclined Plane Using Low–Frequency AC Electrowetting10.1021/la2039703 ↗
26. Smart Self–Cleaning Lens Cover for Miniature Cameras of Automobiles10.1016/j.snb.2016.08.032 ↗
27. Lee, S., Lee, D., Hyun, Y., Lee, K.Y., Lee, J., and Chung, S.K. (2023). Self-Cleaning Drop Free Glass Using Droplet Atomization/Oscillation by Acoustic Waves for Autonomous Driving and IoT Technology. Sens. Actuators A Phys., 361.10.1016/j.sna.2023.114565 ↗
28. Alagoz, S., and Apak, Y. (2020). Removal of Spoiling Materials from Solar Panel Surfaces by Applying Surface Acoustic Waves. J. Clean. Prod., 253.10.1016/j.jclepro.2020.119992 ↗
29. Kim, Y., Lee, J., and Chung, S.K. (2023). Heat-Driven Self–Cleaning Glass Based on Fast Thermal Response for Automotive Sensors. Phys. Scr., 98.10.1088/1402-4896/ace38f ↗
30. Park, J., Lee, S., Kim, D.I., Kim, Y.Y., Kim, S., Kim, H.J., and Kim, Y. (2019). Evaporation-Rate Control of Water Droplets on Flexible Transparent Heater for Sensor Application. Sensors, 19.10.3390/s19224918 ↗
31. Adherent Raindrop Modeling, Detection and Removal in Video10.1109/TPAMI.2015.2491937 ↗
32. Qian, R., Tan, R.T., Yang, W., Su, J., and Liu, J. (2018, January 18–23). Attentive Generative Adversarial Network for Raindrop Removal from A Single Image. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00263 ↗
33. Son, S., Lee, W., Jung, H., Lee, J., Kim, C., Lee, H., Park, H., Lee, H., Jang, J., and Cho, S. (2023). Evaluation of Camera Recognition Performance under Blockage Using Virtual Test Drive Toolchain. Sensors, 23.10.3390/s23198027 ↗
34. Lu, S., Zhao, Y., and Hellerman, E.A.P. (2024). UV-Durable Self-Cleaning Coatings for Autonomous Driving. Sci. Rep., 14.10.1038/s41598-024-58549-y ↗
35. Perceived Rain Dynamics on Hydrophilic/Hydrophobic Lens Surfaces and Their Influences on Vehicle Camera Performance10.1139/tcsme-2023-0156 ↗
36. Fursa, I., Fandi, E., Mușat, V., Culley, J., Gil, E., Teeti, I., Bilous, L., Sluis, I.V., Rast, A., and Bradley, A. (2021). Worsening Perception: Real–Time Degradation of Autonomous Vehicle Perception Performance for Simulation of Adverse Weather Conditions. arXiv.10.4271/12-05-01-0008 ↗
37. Estribeau, M., and Magnan, P. (2004, January 19). Fast MTF Measurement of CMOS Imagers Using ISO 12233 Slanted–Edge Methodology. Proceedings of the Optical Systems Design, Etienne, France.10.1117/12.565503 ↗
38. Fabricating Low Cost and High Performance Elastomer Lenses Using Hanging Droplets10.1364/BOE.5.001626 ↗
39. Dodge, S., and Karam, L. (2016, January 6–8). Understanding how image quality affects deep neural networks. Proceedings of the International Conference on Quality of Multimedia Experience (QoMEX), Lisbon, Portugal.10.1109/QoMEX.2016.7498955 ↗
40. Padilla, R., Passos, W.L., Dias, T.L.B., Netto, S.L., and Da Silva, E.A.B. (2021). A Comparative Analysis of Object Detection Metrics with a Companion Open–Source Toolkit. Electronics, 10.10.3390/electronics10030279 ↗
41. Padilla, R., Netto, S.L., and Da Silva, E.A.B. (2020, January 1–3). A survey on performance metrics for object-detection algorithms. Proceedings of the International Conference on Systems, Signals and Image Processing (IWSSIP), Niteroi, Brazil.10.1109/IWSSIP48289.2020.9145130 ↗
42. Zhu, H., Wei, H., Li, B., Yuan, X., and Kehtarnavaz, N. (2020). A Review of Video Object Detection: Datasets, Metrics and Methods. Appl. Sci., 10.10.3390/app10217834 ↗
43. Lyu, C., Zhang, W., Huang, H., Zhou, Y., Wang, Y., Liu, Y., Zhang, S., and Chen, K. (2022). RTMDet: An Empirical Study of Designing Real–Time Object Detectors. arXiv.
44. Qiao, S., Chen, L.-C., and Yuille, A. (2020). DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution. arXiv.10.1109/CVPR46437.2021.01008 ↗
45. Zhang, H., Li, F., Liu, S., Zhang, L., Su, H., Zhu, J., Ni, L.M., and Shum, H.-Y. (2022). DINO: DETR with Improved DeNoising Anchor Boxes for End–to–End Object Detection. arXiv.