The Design of a Video Reflection Removal Method Based on Illumination Compensation and Image Completion Fusion
Source abstract
Abstract
Our objective is to develop a video reflection removal algorithm that is both easy to compute and effective. Unlike previous methods that depend on machine learning, our approach proposes a local image reflection removal technique that combines image completion and lighting compensation. To achieve this, we utilized the MSER image region feature point matching method to reduce image processing time and the spatial area of layer separation regions. In order to improve the adaptability of our method, we implemented a local image reflection removal technique that utilizes image completion and lighting compensation to interpolate layers and update motion field data in real-time. Our approach is both simple and efficient, allowing us to quickly obtain reflection-free video sequences under a variety of lighting conditions. This enabled us to achieve real-time detection effects through video restoration. This experiment has confirmed the efficacy of our method and demonstrated its comparable performance to advanced methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Vision and Imaging · Image Enhancement Techniques · Advanced Image Processing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China
Collaborative Innovation Center of New Energy Automotive, Shandong University of Technology, Zibo 255000, China
Funding
National Natural Science Foundation of China · Natural Science Foundation of Shandong Province · Experiment technology upgrading project · Shandong provincial programme of introducing and cultivating talents of discipline to universities: research and innovation team of intelligent connected vehicle technology
References (34)
Show source-provided references
1. Chen, J. (2021). Single Image Reflection Removal with Camera Calibration. [Master’s Thesis, Nanyang Technological University].
2. User assisted separation of reflections from a single image using a sparsity prior10.1109/TPAMI.2007.1106 ↗
3. Li, Y., and Brown, M.S. (2014, January 23–28). Single image layer separation using relative smoothness. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.346 ↗
4. Zhang, Y.N., Shen, L., and Li, Q. (2021, January 10–14). Content and Gradient Model-driven Deep Network for Single Image Reflection Removal. Proceedings of the 30th ACM International Conference on Multimedia, Lisbon, Portugal.10.1145/3503161.3547918 ↗
5. Zheng, Q., Qiao, X., Cao, Y., Guo, S., Zhang, L., and Lau, R.W. (2021, January 11–17). Distilling Reflection Dynamics for Single-Image Reflection Removal. Proceedings of the IEEE/CVF International Conference on Computer Vision, Venice, Italy.10.1109/ICCVW54120.2021.00215 ↗
6. Single image reflection removal using non-linearly synthesized glass images and semantic context10.1109/ACCESS.2019.2955994 ↗
7. Single-image reflection removal via a two-stage background recovery process10.1109/LSP.2019.2926828 ↗
8. Chi, Z., Wu, X., Shu, X., and Gu, J. (2018). Single image reflection removal using deep encoder-decoder network. arXiv.
9. Li, Y., Liu, M., Yi, Y., Li, Q., Ren, D., and Zuo, W. (2020). Two-Stage Single Image Reflection Removal with Reflection-Aware Guidance. arXiv.
10. Chang, Y.C., Lu, C.N., Cheng, C.C., and Chiu, W.C. (2021, January 5–9). Single image reflection removal with edge guidance, reflection classifier, and recurrent decomposition. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Virtual Conference.10.1109/WACV48630.2021.00208 ↗
11. Fan, Q., Yang, J., Hua, G., Chen, B., and Wipf, D. (2017, January 22–29). A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.351 ↗
12. Yang, J., Gong, D., Liu, L., and Shi, Q. (2018, January 8–14). Seeing deeply and bidirectionally: A deep learning approach for single image reflection removal. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01219-9_40 ↗
13. Li, C., Yang, Y., He, K., Lin, S., and Hopcroft, J.E. (2019, January 15–20). Single image reflection removal through cascaded refinement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR42600.2020.00362 ↗
14. Wen, Q., Tan, Y., Qin, J., Liu, W., Han, G., and He, S. (2019, January 15–20). Single image reflection removal beyond linearity. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00389 ↗
15. Low-Light Image Enhancement via a Deep Hybrid Network10.1109/TIP.2019.2910412 ↗
16. Aizu, T., and Matsuoka, R. (September, January 29). Reflection Removal Using Multiple Polarized Images with Different Exposure Times. Proceedings of the 30th European Signal Processing Conference (EUSIPCO), Belgrade, Serbia.
17. Szeliski, R., Avidan, S., and Anandan, P. (2000, January 15). Layer extraction from multiple images containing reflections and transparency. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition—CVPR 2000, Hilton Head, SC, USA.
18. Li, Y., and Brown, M.S. (2015, January 7–13). Exploiting reflection change for automatic reflection removal. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.
19. Sun, C., Liu, S., Yang, T., Zeng, B., Wang, Z., and Liu, G. (2016, January 15–19). Automatic reflection removal using gradient intensity and motion cues. Proceedings of the 24th ACM International Conference on Multimedia, Amsterdam, The Netherlands.10.1145/2964284.2967264 ↗
20. Bonekamp, J. (2021). Multi-Image Optimization Based Specular Reflection Removal from Non-Dielectric Surfaces. [Master’s Thesis, Delft University of Technology].
21. Wan, R., Shi, B., Duan, L.Y., and Tan, A.H. (2018, January 19–21). Crrn: Multi-scale guided concurrent reflection removal network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00502 ↗
22. A computational approach for obstruction-free photography. ACM Trans
23. Reflection removal under fast forward camera motion
24. Iwata, S., Ogata, K., Sakaino, S., and Tsuji, T. (2015, January 9–12). Specular reflection removal with high-speed camera for video imaging. Proceedings of the IECON 2015—41st Annual Conference of the IEEE Industrial Electronics Society, Yokohama, Japan.10.1109/IECON.2015.7392352 ↗
25. Alayrac, J.B., Carreira, J., and Zisserman, A. (2019, January 15–20). The visual centrifuge: Model-free layered video representations. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00256 ↗
26. Li, T., and Lun, D.P.K. (2018, January 27–30). A novel reflection removal algorithm using the light field camera. Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS), Florence, Italy.10.1109/ISCAS.2018.8351103 ↗
27. Lei, C., and Chen, Q. (2021, January 20–25). Robust reflection removal with reflection-free flash-only cues. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01457 ↗
28. Robust reflection removal based on light field imaging10.1109/TIP.2018.2880510 ↗
29. Punnappurath, A., and Brown, M.S. (2019, January 5–9). Reflection removal using a dual-pixel sensor. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR.2019.00165 ↗
30. Hong, Y., Lyu, Y., Li, S., and Shi, B. (2020, January 6–10). Near-infrared image guided reflection removal. Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), London, UK.10.1109/ICME46284.2020.9102937 ↗
31. Sheridan, K., Puranik, T.G., Mangortey, E., Pinon, O.J., Kirby, M., and Mavris, D. (2020, January 6–10). An Application of DBSCAN Clustering for Flight Anomaly Detection during the Approach Phase. Proceedings of the AIAA SciTech Forum, Orlando, FL, USA.10.2514/6.2020-1851 ↗
32. An Obstacle Detection and Distance Measurement Method for Sloped Roads Based on VIDAR
33. Nandoriya, A., Elgharib, M., Kim, C., Hefeeda, M., and Matusik, W. (2017, January 22–29). Video reflection removal through spatio-temporal optimization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.264 ↗
34. Simon, C., and Kyu Park, I. (2015, January 7–12). Reflection removal for in-vehicle black box videos. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7299051 ↗