journal article·2023-04-12Open access

A Novel Moving Object Detection Algorithm Based on Robust Image Feature Threshold Segmentation with Improved Optical Flow Estimation

Jing Ding, Zhen Zhang, Xuexiang Yu, Xingwang Zhao, Zhigang Yan

Applied Sciences· Volume 13· Issue 8

Abstract

The detection of moving objects in images is a crucial research objective; however, several challenges, such as low accuracy, background fixing or moving, ‘ghost’ issues, and warping, exist in its execution. The majority of approaches operate with a fixed camera. This study proposes a robust feature threshold moving object identification and segmentation method with enhanced optical flow estimation to overcome these challenges. Unlike most optical flow Otsu segmentation for fixed cameras, a background feature threshold segmentation technique based on a combination of the Horn–Schunck (HS) and Lucas–Kanade (LK) optical flow methods is presented in this paper. This approach aims to obtain the segmentation of moving objects. First, the HS and LK optical flows with the image pyramid are integrated to establish the high-precision and anti-interference optical flow estimation equation. Next, the Delaunay triangulation is used to solve the motion occlusion problem. Finally, the proposed robust feature threshold segmentation method is applied to the optical flow field to attract the moving object, which is the. extracted from the Harris feature and the image background affine transformation model. The technique uses morphological image processing to create the final moving target foreground area. Experimental results verified that this method successfully detected and segmented objects with high accuracy when the camera was either fixed or moving.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Advanced Vision and Imaging · Advanced Image and Video Retrieval Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Coal Industry Engineering Research Center of Mining Area Environmental and Disaster Cooperative Monitoring, Anhui University of Science and Technology, Huainan 232001, China

School of Geomatics, Anhui University of Science and Technology, Huainan 232001, China

School of Environment and Spatial Informatics, China University of Mining and Technology, Xuzhou 221116, China

Funding

Coal Industry Engineering Research Center of Mining Area Environmental and Disaster Cooperative Monitoring · Major science and technology projects of Anhui Province · Key Research and Development Program of Anhui Province · Major Project on Natural Science Foundation of Universities in Anhui Province · Anhui University of Science and Technology Talent Introduction Research Start-up · Natural Science Foundation Project of Anhui Province

References (42)

Show source-provided references
1. Kulchandani, J.S., and Dangarwala, K.J. (2015, January 8–10). Moving object detection: Review of recent research trends. Proceedings of the 2015 International Conference on Pervasive Computing (ICPC), Pune, India.10.1109/PERVASIVE.2015.7087138 ↗
2. Zhan, C., Duan, X., Xu, S., Song, Z., and Luo, M. (2007, January 22–24). An Improved Moving Object Detection Algorithm Based on Frame Difference and Edge Detection. Proceedings of the Fourth International Conference on Image and Graphics (ICIG 2007), Chengdu, China.10.1109/ICIG.2007.153 ↗
3. Moving objects detection with a moving camera: A comprehensive review10.1016/j.cosrev.2020.100310 ↗
4. New trends on moving object detection in video images captured by a moving camera: A survey10.1016/j.cosrev.2018.03.001 ↗
5. Stojnić, V., Risojević, V., Muštra, M., Jovanović, V., Filipi, J., Kezić, N., and Babić, Z. (2021). A Method for Detection of Small Moving Objects in UAV Videos. Remote Sens., 13.10.3390/rs13040653 ↗
6. Motion detection based on frame difference method
7. Shaikh, S.H., Saeed, K., and Chaki, N. (2014). Moving Object Detection Using Background Subtraction, Springer.10.1007/978-3-319-07386-6 ↗
8. Yin, Z., and Shi, J. (2018, January 18–12). GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake, UT, USA.10.1109/CVPR.2018.00212 ↗
9. Spatial Video Forgery Detection and Localization using Texture Analysis of Consecutive Frames10.4316/AECE.2019.03012 ↗
10. Moving object detection based on frame difference and W410.1007/s11760-017-1093-8 ↗
11. Sengar, S.S., and Mukhopadhyay, S. (2016, January 3–5). A novel method for moving object detection based on block based frame differencing. Proceedings of the 2016 3rd International Conference on Recent Advances in Information Technology (RAIT), Dhanbad, India.10.1109/RAIT.2016.7507946 ↗
12. An effective motion object detection using adaptive background modeling mechanism in video surveillance system10.3233/JIFS-210563 ↗
13. Motion Detection and Tracking using Background Subtraction and Consecutive Frames Difference Method
14. Piccardi, M. (2004, January 10–13). Background subtraction techniques: A review. Proceedings of the 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583), The Hague, The Netherlands.
15. Agarwal, A., Gupta, S., and Singh, D.K. (2016, January 14–17). Review of optical flow technique for moving object detection. Proceedings of the 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I), Greater Noida, India.10.1109/IC3I.2016.7917999 ↗
16. Detection of moving objects based on enhancement of optical flow10.1016/j.ijleo.2017.07.040 ↗
17. Cho, J., Jung, Y., Kim, D.S., Lee, S., and Jung, Y. (2019). Moving Object Detection Based on Optical Flow Estimation and a Gaussian Mixture Model for Advanced Driver Assistance Systems. Sensors, 19.10.3390/s19143217 ↗
18. Optical flow estimation and moving object segmentation based on median radial basis function network10.1109/83.668026 ↗
19. GaliC, S., and LonCariC, S. (2000, January 14–15). Spatio-temporal image segmentation using optical flow and clustering algorithm. Proceedings of the IWISPA 2000, Proceedings of the First International Workshop on Image and Signal Processing and Analysis in Conjunction with 22nd International Conference on Information Technology Interfaces, Pula, Croatia.
20. Motion Detection Based on Optical Flow and Self-adaptive Threshold Segmentation10.1016/j.proeng.2011.08.650 ↗
21. Detection of Moving Object in Moving Background Based on Feature Vector Field Fuzzy Segmentation and OTSU Method
22. Han, X., Gao, Y., Lu, Z., Zhang, Z., and Niu, D. (2015, January 18–20). Research on Moving Object Detection Algorithm Based on Improved Three Frame Difference Method and Optical Flow. Proceedings of the 2015 Fifth International Conference on Instrumentation and Measurement, Computer, Communication and Control (IMCCC), Qinhuangdao, China.10.1109/IMCCC.2015.420 ↗
23. Mendes, P.A., Mendes, M., Coimbra, A.P., and Crisóstomo, M.M. (2019, January 3–5). Movement detection and moving object distinction based on optical flow. Proceedings of the Lecture Notes in Engineering and Computer Science: Proceedings of The World Congress on Engineering, London, UK.10.1007/978-981-15-8273-8_12 ↗
24. Ao, S.I., Gelman, L., and Kim, H.K. (2021). Transactions on Engineering Technologies, Springer.10.1007/978-981-15-8273-8 ↗
25. An Object Detection Method Using Wavelet Optical Flow and Hybrid Linear-Nonlinear Classifier10.1155/2013/965419 ↗
26. Moving Vehicle Detection and Tracking Based on Optical Flow Method and Immune Particle Filter under Complex Transportation Environments10.1155/2020/3805320 ↗
27. Fleet, D.J., and Weiss, Y. (2006). Handbook of Mathematical Models in Computer Vision, Springer.
28. Brox, T., Bruhn, A.E., Papenberg, N., and Weickert, J. (2004, January 11–14). High Accuracy Optical Flow Estimation Based on a Theory for Warping. Proceedings of the 8th European Conference on Computer Vision, Berlin/Heidelberg, Germany.10.1007/978-3-540-24673-2_3 ↗
29. Dynamic texture as foreground and background10.1007/s00138-010-0251-6 ↗
30. Regularization strategies for discontinuity-preserving optical flow methods10.1109/TIP.2016.2526903 ↗
31. Kennedy, R., and Taylor, C.J. (2015). Proceedings of International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, Springer.
32. Motion Occlusion Detecting from Image Sequence Based on Optical Flow and Delaunay Triangulation
33. A Unified Framework for High-Dimensional Analysis of $M$-Estimators with Decomposable Regularizers10.1214/12-STS400 ↗
34. Rosten, E., and Drummond, T. (2005, January 17–20). Fusing Points and Lines for High Performance Tracking. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV’05), Beijing, China.10.1109/ICCV.2005.104 ↗
35. Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 7–13). SURF: Speeded up robust features. Proceedings of Proceedings of the 9th European Conference on Computer Vision (ECCV), Graz, Austria.10.1007/11744023_32 ↗
36. Harris, C.G., and Stephens, M. (September, January 31). A Combined Corner and Edge Detector. Proceedings of the Alvey Vision Conference, Manchester, UK.
37. Butler, D.J., Wulff, J., Stanley, G.B., and Black, M.J. (2012, January 7). A naturalistic open source movie for optical flow evaluation. Proceedings of the European Conference on Computer Vision (ECCV), Berlin/Heidelberg, Germany.10.1007/978-3-642-33783-3_44 ↗
38. Lucas, B.D., and Kanade, T. (1981, January 24–28). An Iterative Image Registration Technique with an Application to Stereo Vision. Proceedings of the IJCAI’81: 7th International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada.
39. Segmentation of optical flow fields by pyramid linking10.1016/0167-8655(85)90005-4 ↗
40. Black, M.J., and Anandan, P. (1993, January 11–14). A framework for the robust estimation of optical flow. Proceedings of the 1993 (4th) International Conference on Computer Vision, Berlin, Germany.
41. Large displacement optical flow: Descriptor matching in variational motion estimation10.1109/TPAMI.2010.143 ↗
42. Motion detection using binocular image flow in dynamic scenes10.1186/s13634-016-0349-8 ↗