journal article·2019-11-30Open access

Combination of Spatial and Frequency Domains for Floating Object Detection on Complex Water Surfaces

Xin Sun, Hao Deng, Guihua Liu, Xin Deng

Applied Sciences· Volume 9· Issue 23

Abstract

In order to address the problems of various interference factors and small sample acquisition in surface floating object detection, an object detection algorithm combining spatial and frequency domains is proposed. Firstly, a rough texture detection is performed in a spatial domain. A Fused Histogram of Oriented Gradient (FHOG) is combined with a Gray Level Co-occurrence Matrix (GLCM) to describe global and local information of floating objects, and sliding windows are classified by Support Vector Machines (SVM) with new texture features. Then, a novel frequency-based saliency detection method used in complex scenes is proposed. It adopts global and local low-rank decompositions to remove redundant regions caused by multiple interferences and retain floating objects. The final detection result is obtained by a strategy of combining bounding boxes from different processing domains. Experimental results show that the overall performance of the proposed method is superior to other popular methods, including traditional image segmentation, saliency detection, hand-crafted texture detection, and Convolutional Neural Network Based (CNN-based) object detection. The proposed method is characterized by small sample training and strong anti-interference ability in complex water scenes like ripple, reflection, and uneven illumination. The average precision of the proposed is 97.2%, with only 0.504 seconds of time consumption.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Visual Attention and Saliency Detection · Image Enhancement Techniques · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information Engineering, Southwest University of Science and Technology, Mianyang 621010, China

Funding

National Natural Science Foundation of China

References (38)

Show source-provided references
1. Interception effect of riparian vegetation zone on floats and factors affecting it
2. Design and implementation of the visual detection system for amphibious robots
3. Multi-AUV cooperative target hunting based on improved potential field in underwater environment10.3390/app8060973 ↗
4. Research and application of binarization algorithm of QR code image under complex illumination
5. Static water object detection and segmentation
6. Foreground and background segmentation based on super pixel level feature representation
7. A target detection algorithm for surface cleaning robot based on machine vision
8. A threshold selection method from gray-histogram
9. A GMM-based segmentation method for the detection of water surface floats10.1109/ACCESS.2019.2937129 ↗
10. Improved space object detection using short-exposure image data with daylight background10.1364/AO.57.003968 ↗
11. Zhang, Z., Li, D., Liu, S., Xiao, B., and Cao, X. (2018). Multi-View Ground-Based Cloud Recognition by Transferring Deep Visual Information. Appl. Sci., 8.10.3390/app8050748 ↗
12. How daylight influences high-order chromatic descriptors in natural images10.1364/AO.56.00G120 ↗
13. Navneet, D., and Triggs, B. (2015, January 8–10). Histograms of oriented gradients for human detection. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA.
14. Comparing LBP, HOG and Deep Features for Classification of Histopathology Images
15. GLCM-Based Texture Feature Extraction
16. Dai, J., Li, Y., He, K., and Sun, J. (2016, January 5–10). R-FCN: Object detection via region-based fully convolutional networks. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Barcelona, Spain.
17. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. SSD: Single shot multibox detector. Proceedings of European Conference on Computer Vision, Springer.
18. Zhang, S., Wen, L., Bian, X., Lei, Z., and Li, S.Z. (2018, January 18–22). Single-shot refinement neural network for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, Utah.10.1109/CVPR.2018.00442 ↗
19. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 26–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
20. Global contrast based salient region detection10.1109/TPAMI.2014.2345401 ↗
21. Perazzi, F., Krähenbühl, P., Pritch, Y., and Hornung, A. (2012, January 16–21). Saliency filters: Contrast based filtering for salient region detection. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.10.1109/CVPR.2012.6247743 ↗
22. Zhang, J., and Sclaroff, S. (2013, January 25–27). Saliency detection: A boolean map approach. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.10.1109/ICCV.2013.26 ↗
23. Hou, X., and Zhang, L. (2007, January 20–23). Saliency detection: A spectral residual approach. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.10.1109/CVPR.2007.383267 ↗
24. Achanta, R., Hemami, S., Estrada, F., and Süsstrunk, S. (2009, January 20–25). Frequency-tuned salient region detection. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Miami Beach, FL, USA.10.1109/CVPR.2009.5206596 ↗
25. Achanta, R., and Süsstrunk, S. (2010, January 26–29). Saliency detection using maximum symmetric surround. Proceedings of the 2010 IEEE International Conference on Image Processing, Hong Kong, China.10.1109/ICIP.2010.5652636 ↗
26. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
27. Yang, W., Wang, Y., Vahdat, A., and Mori, G. (2012, January 10–12). Kernel latent SVM for visual recognition. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, CA, USA.
28. A tutorial on ν-support vector machines10.1002/asmb.537 ↗
29. Object detection with discriminatively trained part-based models10.1109/TPAMI.2009.167 ↗
30. Salient Object Detection: A. Survey10.1007/s41095-019-0149-9 ↗
31. Li, C., Hu, Z., Xiao, L., and Pan, Z. (2016, January 27–29). Saliency detection via low-rank reconstruction from global to local. Proceedings of the Chinese Automation Congress (CAC), Guangzhou, China.
32. Ito, S., Soga, M., Hiratsuka, S., Matsubara, H., and Ogawa, M. (2019). Quality Index of Supervised Data for Convolutional Neural Network-Based Localization. Appl. Sci., 9.10.3390/app9101983 ↗
33. Koishi, Y., Ishida, S., Tabaru, T., and Miyamoto, H. (2019). A source domain extension method for inductive transfer learning based on flipping output. Algorithms, 12.10.3390/a12050095 ↗
34. Sun, Q., Liu, Y., Chua, T.-S., and Schiele, B. (2019, January 16–19). Meta-transfer learning for few-shot learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00049 ↗
35. Chen, C.-H., Kung, H.-Y., and Hwang, F.-J. (2019). Deep learning techniques for agronomy applications. Agronomy, 9.10.3390/agronomy9030142 ↗
36. Cubuk, E.D., Zoph, B., Mane, D., Vasudevan, V., and Le, Q.V. (2018). Autoaugment: Learning augmentation policies from data. arXiv.10.1109/CVPR.2019.00020 ↗
37. Saliency Detection by Multitask Sparsity Pursuit10.1109/TIP.2011.2169274 ↗
38. Research on Automatic Monitoring Method of River Floats