journal article·2022-06-29Open access

Three-Dimensional Object Segmentation and Labeling Algorithm Using Contour and Distance Information

Wen-Chien Lo, Chung-Cheng Chiu, Jia-Horng Yang

Applied Sciences· Volume 12· Issue 13

Abstract

Object segmentation and object labeling are important techniques in the field of image processing. Because object segmentation techniques developed using two-dimensional images may cause segmentation errors for overlapping objects, this paper proposes a three-dimensional object segmentation and labeling algorithm that combines the segmentation and labeling functions using contour and distance information for static images. The proposed algorithm can segment and label the object without relying on the dynamic information of consecutive images and without obtaining the characteristics of the segmented objects in advance. The algorithm can also effectively segment and label complex overlapping objects and estimate the object’s distance and size according to the labeling contour information. In this paper, a self-made image capture system is developed to capture test images and the actual distance and size of the objects are also measured using measuring tools. The measured data is used as a reference for the estimated data of the proposed algorithm. The experimental results show that the proposed algorithm can effectively segment and label the complex overlapping objects, obtain the estimated distance and size of each object, and satisfy the detection requirements of objects at a long-range in outdoor scenes.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotics and Sensor-Based Localization · Image and Object Detection Techniques · Visual Attention and Saliency Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical and Electronics Engineering, Chung Cheng Institute of Technology, National Defense University, Taoyuan 33551, Taiwan

Funding

Ministry of Science and Technology of Taiwan

References (39)

Show source-provided references
1. By leaps and bounds: An exclusive look at how Boston dynamics is redefining robot agility10.1109/MSPEC.2019.8913831 ↗
2. Kim, D., Carballo, D., Di Carlo, J., Katz, B., Bledt, G., Lim, B., and Kim, S. (August, January 31). Vision aided dynamic exploration of unstructured terrain with a small-scale quadruped robot. Proceedings of the IEEE International Conference on Robotics and Automation, Paris, France.
3. Autonomous driving cars in smart cities: Recent advances, requirements, and challenges10.1109/MNET.2019.1900120 ↗
4. A survey on 3D object detection methods for autonomous driving applications10.1109/TITS.2019.2892405 ↗
5. Foreground gating and background refining network for surveillance object detection10.1109/TIP.2019.2922095 ↗
6. A gray relational analysis-based motion detection algorithm for real-world surveillance sensor deployment10.1109/JSEN.2018.2879187 ↗
7. Vision-based real-time aerial object localization and tracking for UAV sensing system10.1109/ACCESS.2017.2764419 ↗
8. Autonomous learning of object models on a mobile robot10.1109/LRA.2016.2522086 ↗
9. Rychtáriková, R., Korbel, J., Macháček, P., and Štys, D. (2018). Point Divergence Gain and Multidimensional Data Sequences Analysis. Entropy, 20.10.3390/e20020106 ↗
10. Detecting salient motion by accumulating directionally-consistent flow10.1109/34.868680 ↗
11. A comprehensive survey of video datasets for background subtraction10.1109/ACCESS.2019.2914961 ↗
12. A robust object segmentation system using a probability-based background extraction algorithm10.1109/TCSVT.2009.2035843 ↗
13. Fast multilevel thresholding for image segmentation through a multiphase level set method10.1016/j.sigpro.2012.07.010 ↗
14. Segmentation of color textures10.1109/34.825753 ↗
15. Color-based object segmentation method using artificial neural network10.1016/j.simpat.2016.02.011 ↗
16. Region-based object recognition by color segmentation using a simplified PCNN10.1109/TNNLS.2014.2351418 ↗
17. Automatic image segmentation by integrating color-edge extraction and seeded region growing10.1109/83.951532 ↗
18. Edge boxes: Locating object proposals from edges
19. Object detection and tracking under occlusion for object-level RGB-D video segmentation10.1109/TMM.2017.2751965 ↗
20. Stereo video object segmentation using stereoscopic foreground trajectories10.1109/TCYB.2018.2846361 ↗
21. Fast motion object detection algorithm using complementary depth image on an RGB-D camera10.1109/JSEN.2017.2723599 ↗
22. A robust competitive clustering algorithm with applications in computer vision10.1109/34.765656 ↗
23. Range image segmentation into planar and quadric surfaces using an improved robust estimator and genetic algorithm10.1109/TSMCB.2004.835082 ↗
24. Consistent depth video segmentation using adaptive surface models10.1109/TCYB.2014.2324815 ↗
25. Sequential operations in digital picture processing10.1145/321356.321357 ↗
26. Haralick, R.M. (1981). Some neighborhood operations. Real-Time Parallel Computing, Springer.10.1007/978-1-4684-3893-2_2 ↗
27. The connected-component labeling problem: A review of state-of-the-art algorithms10.1016/j.patcog.2017.04.018 ↗
28. Chen, S.C., and Chiu, C.C. (2019). Texture construction edge detection algorithm. Appl. Sci., 9.10.3390/app9050897 ↗
29. Gao, J., and Liu, N. (2012, January 23–25). An improved adaptive threshold canny edge detection algorithm. Proceedings of the International Conference on Computer Science and Electronics Engineering, Hangzhou, China.
30. Song, Q., Lin, G., Ma, J., and Zhang, H. (2016, January 27–29). An edge-detection method based on adaptive canny algorithm and iterative segmentation threshold. Proceedings of the 2nd International Conference on Control Science and Systems Engineering (ICCSSE), Singapore.
31. Lunar surface crater topology generation using adaptive edge detection algorithm10.1049/iet-ipr.2015.0232 ↗
32. Li, X., and Zhang, H. (2017, January 24–26). An improved canny edge detection algorithm. Proceedings of the 8th IEEE International Conference on Software Engineering and Service Science (ICSESS), Beijing, China.
33. (2019, January 15). Oung Dustin’s Album. Available online: https://www.flickr.com/photos/idostone/15986200330/.
34. Vision meets robotics: The kitti dataset10.1177/0278364913491297 ↗
35. Labayrade, R., Aubert, D., and Tarel, J.P. (2002, January 17–21). Real time obstacle detection in stereovision on non flat road geometry through “v-disparity” representation. Proceedings of the Intelligent Vehicle Symposium, Versailles, France.
36. Hough, P.V. (1962). Method and Means for Recognizing Complex Patterns. (3,069,654), U.S. Patent.
37. Papamarkos, N., Tzortzakis, J., and Gatos, B. (1996, January 16). Determination of run-length smoothing values for document segmentation. Proceedings of the Third International Conference on Electronics, Circuits, and Systems, Rhodes, Greece.
38. High-resolution stereo datasets with subpixel-accurate ground truth10.1007/978-3-319-11752-2_3 ↗
39. Tan, J., Gao, M., Yang, K., and Duan, T. (2021). Remote Sensing Road Extraction by Road Segmentation Network. Appl. Sci., 11.10.3390/app11115050 ↗