journal article·2024Open access

Unsupervised Color Segmentation with Reconstructed Spatial Weighted Gaussian Mixture Model and Random Color Histogram

Umer Sadiq Khan, Zhen Liu, Fang Xu, Muhib Ullah Khan, Lerui Chen, Touseef Ahmed Khan, Muhammad Kashif Khattak, Yuquan Zhang

Computers, Materials & Continua· Volume 78· Issue 3

Abstract

Image classification and unsupervised image segmentation can be achieved using the Gaussian mixture model. Although the Gaussian mixture model enhances the flexibility of image segmentation, it does not reflect spatial information and is sensitive to the segmentation parameter. In this study, we first present an efficient algorithm that incorporates spatial information into the Gaussian mixture model (GMM) without parameter estimation. The proposed model highlights the residual region with considerable information and constructs color saliency. Second, we incorporate the content-based color saliency as spatial information in the Gaussian mixture model. The segmentation is performed by clustering each pixel into an appropriate component according to the expectation maximization and maximum criteria. Finally, the random color histogram assigns a unique color to each cluster and creates an attractive color by default for segmentation. A random color histogram serves as an effective tool for data visualization and is instrumental in the creation of generative art, facilitating both analytical and aesthetic objectives. For experiments, we have used the Berkeley segmentation dataset BSDS-500 and Microsoft Research in Cambridge dataset. In the study, the proposed model showcases notable advancements in unsupervised image segmentation, with probabilistic rand index (PRI) values reaching 0.80, BDE scores as low as 12.25 and 12.02, compactness variations at 0.59 and 0.7, and variation of information (VI) reduced to 2.0 and 1.49 for the BSDS-500 and MSRC datasets, respectively, outperforming current leading-edge methods and yielding more precise segmentations.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Visual Attention and Saliency Detection · Advanced Image and Video Retrieval Techniques · Image Retrieval and Classification Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (93)

Show source-provided references
1. Significantly fast and robust fuzzy c-means clustering algorithm based on morphological reconstruction and membership filtering10.1109/TFUZZ.2018.2796074 ↗
2. Superpixel-based fast fuzzy C-means clustering for color image segmentation10.1109/TFUZZ.2018.2889018 ↗
3. Understanding deep learning techniques for image segmentation10.1145/3329784 ↗
4. A view of computational models for image segmentation10.1007/s11565-022-00417-6 ↗
5. R. Aslanzadeh, K. Qazanfari, and M. Rahmati, “An efficient evolutionary based method for image segmentation,” arXiv preprint arXiv:1709.04393, 2017.
6. Techniques and challenges of image segmentation: A review10.3390/electronics12051199 ↗
7. Image thresholding approaches for medical image segmentation-short literature review10.1016/j.procs.2023.01.439 ↗
8. Brain tumor segmentation and identification using particle imperialist deep convolutional neural network in MRI images10.9781/ijimai.2022.10.006 ↗
9. Image segmentation using deep learning: A survey
10. A double clustering approach for color image segmentation10.1155/2023/1039870 ↗
11. Obinata · Vision Systems: Segmentation and Pattern Recognition · 2007
12. Ivanov · Computer Vision Depth Segmentation Using Virtual Surface · 2005
13. Object recognition, segmentation, and classification of mobile laser scanning point clouds: A state of the art review10.3390/s19040810 ↗
14. S. Caelles, J. Pont-Tuset, F. Perazzi, A. Montes, K. K. Maninis, and L. van Gool, “The 2019 DAVIS challenge on VOS: Unsupervised multi-object segmentation,” arXiv preprint arXiv:1905.00737, 2019.
15. Fast online object tracking and segmentation: A unifying approach
16. Boundary-aware feature propagation for scene segmentation
17. BASNet: Boundary-aware salient object detection
18. Strategies for image segmentation combining region and boundary information10.1016/S0167-8655(02)00262-3 ↗
19. Modified grasshopper algorithm-based multilevel thresholding for color image segmentation10.1109/ACCESS.2019.2891673 ↗
20. Automatic fuzzy clustering framework for image segmentation10.1109/TFUZZ.2019.2930030 ↗
21. Survey on image segmentation techniques10.1016/j.procs.2015.09.027 ↗
22. Dual-path convolutional image-text embeddings with instance loss10.1145/3383184 ↗
23. Modality-invariant image-text embedding for image-sentence matching
24. Robust single-object image segmentation based on salient transition region10.1016/j.patcog.2015.10.009 ↗
25. Information transfer in semi-supervised semantic segmentation
26. Incorporating global multiplicative decomposition and local statistical information for brain tissue segmentation and bias field estimation10.1016/j.knosys.2021.107070 ↗
27. Medical image segmentation using deep learning: A survey10.1049/ipr2.12419 ↗
28. Robust deep learning object recognition models rely on low frequency information in natural images10.1371/journal.pcbi.1010932 ↗
29. Edge intelligence empowered vehicle detection and image segmentation for autonomous vehicles10.1109/TITS.2022.3232153 ↗
30. An effective bi-layer content-based image retrieval technique10.1007/s11227-022-04748-1 ↗
31. Plant trait estimation and classification studies in plant phenotyping using machine vision-A review
32. Saliency-CCE: Exploiting colour contextual extractor and saliency-based biomedical image segmentation10.1016/j.compbiomed.2023.106551 ↗
33. Deep hyperspherical clustering for skin lesion medical image segmentation10.1109/JBHI.2023.3240297 ↗
34. Doubly right object recognition: A why prompt for visual rationales
35. Compositional clustering: Applications to multi-label object recognition and speaker identification10.1016/j.patcog.2023.109829 ↗
36. Automated detection of vehicles with anomalous trajectories in traffic surveillance videos10.3233/ICA-230706 ↗
37. Classification and feature extraction for remote sensing images from urban areas based on morphological transformations10.1109/TGRS.2003.814625 ↗
38. Urban-area and building detection using SIFT keypoints and graph theory10.1109/TGRS.2008.2008440 ↗
39. Improved harris feature point set for orientation-sensitive urban-area detection in aerial images10.1109/LGRS.2012.2224315 ↗
40. Color image segmentation using adaptive mean shift and statistical model-based methods10.1016/j.camwa.2008.10.053 ↗
41. Superpixel segmentation using Gaussian mixture model10.1109/TIP.2018.2836306 ↗
42. Color image segmentation using adaptive spatial Gaussian mixture model
43. Evaluation of modified adaptive k-means segmentation algorithm
44. Unsupervised image compression using graphcut texture synthesis
45. ABANICCO: A new color space for multi-label pixel classification and color analysis10.3390/s23063338 ↗
46. CGFFCM: A color image segmentation method based on cluster-weight and feature-weight learning10.1016/j.simpa.2022.100228 ↗
47. Direct clustering of a data matrix10.1080/01621459.1972.10481214 ↗
48. Semantic segmentation for remote sensing image using the multi-granularity object-based markov random field with blinking coefficient10.1109/TGRS.2023.3301494 ↗
49. Skin lesion segmentation based on region-edge Markov random field
50. Markov random fields and Gibbs random fields10.1007/BF02761538 ↗
51. Object-based hyperspectral image classification using a new latent block model based on hidden Markov random fields10.1007/s10044-021-01050-3 ↗
52. Gaussian Markov random field based improved texture descriptor for image segmentation10.1016/j.imavis.2014.07.002 ↗
53. Multifactorial estimation of clinical outcome in HPV-associated oropharyngeal squamous cell carcinoma via automated image analysis of routine diagnostic H&E slides and neural network modelling10.1016/j.oraloncology.2023.106399 ↗
54. Unsupervised 4D lidar moving object segmentation in stationary settings with multivariate occupancy time series
55. On methods for merging mixture model components suitable for unsupervised image segmentation tasks10.3390/math10224301 ↗
56. Balasubramanian · Human Vision and Electronic Imaging XIII · 2008 · 6806 · 68061H10.1117/12.766184 ↗
57. M. Bosch, C. M. Gifford, A. G. Dress, C. W. Lau, J. G. Skibo and G. A. Christie, “Improved image segmentation via cost minimization of multiple hypotheses,” arXiv preprint arXiv:1802.00088, 2018.10.5244/C.31.7 ↗
58. Unsupervised image segmentation by backpropagation
59. Automatic fuzzy clustering framework for image segmentation10.1109/TFUZZ.2019.2930030 ↗
60. Count data modeling and classification using finite mixtures of distributions10.1109/TNN.2010.2091428 ↗
61. Twenty years of mixture of experts10.1109/TNNLS.2012.2200299 ↗
62. Accurate image segmentation using Gaussian mixture model with saliency map10.1007/s10044-017-0672-1 ↗
63. Finite generalized Gaussian mixture modeling and applications to image and video foreground segmentation
64. Illumination invariant background model using mixture of Gaussians and SURF features
65. Maximum likelihood from incomplete data via the EM algorithm10.1111/j.2517-6161.1977.tb01600.x ↗
66. Maximum likelihood estimation from fuzzy data using the EM algorithm10.1016/j.fss.2011.05.022 ↗
67. McLachlan · The EM Algorithm and Extensions · 2007
68. Segmentation of 4D cardiac MR images using a probabilistic atlas and the EM algorithm10.1016/j.media.2004.06.005 ↗
69. A spatially constrained mixture model for image segmentation10.1109/TNN.2004.841773 ↗
70. Gaussian-mixture-model-based spatial neighborhood relationships for pixel labeling problem10.1109/TSMCB.2011.2161284 ↗
71. A fuzzy clustering approach toward hidden Markov random field models for enhanced spatially constrained image segmentation10.1109/TFUZZ.2008.2005008 ↗
72. An introduction to mixture models
73. Performance evaluation of finite normal mixture model-based image segmentation techniques10.1109/TIP.2003.817251 ↗
74. A vectorial image soft segmentation method based on neighborhood weighted Gaussian mixture model10.1016/j.compmedimag.2009.07.001 ↗
75. Image segmentation by a robust modified gaussian mixture model
76. Incorporating mean template into finite mixture model for image segmentation10.1109/TNNLS.2012.2228227 ↗
77. Frequency-tuned salient region detection
78. Saliency detection: A spectral residual approach
79. Color image segmentation based on different color space models using automatic GrabCut10.1155/2014/126025 ↗
80. Improved unsupervised color segmentation using a modified color model and a bagging procedure in-means10.1155/2018/2786952 ↗
81. Color spaces and image segmentation10.1016/S1076-5670(07)00402-8 ↗
82. YUV vs RGB-Choosing a color space for human-machine interaction10.15439/2014F206 ↗
83. 3-D histogram modification of color images10.1109/ICIP.1996.561000 ↗
84. Sangwine · The Colour Image Processing Handbook · 2012
85. Spectral residual model for rural residential region extraction from GF-1 satellite images
86. Contour detection and hierarchical image segmentation10.1109/TPAMI.2010.161 ↗
87. A database of human segmented natural images and its application to evaluating segmentation algorithms
88. TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation
89. Toward objective evaluation of image segmentation algorithms10.1109/TPAMI.2007.1046 ↗
90. A global/local affinity graph for image segmentation10.1109/TIP.2015.2397313 ↗
91. Laplacian coordinates: Theory and methods for seeded image segmentation10.1109/TPAMI.2020.2974475 ↗
92. Residual-driven fuzzy C-means clustering for image segmentation10.1109/JAS.2020.1003420 ↗
93. Robust self-sparse fuzzy clustering for image segmentation10.1109/ACCESS.2020.3015270 ↗