journal article·2026-04-23Open access

Unsupervised Hierarchical Visual Taxonomy of Marble Natural Stone Using Cluster-Aware Self-Supervised Vision Transformers

Margarida Figueiredo, Carlos M. A. Diogo, Gustavo Paneiro, Pedro Amaral, António Alves de Campos

Applied Sciences· Volume 16· Issue 9

Abstract

The marble industry relies on proprietary commercial names rather than objective visual categories, creating market inefficiencies for stakeholders who select stones based on appearance. Supervised classification perpetuates this problem by replicating inconsistent commercial labels instead of discovering intrinsic visual structure. We propose an unsupervised pipeline combining a two-stage training strategy: A pure self-supervised pretraining followed by cluster-aware fine-tuning of a DINO Vision Transformer, with empirically selected dimensionality reduction and agglomerative hierarchical clustering. Systematic ablation studies on 1480 marble images spanning 10 commercial varieties validate each design choice: cluster-aware training at k = 10 yields geometrically improved embeddings over the self-supervised baseline (mean Silhouette Score 0.693 ± 0.053 vs. 0.660 ± 0.030; mean Davies–Bouldin Index 0.386 ± 0.075 vs. 0.569 ± 0.012; N = 9 independent evaluations across 3 data partitions × 3 training initializations). The resulting taxonomy reveals three phenomena invisible to commercial classification: cross-category merging of visually indistinguishable stones carrying different market names, intra-category splitting of heterogeneous sub-populations within single varieties, and coherent grouping where commercial and visual boundaries coincide, with all three confirmed in every independent run. We further demonstrate that standard extrinsic metrics are misaligned with unsupervised taxonomy objectives when reference labels encode the inconsistencies the method aims to resolve. Validating this methodology across diverse stone types, larger datasets, and varied acquisition conditions represents a natural and necessary next step toward establishing its cross-domain generalizability.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Building materials and conservation · Mineral Processing and Grinding · Advanced Image and Video Retrieval Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

CERENA, Centro de Recursos Naturais e Ambiente, Instituto Superior Técnico, Universidade de Lisboa, 1049-001 Lisbon, Portugal

DER/CERENA, Centro de Recursos Naturais e Ambiente, Instituto Superior Técnico, Universidade de Lisboa, 1049-001 Lisbon, Portugal

LAETA, IDMEC, Associated Laboratory of Energy, Transports and Aerospace, Instituto Superior Técnico, Universidade de Lisboa, 1049-001 Lisbon, Portugal

Funding

PRR − Recovery and Resilience Plan of the European Union

References (50)

Show source-provided references
1. Pereira, D., and Marker, B. (2016). The Value of Original Natural Stone in the Context of Architectural Heritage. Geosciences, 6.10.3390/geosciences6010013 ↗
2. Verde Macael: A Serpentinite Wrongly Referred to as a Marble10.3390/geosciences3010102 ↗
3. Muñoz-Cervera, M.C., Rodriguez-Garcia, M.Á., and Cañaveras, J.C. (2022). Aesthetic Quality Properties of Carbonate Breccias Associated with Textural and Compositional Factors: Marrón Emperador Ornamental Stone (Upper Cretaceous, Southeast Spain). Appl. Sci., 12.10.3390/app12052566 ↗
4. Strzałkowski, P., Köken, E., and Sousa, L. (2023). Guidelines for Natural Stone Products in Connection with European Standards. Materials, 16.10.3390/ma16216885 ↗
5. Badouna, I., Koutsovitis, P., Karkalis, C., Laskaridis, K., Koukouzas, N., Tyrologou, P., Patronis, M., Papatrechas, C., and Petrounias, P. (2020). Petrological and Geochemical Properties of Greek Carbonate Stones, Associated with Their Physico-Mechanical and Aesthetic Characteristics. Minerals, 10.10.3390/min10060507 ↗
6. An Automated Industrial Conveyor Belt System Using Image Processing and Hierarchical Clustering for Classifying Marble Slabs10.1016/j.rcim.2010.07.004 ↗
7. Surface Defects Detection for Ceramic Tiles Using Image Processing and Morphological Techniques
8. Classification of Marble Using Image Processing10.11648/j.ijdst.20190503.11 ↗
9. A Novel Marble Recognition System Using Extreme Learning Machine with LBP and Histogram Features10.1002/cpe.6428 ↗
10. Ouzounis, A.G., Sidiropoulos, G.K., Papakostas, G.A., Sarafis, I.T., Stamkos, A., and Solakis, G. (2021). Interpretable Deep Learning for Marble Tiles Sorting. Proceedings of the 2nd International Conference on Deep Learning Theory and Applications, DeLTA 2021, SciTePress.10.5220/0010517000002996 ↗
11. Marble Classification Using Deep Neural Networks10.36222/ejt.671527 ↗
12. Ouzounis, A.G., Taxopoulos, G., Papakostas, G.A., Sarafis, I.T., Stamkos, A., and Solakis, G. (2021). Marble Quality Assessment with Deep Learning Regression. Proceedings of the 5th International Conference on Intelligent Computing in Data Sciences, ICDS 2021, Institute of Electrical and Electronics Engineers Inc.10.1109/ICDS53782.2021.9626726 ↗
13. Cascaded and Hierarchical Neural Networks for Classifying Surface Images of Marble Slabs10.1109/TSMCC.2009.2013816 ↗
14. Al-Zoubi1, H.R., Al-Khassaweneh, M.A., and Altawil, I.A. (2015). An Image Processing Approach for Marble Classification. Jordan J. Electr. Eng., 1, 73–81.
15. The System Recognizes Surface Defects Of Marble Slabs Based On Segmentation Methods
16. Sidiropoulos, G.K., Ouzounis, A.G., Papakostas, G.A., Lampoglou, A., Sarafis, I.T., Stamkos, A., and Solakis, G. (2022). Hand-Crafted and Learned Feature Aggregation for Visual Marble Tiles Screening. J. Imaging, 8.10.3390/jimaging8070191 ↗
17. Brondolo, F., and Beaussant, S. (2024). DINOv2 Rocks Geological Image Analysis: Classification, Segmentation, and Interpretability. arXiv.10.1016/j.jrmge.2025.01.057 ↗
18. Scabini, L., Sacilotti, A., Zielinski, K.M., Ribas, L.C., De Baets, B., and Bruno, O.M. (2025). A Comparative Survey of Vision Transformers for Feature Extraction in Texture Analysis. J. Imaging, 11.10.3390/jimaging11090304 ↗
19. Autonomous Detection of Concrete Cracks Using Self-Supervised DinoV210.1007/s11633-025-1553-5 ↗
20. A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends10.1109/TPAMI.2024.3415112 ↗
21. Jaiswal, A., Babu, A.R., Zadeh, M.Z., Banerjee, D., and Makedon, F. (2021). A Survey on Contrastive Self-Supervised Learning. Technologies, 9.10.3390/technologies9010002 ↗
22. Caron, M., Bojanowski, P., Joulin, A., and Douze, M. (2018). Deep Clustering for Unsupervised Learning of Visual Features. Proceedings of the European Conference on Computer Vision (ECCV), Springer.10.1007/978-3-030-01264-9_9 ↗
23. Chen, T., Kornblith, S., Norouzi, M., and Hinton, G. (2020). A Simple Framework for Contrastive Learning of Visual Representations. arXiv.
24. He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R. (2020). Momentum Contrast for Unsupervised Visual Representation Learning. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE Computer Society.10.1109/CVPR42600.2020.00975 ↗
25. Caron, M., Touvron, H., Misra, I., Jégou, H., Mairal, J., Bojanowski, P., and Joulin, A. (2021). Emerging Properties in Self-Supervised Vision Transformers. arXiv.10.1109/ICCV48922.2021.00951 ↗
26. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 3–7). An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale. Proceedings of the ICLR 2021 the Ninth International Conference on Learning Representations, Virtual.
27. A Survey on Vision Transformer10.1109/TPAMI.2022.3152247 ↗
28. Leiber, C., Miklautz, L., Plant, C., and Böhm, C. (2025). An Introductory Survey to Autoencoder-Based Deep Clustering—Sandboxes for Combining Clustering with Deep Learning. arXiv.
29. Xie, J., Girshick, R., and Farhadi, A. (2016). Unsupervised Deep Embedding for Clustering Analysis. arXiv.
30. Wang, R., Li, L., Wang, P., Tao, X., and Liu, P. (2020). Feature-Aware Unsupervised Learning with Joint Variational Attention and Automatic Clustering. Proceedings of the International Conference on Pattern Recognition, Institute of Electrical and Electronics Engineers Inc.
31. Zhou, S., Xu, H., Zheng, Z., Chen, J., Li, Z., Bu, J., Wu, J., Wang, X., Zhu, W., and Ester, M. (2022). A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directions. arXiv.
32. Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
33. Contrastive Clustering
34. Li, J., Zhou, P., Xiong, C., and Hoi, S.C.H. (2021, January 3–7). Prototypical Contrastive Learning Of Unsupervised Representations. Proceedings of the ICLR 2021 the Ninth International Conference on Learning Representations, Virtual.
35. Self-Supervised Learning with Cluster-Aware-DINO for High-Performance Robust Speaker Verification10.1109/TASLP.2023.3331949 ↗
36. Objective-Based Hierarchical Clustering of Deep Embedding Vectors
37. Yang, J., Parikh, D., and Batra, D. (2016). Joint Unsupervised Learning of Deep Representations and Image Clusters. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE Computer Society.10.1109/CVPR.2016.556 ↗
38. Kaufman, L., and Rousseeuw, P.J. (1990). Finding Groups in Data An Introduction to Cluster Analysis, John Wiley& Sons, Inc.10.1002/9780470316801 ↗
39. Loshchilov, I., and Hutter, F. (2019, January 6–9). Decoupled Weight Decay Regularization. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA.
40. Loshchilov, I., and Hutter, F. (2017, January 24–26). SGDR: Stochastic Gradient Descent with Warm Restarts. Proceedings of the International Conference on Learning Representations, Toulon, France.
41. Silhouettes: A Graphical Aid to the Interpretation and Validation of Cluster Analysis10.1016/0377-0427(87)90125-7 ↗
42. A Cluster Separation Measure10.1109/TPAMI.1979.4766909 ↗
43. A Dendrite Method For Cluster Analysis
44. Comparing Partitions10.1007/BF01908075 ↗
45. Cluster Ensembles-A Knowledge Reuse Framework for Combining Multiple Partitions
46. Eisner, J. (2007). V-Measure: A Conditional Entropy-Based External Cluster Evaluation Measure. Proceedings of the Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), Association for Computational Linguistics.
47. The Comparison of Dendrograms by Objective Methods10.2307/1217208 ↗
48. Parametric Umap Embeddings for Representation and Semisupervised Learning
49. Scikit-Learn: Machine Learning in Python
50. SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python10.1038/s41592-019-0686-2 ↗