Enhancing digital preservation of Indian art heritage through fusion based deep learning CBIR system
Source abstract
Abstract
In digital archives and cultural preservation, effective image retrieval from extensive datasets is critical. This study develops an efficient Content-Based Image Retrieval (CBIR) system for retrieving culturally significant Indian paintings, enhancing digital accessibility and preservation. It focuses on diverse styles like Gond, Pichwai, Madhubani, Mandla, and Warli. Traditional CBIR relies on handcrafted features, which are time-consuming and less effective. This study proposes a fusion approach using EfficientNetB0 and ResNet50, to enhance retrieval accuracy. Further, Recursive Feature Elimination (RFE) optimizes dimensionality reduction. Various distance metrics, including Hamming, Minkowski, cosine similarity, Jaccard, Euclidean, and Manhattan, compute similarity scores. Performance is assessed using precision, recall, and F1-score. The mean average values of precision, recall, and F1-score of the proposed CBIR system on the TIAPD dataset come out to be 91.64%, 18.17%, and 29.54% respectively. This research not only enhances retrieval accuracy but also contributes to the digital preservation of India’s artistic heritage.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Image and Video Retrieval Techniques · Image Retrieval and Classification Techniques · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (40)
Show source-provided references
1. Müller, H., Müller, W., Squire, D. M., Marchand-Maillet, S. & Pun, T. Performance evaluation in content-based image retrieval: overview and proposals. Pattern Recognit. Lett. 22, 593–601 (2001).10.1016/S0167-8655(00)00118-5 ↗
2. Liu, Y., Zhang, D., Lu, G. & Ma, W. Y. A survey of content-based image retrieval with high-level semantics. Pattern Recognit. 40, 262–282 (2007).10.1016/j.patcog.2006.04.045 ↗
3. Lombardi, T., Cha, S. H. & Tappert, C. A lightweight image retrieval system for paintings. In Proc. Storage and Retrieval Methods and Applications for Multimedia 2005 Vol. 5682, 236–246 (SPIE, 2005).10.1117/12.587353 ↗
4. Lewis, P. H. et al. An integrated content and metadata based retrieval system for art. Trans. Pattern Anal. Mach. Intell. 22, 1349–1380 (2000).10.1109/34.895972 ↗
5. Yen, S. H., Hsieh, M. H., Wang, C. J. & Lin H. J. A content-based painting image retrieval system based on Adaboost algorithm. In Proc. 2006 IEEE International Conference on Systems, Man and Cybernetics Vol. 3, 2407–2412 (IEEE, 2006).10.1109/ICSMC.2006.385224 ↗
6. Unar, S., Wang, X., Zhang, C. & Wang, C. Detected text‐based image retrieval approach for textual images. IET Image Process. 13, 515–521 (2019).10.1049/iet-ipr.2018.5277 ↗
7. Birjandi, M. & Mohanna, F. Modified keyword-based retrieval on fabric images. Quantum J. Eng. Sci. Technol. 1, 1–14 (2020).
8. Alsmadi, M. K. Query-sensitive similarity measure for content-based image retrieval using meta-heuristic algorithm. J. King Saud. Univ. Comput. Inf. Sci. 30, 373–381 (2018).10.1016/j.jksuci.2017.05.002 ↗
9. Ashraf, R. et al. Content based image retrieval by using color descriptor and discrete wavelet transform. J. Med. Syst. 42, 1–12 (2018).10.1007/s10916-017-0880-7 ↗
10. Sharif, U. et al. Scene analysis and search using local features and support vector machine for effective content-based image retrieval. Artif. Intell. Rev. 52, 901–925 (2019).10.1007/s10462-018-9636-0 ↗
11. Radenović, F., Tolias, G. & Chum, O. Fine-tuning CNN image retrieval with no human annotation. IEEE Trans. Pattern Anal. Mach. Intell. 41, 1655–1668 (2018).10.1109/TPAMI.2018.2846566 ↗
12. Sikandar, S., Mahum, R. & Alsalman, A. A novel hybrid approach for a content-based image retrieval using feature fusion. Appl. Sci. 13, 4581 (2023).10.3390/app13074581 ↗
13. Sampathila, N., Pavithra & Martis, R. J. Computational approach for content‐based image retrieval of K‐similar images from brain MR image database. Expert Syst. 39, 7 (2022).10.1111/exsy.12652 ↗
14. Kashif, M., Raja, G. & Shaukat, F. An efficient content-based image retrieval system for the diagnosis of lung diseases. J. Digit. Imaging 33, 971–987 (2020).10.1007/s10278-020-00338-w ↗
15. Devi, N. S. & Hemachandran, K. Retrieval and recognition of faces using content-based image retrieval (CBIR) and feature combination method. In Proc. 2016 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC) 1–7 (IEEE, 2016).10.1109/ICCIC.2016.7919577 ↗
16. Dalvi, C., Rathod, M., Patil, S., Gite, S. & Kotecha, K. A survey of AI-based facial emotion recognition: features, ML & DL techniques, age-wise datasets and future directions. IEEE Access 9, 165806–165840 (2021).10.1109/ACCESS.2021.3131733 ↗
17. Owais, M., Arsalan, M., Choi, J. & Park, K. R. Effective diagnosis and treatment through content-based medical image retrieval (CBMIR) by using artificial intelligence. J. Clin. Med. 8, 462 (2019).10.3390/jcm8040462 ↗
18. Manrique, R. & Duque-Arias, D. 2021 A trademark image retrieval tool based on deep learning features. in Marketing and Smart Technologies: Proceedings of ICMarkTech 23–33 (Springer Singapore, 2020).10.1007/978-981-33-4183-8_3 ↗
19. Sharma, E. K. Tribal folk arts of India. J. Int. Acad. Res. Multidiscip. 3, 300–308 (2015).
20. Saritha, R. R., Paul, V. & Kumar, P. G. Content based image retrieval using deep learning process. Clust. Comput. 22, 4187–4200 (2019).10.1007/s10586-018-1731-0 ↗
21. Wang, Y., Liu, F., Pang, Z., Hassan, A. & Lu, W. Privacy-preserving content-based image retrieval for mobile computing. J. Inf. Secur. Appl. 49, 102399 (2019).
22. Garg, M. & Dhiman, G. A novel content-based image retrieval approach for classification using GLCM features and texture fused LBP variants. Neural Comput. Appl. 33, 1311–1328 (2021).10.1007/s00521-020-05017-z ↗
23. Salih, S. F. & Abdulla, A. A. An effective bi-layer content-based image retrieval technique. J. Supercomput. 79, 2308–2331 (2023).10.1007/s11227-022-04748-1 ↗
24. Ahmad, F. Deep image retrieval using artificial neural network interpolation and indexing based on similarity measurement. CAAI Trans. Intell. Technol. 7, 200–218 (2022).10.1049/cit2.12083 ↗
25. Tan, W. S., Chin, W. Y. & Lim, K. Y. Content-based image retrieval for painting style with convolutional neural network. J. Inst. Eng. Malays. 82, 115–122 (2021).10.54552/v82i3.122 ↗
26. Varshney, S., Singh, S., Lakshmi, C. V. & Patvardhan, C. Content-based image retrieval of Indian traditional textile motifs using deep feature fusion. Sci. Rep. 14, 10035 (2024).10.1038/s41598-024-56465-9 ↗
27. Tena, S., Hartanto, R. & Ardiyanto, I. Content-based image retrieval for traditional Indonesian woven fabric images using a modified convolutional neural network method. J. Imaging 9, 165 (2023).10.3390/jimaging9080165 ↗
28. Wan, J. & Xiaobo, Y. Intelligent retrieval method of approximate painting in digital art field. Sci. Program. 2021, 5796600 (2021).
29. Ghrabat, M. J. J., Ma, G., Maolood, I. Y., Alresheedi, S. S. & Abduljabbar, Z. A. An effective image retrieval based on optimized genetic algorithm utilized a novel SVM-based convolutional neural network classifier. Hum. Centric Comput. Inf. Sci. 9, 1–29 (2019).10.1186/s13673-019-0191-8 ↗
30. Liu, R., Wei, S., Zhao, Y. & Yang, Y. Indexing of the CNN features for the large-scale image search. Multimed. Tools Appl. 77, 32107–32131 (2018).10.1007/s11042-018-6210-3 ↗
31. Rajkumar, R. & Sudhamani, M. V. Image retrieval system using residual neural network in a distributed environment. Int. J. Recent Technol. Eng. 8, 2277–3878 (2020).
32. Wang, X., Lee, F. & Chen, Q. Similarity-preserving hashing based on deep neural networks for large-scale image retrieval. J. Vis. Commun. Image Represent. 61, 260–271 (2019).10.1016/j.jvcir.2019.03.024 ↗
33. Pinterest. https://in.pinterest.com/ Accessed on 1 June 2024.
34. Wang, J. Z., Li, J. & Wiederhold, G. SIMPLIcity: semantics-sensitive integrated matching for picture libraries. IEEE Trans. Pattern Anal. Mach. Intell. 23, 947–963 (2001).10.1109/34.955109 ↗
35. Oliva, A. & Torralba, A. Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42, 145–175 (2001).10.1023/A:1011139631724 ↗
36. Li, J. & Wang, J. Z. Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Trans. Pattern Anal. Mach. Intell. 25, 1075–1088 (2003).10.1109/TPAMI.2003.1227984 ↗
37. Griffin, G., Holub, A. & Perona, P. Caltech 256 (1.0). CaltechDATA. https://doi.org/10.22002/D1.20087 (2022).10.22002/D1.20087 ↗
38. Ortega-Binderberger, M. Corel image features data set. Accessed 22 May 2024, URL: https://archive.ics.uci.edu/ml/datasets/corel+image+features (1999).
39. Kaur, A., Guleria, K. & Trivedi Kumar, N. A deep learning-based model for biotic rice leaf disease detection. Multimed. Tools Appl. 15, 1–27 (2024).
40. Kumar, N., Gupta, M., Gupta, D. & Tiwari, S. Novel deep transfer learning model for COVID-19 patient detection using X-ray chest images. J. Ambient Intell. Humaniz. Comput. 14, 469–478 (2023).10.1007/s12652-021-03306-6 ↗