journal article·2023-09-23Open access

A Crowdsourcing Recommendation Model for Image Annotations in Cultural Heritage Platforms

Menna Maged Kamel, Alberto Gil-Solla, Luis Fernando Guerrero-Vásquez, Yolanda Blanco-Fernández, José Juan Pazos-Arias, Martín López-Nores

Applied Sciences· Volume 13· Issue 19

Abstract

Cultural heritage is one of many fields that has seen a significant digital transformation in the form of digitization and asset annotations for heritage preservation, inheritance, and dissemination. However, a lack of accurate and descriptive metadata in this field has an impact on the usability and discoverability of digital content, affecting cultural heritage platform visitors and resulting in an unsatisfactory user experience as well as limiting processing capabilities to add new functionalities. Over time, cultural heritage institutions were responsible for providing metadata for their collection items with the help of professionals, which is expensive and requires significant effort and time. In this sense, crowdsourcing can play a significant role in digital transformation or massive data processing, which can be useful for leveraging the crowd and enriching the metadata quality of digital cultural content. This paper focuses on a very important challenge faced by cultural heritage crowdsourcing platforms, which is how to attract users and make such activities enjoyable for them in order to achieve higher-quality annotations. One way to address this is to offer personalized interesting items based on each user preference, rather than making the user experience random and demanding. Thus, we present an image annotation recommendation system for users of cultural heritage platforms. The recommendation system design incorporates various technologies intending to help users in selecting the best matching images for annotations based on their interests and characteristics. Different classification methods were implemented to validate the accuracy of our work on Egyptian heritage.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Conservation Techniques and Studies · 3D Surveying and Cultural Heritage · Music and Audio Processing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Science Department, Arab Academy of Science, Technology & Maritime Transport, P.O. Box 2033, Cairo 11757, Egypt

atlanTTic Research Center for Telecommunication Technologies, Universidade de Vigo, 36310 Vigo, Spain

Research Group in Artificial Intelligence and Assistive Technologies, Politecnica Salesiana University, Cuenca 010105, Ecuador

Funding

European Regional Development Fund (ERDF) through the Ministerio de Economía, Industria y Competitividad (Gobierno de España) research project · Galician Regional Government under the agreement for funding the AtlantTIC Research Center for Information and Communication Technologies · Consolidation and Structuring of Competitive Research Groups

References (76)

Show source-provided references
1. Intangible Cultural Heritage: The Living Culture of Peoples10.1093/ejil/chr006 ↗
2. A definition of cultural heritage: From the tangible to the intangible10.1016/j.culher.2010.01.006 ↗
3. Vahtikari, T. (2017). Valuing World Heritage Cities, Routledge.10.4324/9781315548425 ↗
4. Heritage and identity: Technology, values and visitor experiences10.1080/1743873X.2017.1384478 ↗
5. Cultural heritage and new technologies: Trends and challenges10.1007/s00779-016-0984-y ↗
6. Digital cultural heritage meets digital humanities10.5194/isprs-archives-XLII-2-W15-813-2019 ↗
7. Cultural heritage and ICT: State of the art and perspectives
8. Old buildings need new ideas: Holistic integration of conservation-restoration process data using Heritage Building Information Modelling10.1016/j.culher.2022.02.005 ↗
9. The future of museums in the digital age: New models for access to and use of digital collections
10. Pop, I.L., and Borza, A. (2016, January 14–16). Technological innovations in museums as a source of competitive advantage. Proceedings of the 2nd International Scientific Conference SAMRO, Păltiniş, Romania.
11. Harvesting community annotations on 3D models of museum artefacts to enhance knowledge, discovery and re-use10.1016/j.culher.2009.04.004 ↗
12. Enhancing accessibility in cultural heritage environments: Considerations for social computing10.1007/s10209-019-00651-4 ↗
13. Can Heritage Bots Thrive? Toward Future Engagement in Cultural Heritage10.1017/aap.2018.32 ↗
14. Digital transformation of cultural institutions: A statistical analysis of Italian and Campania GLAMs10.1007/s11135-019-00889-3 ↗
15. Zahidi, Z., Lim, Y.P., and Woods, P.C. (2014, January 27–29). Understanding the user experience (UX) factors that influence user satisfaction in digital culture heritage online collections for non-expert users. Proceedings of the 2014 Science and Information Conference, London, UK.10.1109/SAI.2014.6918172 ↗
16. Parent, I., Seles, A., Storti, D., Banda, F., Blin, F., McKenna, G., Lee, I., Murdock Smith, J., Chee, J., and Hagedorn-Saupe, M. (2021). The UNESCO/PERSIST Guidelines for the Selection of Digital Heritage for Long-Term Preservation, UNESCO.
17. Digitization of cultural heritage: Global initiatives, opportunities and challenges10.4018/JCIT.2018100101 ↗
18. Total Recall: How Cultural Heritage Communities Use Digital Initiatives and Platforms for Collective Remembering10.1177/0973258619868045 ↗
19. Rockwell, G. (2016). Collaborative Research in the Digital Humanities, Routledge.
20. Enriching and enhancing digital cultural heritage through crowd contribution10.1108/JCHMSD-12-2014-0043 ↗
21. Crowdsourcing and Co-curation in Virtual Museums: A Practice-driven Approach
22. Transcription maximized; expense minimized? Crowdsourcing and editing The Collected Works of Jeremy Bentham*10.1093/llc/fqs004 ↗
23. Harnessing crowdsourcing for scholarly and GLAM purposes10.1111/lic3.12507 ↗
24. Schreibman, S., Siemens, R., and Unsworth, J. (2015). A New Companion to Digital Humanities, John Wiley & Sons.10.1002/9781118680605 ↗
25. Alam, S.L., and Campbell, J. (2012, January 3–5). Crowdsourcing motivations in a not-for-profit GLAM context: The Australian newspapers digitisation program. Proceedings of the ACIS 2012 Proceedings, Geelong, Australia.
26. An In-Depth Analysis of Tags and Controlled Metadata for Book Search
27. Controlled Vocabularies versus Social Tags: A Brief Literature Review
28. Asadi, B. (2020). Comparison of Social Tags and Controlled Vocabulary Terms Assigned to Images: A Feasibility Study of Computer-assisted Image Indexing. [Ph.D. Thesis, McGill University].
29. Social tags and Controlled Vocabulary: A Comparative Study of Documents in Chemistry and Literature
30. Effects of extrinsic and intrinsic motivation on participation in crowdsourcing contest: A perspective of self-determination theory10.1108/OIR-08-2014-0188 ↗
31. Motivation and sustained participation in the online crowdsourcing community: The moderating role of community commitment10.1108/INTR-01-2020-0008 ↗
32. Gamification artifacts and crowdsourcing participation: Examining the mediating role of intrinsic motivations10.1016/j.chb.2017.12.018 ↗
33. Liao, H., Zhao, M., and Sun, S. (2020, January 10–12). A Literature Review of Museum and Heritage on Digitization, Digitalization, and Digital Transformation. Proceedings of the 6th International Conference on Humanities and Social Science Research, Hangzhou, China.10.2991/assehr.k.200428.101 ↗
34. Bibliometric analysis and visualisation of heritage buildings preservation10.1186/s40494-023-00947-y ↗
35. An ontological data model for points of interest (POI) in a cultural heritage site10.1186/s40494-021-00635-9 ↗
36. Virtual reality-based digitisation for endangered heritage sites: Theoretical framework and application10.1016/j.culher.2021.02.005 ↗
37. Survey and literature study to provide insights on the application of 3D technologies in objects conservation and restoration10.1016/j.culher.2020.12.003 ↗
38. A Blockchain-Based cryptographic interaction method of digital museum collections10.1016/j.culher.2022.11.001 ↗
39. Recommender systems, cultural heritage applications, and the way forward10.1016/j.culher.2018.06.003 ↗
40. Pierdicca, R., Paolanti, M., Matrone, F., Martini, M., Morbidoni, C., Malinverni, E.S., Frontoni, E., and Lingua, A.M. (2020). Point Cloud Semantic Segmentation Using a Deep Learning Framework for Cultural Heritage. Remote Sens., 12.10.3390/rs12061005 ↗
41. Linked open data in authoring virtual exhibitions10.1016/j.culher.2021.11.002 ↗
42. Virtual cleaning of works of art using deep convolutional neural networks10.1186/s40494-021-00567-4 ↗
43. Machine learning techniques for structural health monitoring of heritage buildings: A state-of-the-art review and case studies10.1016/j.culher.2020.09.005 ↗
44. Oomen, J., and Aroyo, L. (July, January 29). Crowdsourcing in the cultural heritage domain: Opportunities and challenges. Proceedings of the Fifth International Conference on Communities and Technologies, Brisbane, Australia.
45. Ridge, M. (2020). Routledge International Handbook of Research Methods in Digital Humanities, Routledge.
46. Chun, S., Cherry, R., Hiwiller, D., Trant, J., and Wyman, B. (2023, July 25). Steve.museum: An Ongoing Experiment in Social Tagging, Folksonomy, and Museums. Available online: http://www.steve.museum/static/index.html.
47. Trant, J. (2009). Tagging, Folksonomy and Art Museums: Results of Steve. Museum’s Research, The University of Arizona. Technical Report.
48. Thousands of Titles Without Authors: Digitized Newspapers, Serial Fiction, and the Challenges of Anonymity10.1353/bh.2016.0008 ↗
49. Oomen, J., Belice Baltussen, L., Limonard, S., Brinkerink, M., Ees, A.V., Aroyo, L., Vervaart, J., Afsar, K., and Gligorov, R. (2023, July 25). Emerging Practices in the Cultural Heritage Domain-Engaging Users on a Large Scale. Available online: https://www.researchgate.net/publication/228585569_Emerging_Practices_in_the_Cultural_Heritage_Domain-Social_Tagging_of_Audiovisual_Heritage.
50. Kaldeli, E., Menis-Mastromichalakis, O., Bekiaris, S., Ralli, M., Tzouvaras, V., and Stamou, G. (2021). CrowdHeritage: Crowdsourcing for Improving the Quality of Cultural Heritage Metadata. Information, 12.10.3390/info12020064 ↗
51. Diffusion of Open Data and Crowdsourcing among Heritage Institutions: Results of a Pilot Survey in Switzerland10.4067/S0718-18762014000300003 ↗
52. Hannewijk, B., Vinella, F.L., Khan, V.-J., Lykourentzou, I., Papangelis, K., and Masthoff, J. (2020). Capturing the City’s Heritage On-the-Go: Design Requirements for Mobile Crowdsourced Cultural Heritage. Sustainability, 12.10.3390/su12062429 ↗
53. A comparative survey of DBpedia, Freebase, OpenCyc, Wikidata, and YAGO
54. Embracing”Web 3.0”10.1109/MIC.2007.52 ↗
55. DBpedia—A large-scale, multilingual knowledge base extracted from Wikipedia10.3233/SW-140134 ↗
56. Wikidata through the eyes of DBpedia10.3233/SW-170277 ↗
57. Mendes, P.N., Jakob, M., García-Silva, A., and Bizer, C. (2011, January 7–9). DBpedia spotlight: Shedding light on the web of documents. Proceedings of the 7th International Conference on Semantic Systems, Graz, Austria.10.1145/2063518.2063519 ↗
58. FICLONE: Improving DBpedia spotlight using named entity recognition and collective disambiguation
59. HaCohen-Kerner, Y., Miller, D., and Yigal, Y. (2020). The influence of preprocessing on text classification using a bag-of-words representation. PLoS ONE, 15.10.1371/journal.pone.0232525 ↗
60. Text mining: Use of TF-IDF to examine the relevance of words to documents
61. Selva Birunda, S., and Kanniga Devi, R. (2021). Innovative Data Communication Technologies and Application: Proceedings of the ICIDCA, Coimbatore, India, 20–21 August 2021, Springer.
62. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv.
63. Dwivedi, V.P., and Shrivastava, M. (2017, January 18–21). Beyond Word2Vec: Embedding Words and Phrases in Same Vector Space. Proceedings of the 14th International Conference on Natural Language Processing (ICON-2017), Kolkata, India.
64. Supervised Machine Learning Algorithms: Classification and Comparison10.14445/22312803/IJCTT-V48P126 ↗
65. Survey on supervised machine learning techniques for automatic text classification10.1007/s10462-018-09677-1 ↗
66. Bhavitha, B.K., Rodrigues, A.P., and Chiplunkar, N.N. (2017, January 10–11). Comparative study of machine learning techniques in sentimental analysis. Proceedings of the 2017 International Conference on Inventive Communication and Computational Technologies (ICICCT), Coimbatore, India.10.1109/ICICCT.2017.7975191 ↗
67. Kar, A., Prakash, A., Liu, M.Y., Cameracci, E., Yuan, J., Rusiniak, M., Acuna, D., Torralba, A., and Fidler, S. (November, January 27). Meta-sim: Learning to generate synthetic datasets. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
69. Kusner, M., Sun, Y., Kolkin, N., and Weinberger, K. (2015, January 7–9). From word embeddings to document distances. Proceedings of the International Conference on Machine Learning, PMLR, Lille, France.
70. Scikit-learn: Machine learning in Python
71. A Review on Evaluation Metrics for Data Classification Evaluations10.5121/ijdkp.2015.5201 ↗
72. Uzair, M., and Jamil, N. (2020, January 5–7). Effects of Hidden Layers on the Efficiency of Neural networks. Proceedings of the 2020 IEEE 23rd International Multitopic Conference (INMIC), Bahawalpur, Pakistan.10.1109/INMIC50486.2020.9318195 ↗
73. Vujičić, T., Matijevi, T., Ljucović, J., Balota, A., and Ševarac, Z. (2016, January 21–23). Comparative analysis of methods for determining number of hidden neurons in artificial neural network. Proceedings of the Central European Conference on Information and Intelligent Systems, Varazdin, Croatia.
74. Novel weighting in single hidden layer feedforward neural networks for data classification10.1016/j.camwa.2012.01.042 ↗
75. Activation functions in neural networks
76. Patle, A., and Chouhan, D.S. (2013, January 23–25). SVM kernel functions for classification. Proceedings of the 2013 International Conference on Advances in Technology and Engineering (ICATE), Mumbai, India.10.1109/ICAdTE.2013.6524743 ↗