Human–Computer Interaction (HCI) Advances to Re-Contextualize Cultural Heritage toward Multiperspectivity, Inclusion, and Sensemaking
Source abstract
Abstract
Today’s social and political movements against dominant Western narratives call for a re-contextualization of cultural heritage (CH) toward inclusivity, multiperspectivity, and sensemaking. Our work approaches this challenge from a Human–Computer Interaction (HCI) perspective, questioning how HCI approaches, tools and methods can contribute to CH re-contextualization. Through collaborative reflection on our research practice, we identified four diverging case studies highlighting the different roles of HCI and its increasing entanglement with CH. Case studies 1–3 focus on HCI as a medium for CH, case 4 on digital CH, and thereby on the HCI–CH entanglement. Our reflections contribute to CH re-contextualization by highlighting the need for co-design and slow design approaches, the role of HCI technologies in preserving, communicating, and shaping CH, and open questions and challenges related to the increasing HCI–CH convergence.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Museums and Cultural Heritage · Innovative Human-Technology Interaction · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Fraunhofer Institute for Applied Information Technology FIT, 53757 Sankt Augustin, Germany
Faculty of Art and Design, University of Lapland, 96300 Rovaniemi, Finland
Open Laboratory, Newcastle University, Newcastle upon Tyne NE1 7RU, UK
School of Design, Northumbria University, Newcastle upon Tyne NE2 1XA, UK
School of Architecture, Design and Planning, The University of Sydney, Sydney 2006, Australia
Funding
Muittut, muitalusat—the story of the Sámi by the Sámi · Xstory—Lapland narratives with experience technologies · European Regional Development Fund (ERDF) · Ultra High-Speed Mobile Information and Communication (UMIC) · Northumbria and Newcastle University and the Center for Digital Citizens
References (100+)
Show source-provided references
1. On agonistic memory10.1177/1750698015615935 ↗
2. Kuipers, M., and de Jonge, W. (2017). Designing from Heritage: Strategies for Conservation and Conversion, Basic Books.
3. White, S., and Hespanhol, L. (July, January 25). Towards a framework for designing technology with Country: A perspective from Australia. Proceedings of the DRS2022, Bilbao, Spain.
4. Boundaries of historical consciousness: A Western cultural achievement or an anthropological universal?10.1080/00220272.2019.1652938 ↗
5. Adichie, C.N. (2024, April 09). The Danger of a Single Story. Available online: https://www.ted.com/talks/chimamanda_ngozi_adichie_the_danger_of_a_single_story/transcript.
6. Seixas, P. (2017). Historical Consciousness and Historical Thinking. Palgrave Handbook of Research in Historical Culture and Education, Palgrave Macmillan.10.1057/978-1-137-52908-4_3 ↗
7. Di Stefano, M. (2014, January 9–14). Heritage and Landscape as Human Values. Proceedings of the 18th ICOMOS GA and Symposium, Firenze, Italy.
8. ICOMOS (2020). Resolution 20GA/19—People-Centred Approaches to Cultural Heritage. Report of the Resolutions Committee to the 20th ICOMOS General Assembly, ICOMOS.
9. Silverman, H., Waterton, E., and Watson, S. (2017). Heritage in Action, Springer International Publishing.10.1007/978-3-319-42870-3 ↗
10. Alda, M. (2024, February 04). Communications. Available online: https://www.statista.com/markets/424/topic/2494/communications/.
11. Loh Chee Wyai, G., Zaman, T., Ab Hamid, K., and Anak Gindau, M. (2023). Design inspiration translated from the “Proud to be Iban” probes. KUI ’23, Proceedings of the 20th International Conference on Culture and Computer Science: Code and Materiality, Lisbon, Portugal, 28–29 September 2023, Association for Computing Machinery.10.1145/3623462.3623472 ↗
12. Rethinking indigenous media: Rituals, ‘talking’ drums and orality as forms of public communication in Uganda10.1080/1369681032000169302 ↗
13. The Role of Indigenous Communication Systems for Rural Development in the Tolon District of Ghana
14. Wefwafwa, J. (2015). Indigenous Communication Systems versus Modern Communication Systems: A Case Study of the Bukusu Subtribe of Western Kenya. Glob. Media J. Afr. Ed., 8.10.5789/8-2-173 ↗
15. Research on Indigenous People and the Role of Information and Communications Technology in Development: A Review of the Literature
16. Alvarado Garcia, A., Maestre, J.F., Barcham, M., Iriarte, M., Wong-Villacres, M., Lemus, O.A., Dudani, P., Reynolds-Cuéllar, P., Wang, R., and Cerratto Pargman, T. (2021). Decolonial Pathways: Our Manifesto for a Decolonizing Agenda in HCI Research and Design. CHI EA ’21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, 8–13 May 2021, Association for Computing Machinery.10.1145/3411763.3450365 ↗
17. Anuyah, O., Badillo-Urquiola, K., and Metoyer, R. (2023). Characterizing the Technology Needs of Vulnerable Populations for Participation in Research and Design by Adopting Maslow’s Hierarchy of Needs. CHI ’23, Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Hamburg, Germany, 23–28 April 2023, Association for Computing Machinery.10.1145/3544548.3581221 ↗
18. Avouris, N. (2021, January 25–27). Teaching Human–Computer Interaction for Social Good. Proceedings of the CHI Greece 2021: 1st International Conference of the ACM Greek SIGCHI Chapter, Virtual.10.1145/3489410.3489413 ↗
19. Butler, K.A., and Jacob, R.J.K. (1997). Human–Computer Interaction: Introduction and overview. CHI EA ’97, CHI ’97 Extended Abstracts on Human Factors in Computing Systems, Atlanta, GA, USA, 22–27 March 1997, Association for Computing Machinery.10.1145/1120212.1120311 ↗
20. Hirsch, L., Welsch, R., Rossmy, B., and Butz, A. (2022). Embedded AR Storytelling Supports Active Indexing at Historical Places. TEI ’22, Proceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction, Daejeon, Republic of Korea, 13–16 February 2022, Association for Computing Machinery.10.1145/3490149.3501328 ↗
21. Paananen, S., Kim, J.C., Kirjavainen, E., Kalving, M., Mitra, K., and Häkkilä, J. (2023). Augmenting Indigenous Sámi Exhibition - Interactive Digital Heritage in Museum Context. Human–Computer Interaction—INTERACT 2023, Proceedings of the 19th IFIP TC13 International Conference, York, UK, 28 August–1 September 2023, Proceedings, Part II, Springer.10.1007/978-3-031-42283-6_32 ↗
22. Improving Accessibility to Intangible Cultural Heritage Preservation Using Virtual Reality
23. Smart Objects and Replicas: A Survey of Tangible and Embodied Interactions in Museums and Cultural Heritage Sites10.1145/3631132 ↗
24. Exploring Digital Means to Engage Visitors with Roman Culture: Virtual Reality vs. Tangible Interaction10.1145/3625367 ↗
25. Laser Scan Measurement of the Niche and Virtual 3D Representation of the Small Buddha in Bamiyan
26. 3D Scanning and Visualization of Large Monuments of Timurid Architecture in Central Asia—A Methodical Approach10.1145/3425796 ↗
27. Pribanić, T., Bojanić, D., Bartol, K., and Petković, T. (2021). Can OpenPose Be Used as a 3D Registration Method for 3D Scans of Cultural Heritage Artifacts. Pattern Recognition, Proceedings of the ICPR International Workshops and Challenges, Virtual Event, 10–15 January 2021, Proceedings, Part VII, Springer.10.1007/978-3-030-68787-8_6 ↗
28. Bratteteig, T., and Wagner, I. (2016). What is a participatory design result?. PDC ’16: Proceedings of the 14th Participatory Design Conference: Full Papers—Volume 1, Association for Computing Machinery.10.1145/2940299.2940316 ↗
29. Wang, Z., Jiang, T., Huang, J., Tai, Y., and Trapani, P. (July, January 25). How might we evaluate co-design? A literature review on existing practicess. Proceedings of the DRS2022, Bilbao, Spain.
30. Hirsch, L., Paananen, S., Hornecker, E., Hespanhol, L., Kuflik, T., Losev, T., and Häkkilä, J. (2023). Re-contextualizing Built Environments: Critical and Inclusive HCI Approaches for Cultural Heritage. Human–Computer Interaction—INTERACT 2023, 19th IFIP TC13 International Conference, York, UK, 28 August–1 September 2023, Proceedings, Part IV, Springer.10.1007/978-3-031-42293-5_91 ↗
31. Prilla, M., Degeling, M., and Herrmann, T. (2012). Collaborative reflection at work: Supporting informal learning at a healthcare workplace. GROUP ’12, Proceedings of the 2012 ACM International Conference on Supporting Group Work, Sanibel Island, FL, USA, 27–31 October 2012, Association for Computing Machinery.10.1145/2389176.2389185 ↗
32. Yoo, D., Kantengwa, O., Logler, N., Interayamahanga, R., Nkurunziza, J., and Friedman, B. (2018). Collaborative Reflection: A Practice for Enriching Research Partnerships Spanning Culture, Discipline, and Time. CHI ’18, Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada, 21–26 April 2018, Association for Computing Machinery.10.1145/3173574.3173853 ↗
33. Janssenswillen, P., and Meeus, W. (2017, January 8–9). Sustainable Heritage Education: Multiperspectivity as a Bridge. Proceedings of the Future of Education, Florence, Italy.
34. “Connected to the people”: Social Inclusion & Cohesion in Action through a Cultural Heritage Digital Tool10.1145/3610168 ↗
35. The To-and-Fro of Sense Making: Supporting Users’ Active Indexing in Museums10.1145/2882785 ↗
36. Rantanen, M.J. (2010). Indexicality of Language and the Art of Creating Treasures. CHI ’10, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Atlanta, GA, USA, 10–15 April 2010, Association for Computing Machinery.10.1145/1753326.1753371 ↗
37. Combining X-Ray Micro-CT Technology and 3D Printing for the Digital Preservation and Study of a 19th Century Cantonese Chess Piece with Intricate Internal Structure10.1145/2399180.2399181 ↗
38. Fully Automatic, Omnidirectional Acquisition of Geometry and Appearance in the Context of Cultural Heritage Preservation
39. Häkkilä, J., Kalving, M., Marjomaa, S., and Mäkikalli, M. (2023). Connecting the Past: Evaluating an Indigenous Sámi Heritage Search Portal in Schools. Relate North: Possible Futures, InSEA Publications.
40. Häkkilä, J., Hannula, P., Luiro, E., Launne, E., Mustonen, S., Westerlund, T., and Colley, A. (2019). Visiting a virtual graveyard: Designing virtual reality cultural heritage experiences. MUM ’19, Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia, Pisa, Italy, 26–29 November 2019, Association for Computing Machinery.10.1145/3365610.3368425 ↗
41. An Interactive Narrative to Improve Cultural Heritage Experience in Elementary School Children10.1145/3382771 ↗
42. Mah, K., Loke, L., and Hespanhol, L. (2020). Designing With Ritual Interaction: A Novel Approach to Compassion Cultivation Through a Buddhist-Inspired Interactive Artwork. TEI ’20, Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction, Sydney, NSW, Australia, 9–12 February 2020, Association for Computing Machinery.10.1145/3374920.3374947 ↗
43. Situated Tangible Gamification of Heritage for Supporting Collaborative Learning of Young Museum Visitors10.1145/3350427 ↗
44. Harjuniemi, E. (2016). Soft tangible user interfaces: Coupling the digital information to the textile materials. MUM ’16, Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia, Rovaniemi, Finland, 12–15 December 2016, Association for Computing Machinery.10.1145/3012709.3018008 ↗
45. Nisi, V., Bostock, H., Cesário, V., Acedo, A., and Nunes, N. (2021). Impalpable Narratives: How to capture intangible cultural heritage of migrant communities. C&T ’21: Proceedings of the 10th International Conference on Communities & Technologies—Wicked Problems in the Age of Tech, Seattle, WA, USA, 23–25 June 2021, Association for Computing Machinery.10.1145/3461564.3461575 ↗
46. Exploring RGB-D Cameras for 3D Reconstruction of Cultural Heritage: A New Approach Applied to Brazilian Baroque Sculptures10.1145/3230674 ↗
47. Grammalidis, N., Dimitropoulos, K., Tsalakanidou, F., Kitsikidis, A., Roussel, P., Denby, B., Chawah, P., Buchman, L., Dupont, S., and Laraba, S. (2016). The i-Treasures Intangible Cultural Heritage dataset. MOCO ’16, Proceedings of the 3rd International Symposium on Movement and Computing, Thessaloniki, Greece, 5–6 July 2016, Association for Computing Machinery.10.1145/2948910.2948944 ↗
48. Bordawekar, R., Cappiello, C., Efthymiou, V., Ehrlinger, L., Gadepally, V., Galhotra, S., Geisler, S., Groppe, S., Gruenwald, L., and Halevy, A. (2023). Culture Data Space: A Case Study in Federated Data Ecosystems. VLDBW 2023: Workshops at VLDB 2023: Joint Proceedings of Workshops at the 49th International Conference on Very Large Data Bases (VLDB 2023), Vancouver, BC, Canada, 28 August–1 September 2023, CEUR. CEUR Workshop Proceedings.
49. Wrestling with the Social Value of Heritage: Problems, Dilemmas and Opportunities
50. Social Augmented Reality: Communicating via Cultural Heritage10.1145/3582266 ↗
51. Falk, J.H., and Dierking, L.D. (2018). Learning from Museums, Rowman & Littlefield Publishers. [2nd ed.].
52. Students’ and teachers’ beliefs about historical empathy in secondary history education10.1080/00933104.2020.1808131 ↗
53. Unsettling Play: Perceptions of Agonistic Games10.1145/3431925 ↗
54. Berger, S., and Kansteiner, W. (2021). Agonistic Perspectives on the Memory of War: An Introduction, Springer.10.1007/978-3-030-86055-4_1 ↗
55. Pescarin, S., Bonanno, V., and Marasco, A. (2023). Social Cohesion in Interactive Digital Heritage Experiences. Multimodal Technol. Interact., 7.10.3390/mti7060061 ↗
56. Challenges and paradoxes in decolonising HCI: A critical discussion10.1007/s10606-021-09398-0 ↗
57. Smith, R.C., Winschiers-Theophilus, H., Loi, D., de Paula, R.A., Kambunga, A.P., Samuel, M.M., and Zaman, T. (2021). Decolonizing design practices: Towards pluriversality. CHI EA ’21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, 8–13 May 2021, Association for Computing Machinery.10.1145/3411763.3441334 ↗
58. Da Milano, C., Falchetti, E., Migone, P., and Nisi, V. (2023). Digital storytelling, cultural heritage, and social inclusion: The MEMEX project. Digital Approaches to Inclusion and Participation in Cultural Heritage, Routledge.10.4324/9781003277606-2 ↗
59. Petropoulos, E. (2021). Social Cohesion through Cultural Heritage. [Master’s Thesis, University of the Peloponnese].
60. Bulla, L., De Giorgis, S., Gangemi, A., Lucifora, C., and Mongiovì, M. (2023). Comparing User Perspectives in a Virtual Reality Cultural Heritage Environment. Advanced Information Systems Engineering, Proceedings of the 2023 Conference (CAiSE 2023), Zaragoza, Spain, 12–16 June 2023, Springer.10.1007/978-3-031-34560-9_1 ↗
61. Giglitto, D., Ciolfi, L., Claisse, C., and Lockley, E. (2019). Bridging Cultural Heritage and Communities through Digital Technologies: Understanding Perspectives and Challenges. C&T ’19: Proceedings of the 9th International Conference on Communities & Technologies—Transforming Communities, Vienna, Austria, 3–7 June 2019, ACM.10.1145/3328320.3328386 ↗
62. Chowdhury, N., Shokri, N., Valera, C.H., Sp, A.M., Marquez, C.R., Rifat, M.R., Wong-Villacres, M., Munteanu, C., Dahya, N., and Ahmed, S.I. (2024). Politics of the Past: Understanding the Role of Memory, Postmemory, and Remembrance in Navigating the History of Migrant Families. CHI ’24: Proceedings of the CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 11–16 May 2024, Association for Computing Machinery.10.1145/3613904.3642496 ↗
63. A different view on (world) heritage. The need for multi-perspective data analyses in historical landscape studies: The example of Schokland (NL)10.1016/j.culher.2021.11.011 ↗
64. Meissner, M. (2018, January 12–15). Between Social Cohesion and Social Distinction: Intangible Cultural Heritage and Sustainable Social Development. Proceedings of the 6th International Conference on Heritage and Sustainable Development, Granada, Spain.
65. Leite, C., Acosta, C., Militelli, F., Jajamovich, G., Wilderom, M., Bonduki, N., Somekh, N., and Herling, T. (2019). Sao Paulo: Participation and Social Inclusion on Cultural Heritage. Social Urbanism in Latin America, Springer International Publishing.10.1007/978-3-030-16012-8 ↗
66. Safe spaces in participatory design with young forced migrants
67. Decolonizing design through the perspectives of cosmological others: Arguing for an ontological turn in design research and practice10.1145/3368048 ↗
68. On decolonizing design
69. Paananen, S., Suoheimo, M., and Häkkilä, J. (2022). Decolonizing design with technology in cultural heritage contexts-systematic literature review. [ ] With Design: Reinventing Design Modes: Proceedings of the Congress of the International Association of Societies of Design Research, Springer.10.1007/978-981-19-4472-7_119 ↗
70. Decolonial design in practice: Designing meaningful and transformative science communications for Navakavu, Fiji
71. Sustainability: Design for the pluriverse10.1057/dev.2011.28 ↗
72. Kambunga, A.P., Winschiers-Theophilus, H., and Goagoses, N. (2018). Re-conceptualizing technology adoption in informal settlements based on a Namibian application. AfriCHI ’18: Proceedings of the Second African Conference for Human-Computer Interaction: Thriving Communities, Windhoek, Namibia, 3–7 December 2018, Association for Computing Machinery.10.1145/3283458.3283468 ↗
73. Clarke, R., Talhouk, R., Beshtawi, A., Barham, K., Boyle, O., Griffiths, M., and Baillie Smith, M. (2022). Decolonising in, by and through participatory design with political activists in Palestine. PDC ’22: Proceedings of the Participatory Design Conference 2022, Newcastle upon Tyne, Uk, 19 August–1 September 2022—Volume 1, Association for Computing Machinery.10.1145/3536169.3537778 ↗
74. Embracing plurality in designing social innovation practices
75. Protecting Indigenous heritage objects, places, and values: Challenges, responses, and responsibilities10.1080/13527258.2021.2009539 ↗
76. Bramwell-Dicks, A., Evans, A., Winckler, M., Petrie, H., and Abdelnour-Nocera, J. (2023). Design for Equality and Justice, Springer. Chapter Re-Contextualizing Built Environments: Critical & Inclusive HCI Approaches for Cultural Heritage.10.1007/978-3-031-61698-3 ↗
77. Academic Self-Organised Learning Environment—The lessons to be learned and taught
78. Lengyel, D., Kharrufa, A., Stanfield, J., Powers, H., Stratford, B.L., and Talhouk, R. (September, January 28). Gender and Racism: Considerations for Digital Learning Among Young Refugees and Asylum Seekers. Proceedings of the Human–Computer Interaction—INTERACT 2023, York, UK.10.1007/978-3-031-42286-7_26 ↗
79. Dankwa, N.K., and Draude, C. (2021). Setting Diversity at the Core of HCI. Universal Access in Human–Computer Interaction. Design Methods and User Experience, Proceedings of the 15th International Conference, UAHCI 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, 24–29 July 2021, Proceedings, Part I, Springer.10.1007/978-3-030-78092-0_3 ↗
80. Power dynamics and collaborative mechanisms in co-production and co-design processes10.1177/0261018317747444 ↗
81. ‘Who put that on there... why why why?’ Power games and participatory techniques of visual data production10.1080/1472586X.2013.801635 ↗
82. ‘Draw, write and tell’: A literature review and methodological development on the ’draw and write’ research method10.1177/1476718X14538592 ↗
83. Refugee Food Insecurity & Technology: Surfacing Experiences of Adaptation, Navigation, Negotiation and Sharing10.1007/s10606-022-09423-w ↗
84. Understanding metacognition through the use of pupil views templates: Pupil views of Learning to Learn10.1016/j.tsc.2008.03.004 ↗
85. Practicing Humility: Design as Response, Not as Solution10.1007/s42438-023-00436-2 ↗
86. A definition of cultural heritage: From the tangible to the intangible10.1016/j.culher.2010.01.006 ↗
87. Schön, D.A. (1984). The Reflective Practitioner: How Professionals Think in Action, Routledge.
88. Knowles, J.G., and Cole, A.L. (2008). Interrogating Reflexivity: Art, Research, and the Desire for Presence. Handbook of the Arts in Qualitative Research: Perspectives, Methodologies, Examples, and Issues, SAGE.10.4135/9781452226545 ↗
89. The double arrow: How qualitative social work researchers use reflexivity10.1177/1473325013506248 ↗
90. Leavy, P. (2017). Arts-Based Visual Research. Handbook of Arts-Based Research, Guilford Press.
91. Lengyel, D. (2024). Penta Portas and the Multi-disciplinary Arts-based Method Framework (MAMF): An Empirical and Theoretical Investigation of Arts-Based Methods. [Ph.D. Thesis, Department of Computer Science, University of Bath].
92. Using Art to Tell Stories and Build Safe Spaces: Transforming Academic Research Into Action10.7870/cjcmh-2015-005 ↗
93. Knowles, J.G., and Cole, A.L. (2008). Nursing Research and the Transformative Value of Art. Handbook of the Arts in Qualitative Research: Perspectives, Methodologies, Examples, and Issues, SAGE.10.4135/9781452226545 ↗
94. Muecke, S. (2018). Another Science Is Possible: A Manifesto for Slow Science, Polity Press.
95. Fast Lane to Slow Science10.1016/j.tics.2019.10.007 ↗
96. Odom, W., Selby, M., Sellen, A., Kirk, D., Banks, R., and Regan, T. (2012). Photobox: On the design of a slow technology. DIS ’12: Proceedings of the Designing Interactive Systems Conference, Newcastle Upon Tyne, UK, 11–15 June 2012, ACM.10.1145/2317956.2318055 ↗
97. Falk, J., Frauenberger, C., and Kannabiran, G. (2022). How Shortening or Lengthening Design Processes Configure Decision Making. NordiCHI ’22: Nordic Human–Computer Interaction Conference, Aarhus, Denmark, 8–12 October 2022, ACM.10.1145/3546155.3547726 ↗
98. Keskitalo, P., Virtanen, P.K., and Olsen, T. (2021). Introduction. Indigenous Research Methodologies in Sámi and Global Contexts, Brill.10.1163/9789004463097 ↗
99. Contested Sami heritage: Drums and sieidis on the move
100. Gabriel, M., and Dahl, J. (2008). Repatriation as knowledge sharing–returning the Sámi cultural heritage. UTIMUT: Past Heritage-Future Partnerships: Discussions on Repatriation in the 21st Century, IWGIA.