Intelligent Multi-Criteria Decision Support for Renovation Solutions for a Building Based on Emotion Recognition by Applying the COPRAS Method and BIM Integration
Source abstract
Abstract
With accelerating climate change and the urgent need to cut carbon emissions, global focus has turned to the existing building stock and its renovation. Sustainable renovation helps to achieve better energy performance and gain wider sustainability benefits, such as increased value of a building, improved indoor and outdoor comfort, reduced carbon emissions, and the higher satisfaction and better emotional state of inhabitants. Numerous systems and tools have been developed worldwide to assist with decision making in the choice of preferred modernisation scenarios and alternatives. However, social aspects are often neglected in the existing systems, and emotions of inhabitants are rarely analysed. To close this gap, the present study proposes an innovative decision-making framework for sustainable renovation solutions, based on emotion recognition. The framework makes it possible to assess various renovation alternatives against sustainability criteria and real-time measurements of the emotional states of inhabitants. Based on the proposed framework, an intelligent multi-criteria decision support system was developed by integrating COPRAS and the facial action coding system, the method of automatic facial expression recognition, and the continuous calibration and participant methods. The system was tested in the case study of renovation solutions for a building located in Ukraine. The research results revealed that the proposed renovation solutions had a positive impact on the emotional state of inhabitants, especially when visual materials such as drawings were presented. Some case studies were analysed together with the application of decision system tools and building information modelling (BIM) subsystem integration as a multidiscipline application of various applied sciences for representation and data analysis. The authors of this research have been analysing human emotional, affective and physiological states for many years and collected over a billion of these data in Vilnius city during the H2020 ROCK, SAVAS and BIM4REN projects. Data acquired during measurements in Vilnius were used to determine correlations and trends for the case study. The proposed methodology and findings of the study can be useful for researchers who use the evaluation and analysis of human emotions when there is a need to choose appropriate renovation measures or find alternative solutions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: BIM and Construction Integration · Facilities and Workplace Management · Sustainable Building Design and Assessment
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Construction Management and Real Estate, Faculty of Civil Engineering, Vilnius Gediminas Technical University, Sauletekio al. 11, LT-10223 Vilnius, Lithuania
Funding
European Commission Erasmus+ programme
References (100+)
Show source-provided references
1. REDIS: A value-based decision support tool for renovation of building portfolios10.1016/j.buildenv.2018.06.016 ↗
2. A review of climate change implications for built environment: Impacts, mitigation measures and associated challenges in developed and developing countries10.1016/j.jclepro.2018.11.128 ↗
3. Research on the seismic retrofitting performance of RC frames using SC-PBSPC BRBF substructures10.1002/eqe.3265 ↗
4. Seismic retrofitting of existing frame buildings through externally attached sub-structures: State of the art review and future perspectives10.1016/j.jobe.2022.104904 ↗
5. Early stage decision support for sustainable building renovation—A review10.1016/j.buildenv.2016.04.009 ↗
6. Combining multi-criteria decision making (MCDM) methods with building information modelling (BIM): A review10.1016/j.autcon.2020.103451 ↗
7. BIM-aided large-scale group decision support: Optimization of the retrofit strategy for existing buildings10.1016/j.asoc.2022.109790 ↗
8. BIM competencies for delivering waste-efficient building projects in a circular economy10.1016/j.dibe.2020.100036 ↗
9. Narratives of a fractured trust in the Swedish model: Tenants’ emotions of renovation10.3384/cu.2000.1525.2019111141 ↗
10. Why do homeowners renovate energy efficiently? Contrasting perspectives and implications for policy10.1016/j.erss.2015.03.002 ↗
11. Affect and emotions as drivers of climate change perception and action: A review10.1016/j.cobeha.2021.02.001 ↗
12. Indoor air quality for sustainable building renovation: A decision-support assessment system using structural equation modelling10.1016/j.buildenv.2022.108933 ↗
13. A multi-criteria decision support method towards selecting feasible and sustainable housing renovation strategies10.1016/j.jclepro.2020.123588 ↗
14. A multi-criteria decision-making framework for residential building renovation using pairwise comparison and TOPSIS methods10.1016/j.jobe.2022.104596 ↗
15. An intelligent retrofit decision-making model for building program planning considering tacit knowledge and multiple objectives10.1016/j.energy.2022.125704 ↗
16. Intelligent decision support system for home energy retrofit adoption10.1016/j.ijsbe.2016.05.003 ↗
17. A hybrid decision support system for sustainable office building renovation and energy performance improvement10.1016/j.enbuild.2009.09.006 ↗
18. Sustainability focused decision-making in building renovation10.1016/j.ijsbe.2017.05.001 ↗
19. Constraint-based renovation design support through the renovation domain model10.1016/j.autcon.2019.04.023 ↗
20. Decision Support System for technology selection based on multi-criteria ranking: Application to NZEB refurbishment10.1016/j.buildenv.2022.108786 ↗
21. Sustainable building renovation for an ageing population: Decision support system through an integral assessment method of architectural interventions10.1016/j.scs.2018.01.050 ↗
22. Information needs for progressive BIM methodology supporting the holistic energy renovation of office buildings10.1016/j.energy.2019.02.087 ↗
23. Identifying optimal renovation schedules for building portfolios: Application in a social housing context under multi-year funding constraints10.1016/j.enbuild.2021.111290 ↗
24. Refurbishment criteria performance assessment methodologies based on a multiple-criteria approach10.1007/s10901-020-09752-6 ↗
25. Khadra, A., Hugosson, M., Akander, J., and Myhren, J.A. (2020). Development of a weight factor method for sustainability decisions in building renovation. Case study using Renobuild. Sustainability, 2.10.3390/su12177194 ↗
26. Decision support to choose renovation actions in order to reduce house energy consumption—An applied approach10.1016/j.buildenv.2016.09.019 ↗
27. An approach towards sustainable renovation—A tool for decision support in early project stages10.1016/j.buildenv.2016.06.016 ↗
28. Achieving nearly zero-energy buildings by applying multi-attribute assessment10.1016/j.enbuild.2017.03.037 ↗
29. Developing a decision aid for selecting low-carbon refurbishment solutions for multi-story residential buildings in subtropical cities10.1016/j.enbuild.2017.11.066 ↗
30. Sustainability assessment of energy saving measures: A multi-criteria approach for residential buildings retrofitting—A case study of the Spanish housing stock10.1016/j.enbuild.2016.01.019 ↗
31. Decision matrix methodology for retrofitting techniques of existing buildings10.1016/j.jclepro.2019.118153 ↗
32. Scenario-based economic and environmental analysis of clean energy incentives for households in Canada: Multi criteria decision making approach10.1016/j.jclepro.2018.07.014 ↗
33. Decision support for retrofitting building envelopes using multi-objective optimization under uncertainties10.1016/j.jobe.2020.101413 ↗
34. Generation of whole building renovation scenarios using variational autoencoders10.1016/j.enbuild.2020.110520 ↗
35. A decision support system for multi-criteria assessment of large building stocks10.3846/jcem.2019.9872 ↗
36. Analysis of problems, consequences and solutions for BIM application in reconstruction projects10.3846/13923730.2017.1374304 ↗
37. Nikmehr, B., Hosseini, M.R., Wang, J., Chileshe, N., and Rameezdeen, R. (2021). BIM-based tools for managing construction and demolition waste (CDW): A scoping review. Sustainability, 13.10.3390/su13158427 ↗
38. Jalilzadehazhari, E., Vadiee, A., and Johansson, P. (2019). Achieving a trade-off construction solution using BIM, an optimization algorithm, and a multi-criteria decision-making method. Buildings, 9.10.3390/buildings9040081 ↗
39. Using BIM as a lean management tool in construction processes—A case study10.1016/j.asej.2021.07.009 ↗
40. Towards the success of Building Information Modelling implementation: A fuzzy-based MCDM risk assessment tool10.1016/j.jobe.2021.103117 ↗
41. Application of MCDM and BIM for evaluation of asset redevelopment solutions10.24846/v25i3y201603 ↗
42. Kumar, B. (2018). Contemporary Strategies and Approaches in 3-D Information Modelling, IGI Global.10.4018/978-1-5225-5625-1 ↗
43. A real-time automated system for the recognition of human facial expressions10.1109/TSMCB.2005.854502 ↗
44. Recognition of emotions using multimodal physiological signals and an ensemble deep learning model10.1016/j.cmpb.2016.12.005 ↗
45. Are there basic emotions?10.1037/0033-295X.99.3.550 ↗
46. A whole and its parts: Behaviour, the brain, cognition and emotion
47. Watson, J.B. (2017). Behaviorism, Routledge.10.4324/9781351314329 ↗
48. What is an emotion?10.1093/mind/os-IX.35.421 ↗
49. Toward a general psychobiological theory of emotions10.1017/S0140525X00012759 ↗
50. Human emotion recognition from EEG-based brain–computer interface using machine learning: A comprehensive review10.1007/s00521-022-07292-4 ↗
51. A survey of emotion recognition methods with emphasis on E-Learning environments10.1016/j.jnca.2019.102423 ↗
52. Chao, L., Tao, J., Yang, M., Li, Y., and Wen, Z. (2016, January 20–25). Long short term memory recurrent neural network based encoding method for emotion recognition in video. Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.10.1109/ICASSP.2016.7472178 ↗
53. The challenges of emotion recognition methods based on electroencephalogram signals: A literature review
54. Bouali, Y.L., Ahmed, O.B., and Mazouzi, S. (2022, January 24–27). Cross-modal learning for audio-visual emotion recognition in acted speech. Proceedings of the 2022 6th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), Sfax, Tunisia.10.1109/ATSIP55956.2022.9805959 ↗
55. Jones, C.M., and Jonsson, I.M. (2005, January 21–25). Automatic recognition of affective cues in the speech of car drivers to allow appropriate responses. Proceedings of the 17th Australia Conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future, Canberra, Australia.
56. Toward emotion recognition in car-racing drivers: A biosignal processing approach10.1109/TSMCA.2008.918624 ↗
57. An effective Decision Support System for social media listening based on cross-source sentiment analysis models10.1016/j.engappai.2018.10.014 ↗
58. Deep learning for affective computing: Text-based emotion recognition in decision support10.1016/j.dss.2018.09.002 ↗
59. Algarni, M., Saeed, F., Al-Hadhrami, T., Ghabban, F., and Al-Sarem, M. (2022). Deep learning-based approach for emotion recognition using electroencephalography (EEG) signals using Bi-directional long short-term memory (Bi-LSTM). Sensors, 22.10.3390/s22082976 ↗
60. Multi-criteria decision making: An operations research approach
61. Measuring sustainability, resilience and livability performance of European smart cities: A novel fuzzy expert-based multi-criteria decision support model10.1016/j.cities.2023.104293 ↗
62. Multiple criteria decision-making techniques and their applications—A review of the literature from 2000 to 201410.1080/1331677X.2015.1075139 ↗
63. Automated facial coding: Validation of basic emotions and FACS AUs in FaceReader10.1037/npe0000028 ↗
64. Novelda, A.S. (2019, July 28). X4M200 Datasheet. Available online: https://www.codico.com/shop/media/datasheets/Novelda_X4M200_respiration_sensor_rev_c_preliminary.pdf.
65. FaceReader (2019, July 28). Reference Manual Version 7. Tool for Automatic Analysis of Facial Ex-pressions, Noldus Information Technology. Available online: http://sslab.nwpu.edu.cn/uploads/1500604789-5971697563f64.pdf.
66. Friesen, E., and Ekman, P. (1978). Facial Action Coding System: A Technique for the Measurement of Facial Movement, Consulting Psychologists Press.
67. Emotional induction through music: Measuring cardiac and electrodermal responses of emotional states and their persistence10.3389/fpsyg.2019.00451 ↗
68. Benezeth, Y., Li, P., Macwan, R., Nakamura, K., Gomez, R., and Yang, F. (2018, January 4–7). Remote heart rate variability for emotional state monitoring. Proceedings of the IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Vegas, NV, USA.10.1109/BHI.2018.8333392 ↗
69. Improving prediction accuracy of “Central Line-Associated Blood Stream Infections” using data mining models10.1155/2017/3292849 ↗
70. Tax compliance and psychic costs: Behavioral experimental evidence using a physiological marker10.1016/j.jpubeco.2015.12.007 ↗
71. Selection of low-e windows in retrofit of public buildings by applying multiple criteria method COPRAS: A Lithuanian case10.1016/j.enbuild.2005.08.005 ↗
72. Emotions analysis in public spaces for urban planning10.1016/j.landusepol.2021.105458 ↗
73. Emotional, affective and biometrical states analytics of a built environment10.1016/j.engappai.2020.103621 ↗
74. An affect-based built environment video analytics10.1016/j.autcon.2019.102888 ↗
75. Affective analytics of demonstration sites10.1016/j.engappai.2019.03.001 ↗
76. Kaklauskas, A., Abraham, A., Ubarte, I., Kliukas, R., Luksaite, V., Binkyte-Veliene, A., Vetloviene, I., and Kaklauskiene, L. (2022). A review of AI cloud and edge sensors, methods, and applications for the recognition of emotional, affective and physiological states. Sensors, 22.10.3390/s22207824 ↗
77. Diurnal emotions, valence and the coronavirus lockdown analysis in public spaces10.1016/j.engappai.2020.104122 ↗
78. Web-based biometric computer mouse advisory system to analyze a user’s emotions and work productivity10.1016/j.engappai.2011.04.006 ↗
79. Effects of country success on COVID-19 cumulative cases and excess deaths in 169 countries10.1016/j.ecolind.2022.108703 ↗
80. Analysis of the impact of success on three dimensions of sustainability in 173 countries10.1038/s41598-022-19131-6 ↗
81. Loijens, L., and Krips, O. (2013). FaceReader Methodology, Noldus Information Technology.
82. Bedon, C., and Mattei, S. (2021). Facial expression-based experimental analysis of human reactions and psychological comfort on glass structures in buildings. Buildings, 11.10.3390/buildings11050204 ↗
83. Fuzzy comprehensive evaluation of human physiological state in indoor high temperature environments10.1016/j.buildenv.2018.12.063 ↗
84. Fear and happiness, but not sadness, motivate attentional flexibility: A case for emotion influencing the ability to split foci of attention10.1037/emo0000471 ↗
85. Making the worst of a good job: Induced dampening appraisals blunt happiness and increase sadness in adolescents during pleasant memory recall10.1016/j.brat.2019.103476 ↗
86. Big data, scientific programming, and its role in internet of industrial things: A decision support system
87. Heart rate variability biofeedback increased autonomic activation and improved symptoms of depression and insomnia among patients with major depression disorder10.9758/cpn.2019.17.2.222 ↗
88. Tsihrintzis, G.A., and Jain, L.C. (2010). Multimedia Services in Intelligent Environments: Integrated Systems, Springer.10.1007/978-3-642-13396-1 ↗
89. A multimodal emotion recognition system using facial landmark analysis10.1007/s40998-018-0142-9 ↗
90. Hernandez, J., Lovejoy, J., McDuff, D., Suh, J., O’Brien, T., Sethumadhavan, A., Greene, G., and Czerwinski, M. (October, January 28). Guidelines for assessing and minimizing risks of emotion recognition applications. Proceedings of the 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII), Nara, Japan.10.1109/ACII52823.2021.9597452 ↗
91. Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies10.1037/0033-2909.115.1.102 ↗
92. Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements10.1177/1529100619832930 ↗
93. Context in emotion perception10.1177/0963721411422522 ↗
94. Faded smiles? A largescale observational study of smiling from adolescence to old age10.1109/TAFFC.2019.2922341 ↗
95. Cross-cultural and cultural-specific production and perception of facial expressions of emotion in the wild10.1109/TAFFC.2018.2887267 ↗
96. Kaklauskas, A. (1999). Multiple Criteria Decision Support of Building Life Cycle, Technika. Research Report Presented for Habilitation.
97. A neuro-advertising property video recommendation system10.1016/j.techfore.2017.07.011 ↗
98. Kaklauskas, A., Ubarte, I., Kalibatas, D., Lill, I., Velykorusova, A., Volginas, P., Vinogradova, I., Milevicius, V., Vetloviene, I., and Grubliauskas, R. (2019). A multisensory, green, and energy efficient housing neuromarketing method. Energies, 12.10.3390/en12203836 ↗
99. Kaklauskas, A., Zavadskas, E.K., Schuller, B., Lepkova, N., Dzemyda, G., Sliogeriene, J., and Kurasova, O. (2020). Customized ViNeRS method for video neuro-advertising of green housing. Int. J. Environ. Res. Public Health, 17.10.3390/ijerph17072244 ↗
100. Integrated hedonic-utilitarian valuation of the built environment by Neutrosophic INVAR method10.1016/j.landusepol.2020.105150 ↗