journal article·2023-10-30Open access

Determinants of Emotion Recognition System Adoption: Empirical Evidence from Malaysia

Muhammad Nadzree Mohd Yamin, Kamarulzaman Ab. Aziz, Tan Gek Siang, Nor Azlina Ab. Aziz

Applied Sciences· Volume 13· Issue 21

Abstract

Emotion recognition systems (ERS) are an emerging technology with immense potential, exemplifying the innovative utilization of artificial intelligence (AI) within the context of the fourth industrial revolution (IR 4.0). Given that personalization is a key feature of the fifth industrial revolution (IR 5.0), ERS has the potential to serve as an enabler for IR 5.0. Furthermore, the COVID-19 pandemic has increased the relevance of this technology as work processes were adapted for social distancing and the use of face masks. Even in the post-pandemic era, many individuals continue to wear face masks. Therefore, ERS offers a technological solution to address communication challenges in a masked world. The existing body of knowledge on ERS primarily focuses on exploring modalities or modes for emotion recognition, system development, and the creation of applications utilizing emotion recognition functions. However, to enhance the development of impactful ERS, it is essential for researchers and innovators to understand the factors that influence its usage and adoption among the intended users. Therefore, this study presents a framework that combines technology adoption theories to identify the determinants of ERS adoption among Malaysian youth. Data for this study were collected through a survey involving 386 respondents. The findings revealed attitudes, subjective norms, perceived behavioral control, and awareness as significant determinants of ERS adoption. Additionally, the study found that technology aptitude plays a moderating role. These insights can inform the formulation of effective policies and programs to encourage and facilitate the development of innovative ERS solutions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Emotion and Mood Recognition · AI in Service Interactions · Consumer Retail Behavior Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Business, Multimedia University, Melaka 75450, Malaysia

Faculty of Engineering and Technology, Multimedia University, Melaka 75450, Malaysia

Funding

Telekom Malaysia Research and Development Sdn. Bhd. · Multimedia University

References (100+)

Show source-provided references
1. Trust in AI and Its Role in the Acceptance of AI Technologies10.1080/10447318.2022.2050543 ↗
2. Trustworthy artificial intelligence10.1007/s12525-020-00441-4 ↗
3. Krafft, P.M., Young, M., Katell, M., Huang, K., and Bugingo, G. (2020, January 7–9). Defining AI in policy versus practice. Proceedings of the AIES 2020—AAAI/ACM Conference on AI, Ethics, and Society, New York, NY, USA.10.1145/3375627.3375835 ↗
4. Artificial intelligence for sustainability: Challenges, opportunities, and a research agenda10.1016/j.ijinfomgt.2020.102104 ↗
5. Industry 4.0, digitization, and opportunities for sustainability10.1016/j.jclepro.2019.119869 ↗
6. Human–computer communication using recognition and synthesis of facial expression10.2991/jrnal.k.210521.003 ↗
7. Sumi, K. (2016, January 29–31). Affective Human Computer Interaction. Proceedings of the International Conference on Artificial Life and Robotics, Okinawa, Japan.10.5954/ICAROB.2016.IS2 ↗
8. Industrial Revolution 5.0: The Transformation of the Modern Manufacturing Process to Enable Man and Machine to Work Hand in Hand
9. Picard, R.W. (1999, January 22–26). Affective Computing for HCI. Proceedings of the 8th HCI International on Human-Computer Interaction: Ergonomics and User Interfaces, Munich, Germany. Available online: http://dl.acm.org/citation.cfm?id=647943.742338.
10. Kodhai, E., Pooveswari, A., Sharmila, P., and Ramiya, N. (2020, January 3–4). Literature Review on Emotion Recognition System. Proceedings of the 2020 International Conference on System, Computation, Automation and Networking, ICSCAN, Pondicherry, India.10.1109/ICSCAN49426.2020.9262389 ↗
11. Hippe, Z.S., Kulikowski, J.L., Mroczek, T., and Wtorek, J. (2014). Human-Computer Systems Interaction: Backgrounds and Applications 3, Springer. Advances in Intelligent Systems and Computing.10.1007/978-3-319-08491-6 ↗
12. Hasnul, M.A., Aziz, N.A.A., Alelyani, S., Mohana, M., and Aziz, A.A. (2021). Electrocardiogram-Based Emotion Recognition Systems and Their Applications in Healthcare—A Review. Sensors, 21.10.3390/s21155015 ↗
13. Driver emotion recognition of multiple-ECG feature fusion based on BP network and D-S evidence10.1049/iet-its.2019.0499 ↗
14. Real-Time Emotion Recognition System to Monitor Student’s Mood in a Classroom10.1088/1742-6596/1413/1/012021 ↗
15. The ‘digital natives’ debate: A critical review of the evidence10.1111/j.1467-8535.2007.00793.x ↗
16. E-learning: Ageing workforce versus technology-savvy generation10.1108/00400911211244687 ↗
17. Uncertainty in emotion recognition10.1108/JICES-03-2019-0034 ↗
18. Deep learning for affective computing: Text-based emotion recognition in decision support10.1016/j.dss.2018.09.002 ↗
19. Industrial Artificial Intelligence in Industry 4.0—Systematic Review, Challenges and Outlook10.1109/ACCESS.2020.3042874 ↗
20. Gloor, P.A., Colladon, A.F., Altuntas, E., Cetinkaya, C., Kaiser, M.F., Ripperger, L., and Schaefer, T. (2022). Your Face Mirrors Your Deepest Beliefs—Predicting Personality and Morals through Facial Emotion Recognition. Future Internet, 14.10.3390/fi14010005 ↗
21. Alhalaseh, R., and Alasasfeh, S. (2020). Machine-Learning-Based Emotion Recognition System Using EEG Signals. Computers, 9.10.3390/computers9040095 ↗
22. Deep learning for electroencephalogram (EEG) classification tasks: A review10.1088/1741-2552/ab0ab5 ↗
23. Development and Validation of an EEG-Based Real-Time Emotion Recognition System Using Edge AI Computing Platform with Convolutional Neural Network System-on-Chip Design10.1109/JETCAS.2019.2951232 ↗
24. Tong, Z., Chen, X., He, Z., Tong, K., Fang, Z., and Wang, X. (2018, January 23–27). Emotion Recognition Based on Photoplethysmogram and Electroencephalogram. Proceedings of the 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), Tokyo, Japan.10.1109/COMPSAC.2018.10266 ↗
25. EEG-Based Emotion Recognition: A State-of-the-Art Review of Current Trends and Opportunities10.1155/2020/8875426 ↗
26. Udovičić, G., Ðerek, J., Russo, M., and Sikora, M. (2017, January 23). Wearable Emotion Recognition system based on GSR and PPG signals. Proceedings of the MMHealth 2017—2nd International Workshop on Multimedia for Personal Health and Health Care, Co-Located with MM, Mountain View, CA, USA.10.1145/3132635.3132641 ↗
27. Rathour, N., Khanam, Z., Gehlot, A., Singh, R., Rashid, M., AlGhamdi, A.S., and Alshamrani, S.S. (2021). Real-Time Facial Emotion Recognition Framework for Employees of Organizations Using Raspberry-Pi. Appl. Sci., 11.10.3390/app112210540 ↗
28. Kundu, T., and Saravanan, C. (2017, January 15–16). Advancements and recent trends in emotion recognition using facial image analysis and machine learning models. Proceedings of the International Conference on Electrical, Electronics, Communication Computer Technologies and Optimization Techniques, ICEECCOT, Mysuru, India.10.1109/ICEECCOT.2017.8284512 ↗
29. Shinde, A.S., and Patil, V.V. (2021, January 7). Speech Emotion Recognition System: A Review. Proceedings of the 4th International Conference on Advances in Science and Technology (ICAST, 2021), Mumbai, India.10.2139/ssrn.3869462 ↗
30. Survey on speech emotion recognition: Features, classification schemes, and databases10.1016/j.patcog.2010.09.020 ↗
31. Huang, Y., Yang, J., Liu, S., and Pan, J. (2019). Combining facial expressions and electroencephalography to enhance emotion recognition. Future Internet, 11.10.3390/fi11050105 ↗
32. Sentiment analysis for mining texts and social networks data: Methods and tools10.1002/widm.1333 ↗
33. A Review of Different Approaches for Detecting Emotion from Text10.1088/1757-899X/1110/1/012009 ↗
34. GeethaRamani, R., Kumar, M.N., and Balasubramanian, L. (2016, January 25–27). Identification of emotions in text articles through data pre-processing and data mining techniques. Proceedings of the 2016 International Conference on Advanced Communication Control and Computing Technologies, ICACCCT, Ramanathapuram, India.10.1109/ICACCCT.2016.7831713 ↗
35. Towards emotion recognition from contextual information using machine learning10.1007/s12652-019-01485-x ↗
36. Atif, M., and Franzoni, V. (2022). Tell Me More: Automating Emojis Classification for Better Accessibility and Emotional Context Recognition. Future Internet, 14.10.3390/fi14050142 ↗
37. Emotions recognition as innovative tool for improving students’ performance and learning approaches10.1016/j.procs.2020.07.086 ↗
38. Kalyta, O., Barmak, O., Radiuk, P., and Krak, I. (2023). Facial Emotion Recognition for Photo and Video Surveillance Based on Machine Learning and Visual Analytics. Appl. Sci., 13.10.3390/app13179890 ↗
39. Alghamdi, T., and Alaghband, G. (2023). SAFEPA: An Expandable Multi-Pose Facial Expressions Pain Assessment Method. Appl. Sci., 13.10.3390/app13127206 ↗
40. Duville, M.M., Pérez, Y., Hugues-Gudiño, R., Naal-Ruiz, N.E., Alonso-Valerdi, L.M., and Ibarra-Zarate, D.I. (2023). Systematic Review: Emotion Recognition Based on Electrophysiological Patterns for Emotion Regulation Detection. Appl. Sci., 13.10.3390/app13126896 ↗
41. A survey on human emotion recognition approaches, databases and applications
42. Haridas, A.V., Marimuthu, R., and Chakraborty, B. (2020, January 8–10). Emotion Recognition System for Specially Needed People with Optimized Deep Learning Algorithm. Proceedings of the 2020 Fourth International Conference on Inventive Systems and Control (ICISC), Coimbatore, India.10.1109/ICISC47916.2020.9171190 ↗
43. Rößler, J., Sun, J., and Gloor, P. (2021). Reducing Videoconferencing Fatigue through Facial Emotion Recognition. Future Internet, 13.10.3390/fi13050126 ↗
44. Santamaria-Granados, L., Mendoza-Moreno, J.F., and Ramirez-Gonzalez, G. (2021). Tourist Recommender Systems Based on Emotion Recognition—A Scientometric Review. Future Internet, 13.10.3390/fi13010002 ↗
45. Deep learning in digital marketing: Brand detection and emotion recognition
46. Davis, F.D. (1986). A Technology Acceptance Model for Empirically Testing New End-User Information Systems. [Ph.D. Thesis, Massachusetts Institute of Technology]. Available online: https://www.researchgate.net/publication/35465050_A_Technology_Acceptance_Model_for_Empirically_Testing_New_End-User_Information_Systems.
47. The theory of planned behaviour: Reactions and reflections10.1080/08870446.2011.613995 ↗
48. Rogers, E.M. (1962). Diffusion of Innovations, Free Press of Glencoe.
49. User Acceptance of Information Technology: Toward a Unified View10.2307/30036540 ↗
50. A review of technology acceptance and adoption models and theories10.1016/j.promfg.2018.03.137 ↗
51. The Literature Review of Technology Adoption Models and Theories for the Novelty Technology
52. An adapted TPB approach to consumers’ acceptance of service-delivery drones10.1080/09537325.2016.1242720 ↗
53. Applying Ajzen’s Theory of Planned Behavior to a Study of Online Course Adoption in Public Relations Education
54. Detailed Review of Rogers’ Diffusion of Innovations Theory and Educational Technology-Related Studies Based on Rogers’ Theory
55. Diffusion of Innovation Theory in the Realm of Environmental Construction
56. Bhattacharyya, K., and Smith, N.T. (2018). Antecedents to the Success of Block Chain Technology Adoption in Manufacturing Supply Chains, Association for Computing Machinery.10.1145/3278252.3278273 ↗
57. Complex adaptive systems and the diffusion of innovations
58. Developing a general extended UTAUT model for M-payment adoption10.1016/j.techsoc.2020.101293 ↗
59. A meta-analysis of the UTAUT model in the mobile banking literature: The moderating role of sample size and culture10.1016/j.jbusres.2021.04.052 ↗
60. Mobile augmented reality applications for heritage preservation in UNESCO world heritage sites through adopting the UTAUT model10.1063/1.4980928 ↗
61. Awareness and Readiness of Malaysian University Students for Emotion Recognition System
62. Machines that feel: Behavioral determinants of attitude towards affect recognition technology—Upgrading technology acceptance theory with the mindsponge model10.1057/s41599-023-01837-1 ↗
63. Saunders, M., Lewis, P., and Thornhill, A. (2019). Research Methods for Business Students, Pearson Education Limited.
64. Unified Theory of Acceptance and Use of Technology: A Synthesis and the Road Ahead
65. An Empirical Study of the Acceptance of IoT-Based Smart Meter in Malaysia: The Effect of Electricity-Saving Knowledge and Environmental Awareness10.1109/ACCESS.2020.2977060 ↗
66. The Role of Facilitating Conditions and User Habits: A Case of Indonesian Online Learning Platform10.13106/jafeb.2020.vol7.no10.481 ↗
67. Determinants of Behavior Intention and Use Behavior among Bukalapak’s Consumers10.12962/j20882033.v31i2.5585 ↗
68. Adoption of Agricultural E-Marketing: Application of the Theory of Planned Behavior10.1080/08974438.2016.1229242 ↗
69. Green information technology adoption: Influencing factors and extension of theory of planned behavior10.1108/SRJ-05-2016-0064 ↗
70. Understanding the Blockchain technology adoption in supply chains-Indian context10.1080/00207543.2018.1518610 ↗
71. Adoption and diffusion of digital farming technologies—Integrating farm-level evidence and system interaction10.1016/j.agsy.2021.103074 ↗
72. A Study on the performance evaluation of user awareness technology based Smart Lighting Control System for energy saving10.14257/ijsh.2014.8.5.01 ↗
73. Exploring biometric technology adoption in a developing country context using the modified UTAUT
74. Evaluating Barriers on Biogas Technology Adoption in China: The Moderating Role of Awareness and Technology Understanding10.3389/fenvs.2022.887084 ↗
75. Critical barriers to augmented reality technology adoption in developing countries: A case study of Nigeria
76. Yamin, M.N.M., Aziz, K.A., Siang, T.G., and Aziz, N.A.A. (2022, January 25–27). Emotion Recognition System: A Proposed Framework. Proceedings of the International Conference on Technology and Innovation Management (ICTIM 2022), Cyberjaya, Malaysia.10.2991/978-94-6463-080-0_16 ↗
77. Research Design and Methods: A Systematic Review of Research Paradigms, Sampling Issues and Instruments Development10.4172/2162-6359.1000403 ↗
78. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses10.3758/BRM.41.4.1149 ↗
79. Personal computing: Toward a conceptual model of utilization10.2307/249443 ↗
80. Are government employees adopting local e-government transformation? The need for having the right attitude, facilitating conditions and performance expectations
81. Facilitating conditions for successful adoption of inter-organizational information systems in seaports10.1016/j.tra.2019.09.017 ↗
82. Examining the influence of subjective norm and facilitating conditions on the intention to use technology among pre-service teachers: A structural equation modeling of an extended technology acceptance model10.1007/s12564-009-9066-4 ↗
83. Ajzen, I. (2019). TPB Questionnaire Construction Constructing a Theory of Planned Behaviour Questionnaire, University of Massachusetts Amherst. Available online: http://people.umass.edu/~aizen/pdf/tpb.measurement.pdf.
84. Determinants of Consumers’ Green Purchase Behavior in a Developing Nation: Applying and Extending the Theory of Planned Behavior10.1016/j.ecolecon.2016.12.019 ↗
85. Flowers, E.P., Freeman, P., and Gladwell, V.F. (2017). The development of three questionnaires to assess beliefs about green exercise. Int. J. Environ. Res. Public Health, 14.10.3390/ijerph14101172 ↗
86. What Is Coefficient Alpha? An Examination of Theory and Applications10.1037/0021-9010.78.1.98 ↗
87. Starting at the beginning: An introduction to coefficient alpha and internal consistency10.1207/S15327752JPA8001_18 ↗
88. Coefficient α as a Measure of Test Score Reliability: Review of 3 Popular Misconceptions10.2105/AJPH.2015.302993 ↗
89. CB-SEM vs PLS-SEM methods for research in social sciences and technology forecasting10.1016/j.techfore.2021.121092 ↗
90. Sample Size for Survey Research: Review and Recommendations
91. PLS-SEM or CB-SEM: Updated guidelines on which method to use10.1504/IJMDA.2017.087624 ↗
92. Ringle, C.M., Wende, S., and Becker, J.M. (2023, March 05). SmartPLS 4. Oststeinbek: SmartPLS. Available online: https://www.smartpls.com.
93. Investigating e-wallet adoption of COVID-19 intra-period among Malaysian youths’: Integrated task-technology fit and technology acceptance model framework10.5267/j.ijdns.2021.6.004 ↗
94. Mobile banking adoption of the youth market: Perceptions and intentions10.1108/02634501211231928 ↗
95. Kline, R.B. (1998). Principles and Practice of Structural Equation Modeling, Guilford Press.
96. Parametric or Non-parametric: Skewness to Test Normality for Mean Comparison10.21449/ijate.656077 ↗
97. Structural Relationship of Technology Adoption and Performance Factors in UAE Manufacturing Industry
98. Sarstedt, M., Ringle, C.M., and Hair, J.F. (2017). Partial Least Squares Structural Equation Modeling, Springer International Publishing.10.1007/978-3-319-05542-8_15-1 ↗
99. Hair, J.F., Hult, G.T.M., Ringle, C.M., Sarstedt, M., Danks, N.P., and Ray, S. (2021). Evaluation of Reflective Measurement Models, Springer.10.1007/978-3-030-80519-7_4 ↗
100. Ramayah, T., Hwa, C., Chuah, F., Ting, H., and Memon, M. (2018). Partial Least Squares Structural Equation Modeling (PLS-SEM) Using SmartPLS 3.0: An Updated and Practical Guide to Statistical Analysis, Pearson.