journal article·2025-04-28Open access

Evaluation of Rural Visual Landscape Quality Based on Multi-Source Affective Computing

Xinyu Zhao, Lin Lin, Xiao Guo, Zhisheng Wang, Ruixuan Li

Applied Sciences· Volume 15· Issue 9

Abstract

Assessing the visual quality of rural landscapes is pivotal for quantifying ecological services and preserving cultural heritage; however, conventional ecological indicators neglect emotional and cognitive dimensions. To address this gap, the present study proposes a novel visual quality assessment method for rural landscapes that integrates multimodal sentiment classification models to strengthen sustainability metrics. Four landscape types were selected from three representative villages in Dalian City, China, and the physiological signals (EEG, EOG) and subjective evaluations (Beauty Assessment and SAM Scales) of students and teachers were recorded. Binary, ternary, and five-category emotion classification models were then developed. Results indicate that the binary and ternary models achieve superior accuracy in emotional valence and arousal, whereas the five-category model performs least effectively. Furthermore, an ensemble learning approach outperforms individual classifiers in both binary and ternary tasks, yielding a 16.54% increase in mean accuracy. Integrating subjective and objective data further enhances ternary classification accuracy by 7.7% compared to existing studies, confirming the value of multi-source features. These findings demonstrate that a multi-source sentiment computing framework can serve as a robust quantitative tool for evaluating emotional quality in rural landscapes and promoting their sustainable development.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Color perception and design · Multisensory perception and integration · Emotion and Mood Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Art and Design, Dalian Polytechnic University, Dalian 116034, China

School of Design, Dalian Minzu University, Dalian 116600, China

Funding

Humanities and Social Science Fund of Chinese Ministry of Education · Guizhou Provincial Science and Technology Projects · Liaoning Province Social Science Federation project · Ministry of Education industry-university cooperative education project

References (82)

Show source-provided references
1. Assessing the Visual Quality of Rural and Urban-fringed Landscapes Surrounding Livestock Farms10.1016/j.biosystemseng.2006.07.011 ↗
2. Ecosystem Restoration along the “Pattern-Process-service-sustainability” Path for Achieving Land Degradation Neutrality10.1016/j.landurbplan.2024.105227 ↗
3. Assessing, Mapping, and Quantifying Cultural Ecosystem Services at Community Level10.1016/j.landusepol.2012.12.013 ↗
4. Review on Stimuli Presentation for Affect Analysis Based on EEG10.1109/ACCESS.2020.2980893 ↗
5. Whose Emotion is It? Perspective Matters to Understand Brain-Body Interactions in Emotions10.1016/j.neuroimage.2023.119867 ↗
6. A Systematic Review on Affective Computing: Emotion Models, Databases, and Recent Advances10.1016/j.inffus.2022.03.009 ↗
7. Investigating Multisensory Integration in Emotion Recognition Through Bio-Inspired Computational Models10.1109/TAFFC.2021.3106254 ↗
8. Emotion Recognition from Multimodal Physiological Signals for Emotion Aware Healthcare Systems10.1007/s40846-019-00505-7 ↗
9. Needs and Challenges in Human Computer Interaction for Processing Social Emotional Information10.1016/j.patrec.2015.02.013 ↗
10. The Role of Emotion in Decision Making10.1111/j.1467-8721.2006.00448.x ↗
11. Toward Machine Emotional Intelligence: Analysis of Affective Physiological State10.1109/34.954607 ↗
12. Quick Computation of Spatial Autoregressive Estimators10.1111/j.1538-4632.1997.tb00959.x ↗
13. Defining Affect in Relation to Cognition: A Response to Susan McLeod
14. Affective Computing in Education: A Systematic Review and Future Research10.1016/j.compedu.2019.103649 ↗
15. Liberati, G., Veit, R., Kim, S., Birbaumer, N., Von Arnim, C., Jenner, A., Lulé, D., Ludolph, A.C., Raffone, A., and Belardinelli, M.O. (2013, January 2–5). Development of a Binary Fmri-Bci for Alzheimer Patients: A Semantic Conditioning Paradigm Using Affective Unconditioned Stimuli. Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva, Switzerland.10.1109/ACII.2013.157 ↗
16. Pei, G., and Li, T. (2021). A Literature Review of EEG-Based Affective Computing in Marketing. Front. Psychol., 12.10.3389/fpsyg.2021.602843 ↗
17. Detecting Stress During Real-World Driving Tasks Using Physiological Sensors10.1109/TITS.2005.848368 ↗
18. Opinion Mining and Information Fusion: A Survey10.1016/j.inffus.2015.06.002 ↗
19. Gómez, L.M., and Cáceres, M.N. (2017, January 21–23). Applying Data Mining for Sentiment Analysis in Music. Proceedings of the Advances in Intelligent Systems and Computing Trends in Cyber-Physical Multi-Agent Systems the Paams Collection—15th International Conference, Paams 2017, Porto, Portugal.
20. An Effective Decision Support System for Social Media Listening Based on Cross-Source Sentiment Analysis Models10.1016/j.engappai.2018.10.014 ↗
21. Emotion Recognition from Physiological Signal Analysis: A Review10.1016/j.entcs.2019.04.009 ↗
22. Multimodal Emotion Recognition in Speech-Based Interaction Using Facial Expression, Body Gesture and Acoustic Analysis10.1007/s12193-009-0025-5 ↗
23. Aspect Extraction for Opinion Mining with a Deep Convolutional Neural Network10.1016/j.knosys.2016.06.009 ↗
24. Cambria, E., Das, D., Bandyopadhyay, S., and Feraco, A. (2017). Affective Computing and Sentiment Analysis. A Practical Guide to Sentiment Analysis, Springer.10.1007/978-3-319-55394-8 ↗
25. Cambria, E., Speer, R., Havasi, C., and Hussain, A. (2010). Senticnet: A Publicly Available Semantic Resource for Opinion Mining. AAAI Fall Symposium Commonsense Knowledge, AAAI Press.
26. A Review of Affective Computing: From Unimodal Analysis to Multimodal Fusion10.1016/j.inffus.2017.02.003 ↗
27. Are They Different? Affect, Feeling, Emotion, Sentiment, and Opinion Detection in Text10.1109/TAFFC.2014.2317187 ↗
28. II.3. Electrograms (ECG, EEG, EMG, EOG)
29. A Novel Emotion-Aware Method Based on the Fusion of Textual Description of Speech, Body Movements, and Facial Expressions10.1109/TIM.2022.3204940 ↗
30. Jiang, W., Liu, X., Zheng, W., and Lu, B. (2024). SEED-VII: A Multimodal Dataset of Six Basic Emotions with Continuous Labels for Emotion Recognition. IEEE Trans. Affect. Comput., 1–16.10.1109/TAFFC.2024.3485057 ↗
31. Emotions Recognition Using EEG Signals: A Survey10.1109/TAFFC.2017.2714671 ↗
32. Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks10.1109/TAMD.2015.2431497 ↗
33. EmotionMeter: A Multimodal Framework for Recognizing Human Emotions10.1109/TCYB.2018.2797176 ↗
34. A Multimodal Database for Affect Recognition and Implicit Tagging10.1109/T-AFFC.2011.25 ↗
35. Jafari, M., Shoeibi, A., Khodatars, M., Bagherzadeh, S., Shalbaf, A., García, D.L., Gorriz, J.M., and Acharya, U.R. (2023). Emotion Recognition in EEG Signals Using Deep Learning Methods: A Review. Comput. Biol. Med., 165.10.1016/j.compbiomed.2023.107450 ↗
36. A Comparative Analysis of Machine Learning Methods for Emotion Recognition Using EEG and Peripheral Physiological Signals
37. Li, R., Yuizono, T., and Li, X. (2022). Affective Computing of Multi-Type Urban Public Spaces to Analyze Emotional Quality Using Ensemble Learning-Based Classification of Multi-Sensor Data. PLoS ONE, 17.10.1371/journal.pone.0269176 ↗
38. Multimodal fusion framework: A multiresolution approach for emotion classification and recognition from physiological signals10.1016/j.neuroimage.2013.11.007 ↗
39. An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Era10.1109/JPROC.2023.3250266 ↗
40. Heredia, B., Khoshgoftaar, T.M., Prusa, J.D., and Crawford, M. (2016, January 7–10). Integrating Multiple Data Sources to Enhance Sentiment Prediction. Proceedings of the IEEE Conference Proceedings, Las Vegas, NV, USA.10.1109/CIC.2016.046 ↗
41. Li, F., Lv, Y., Zhu, Q., and Lin, X. (2015, January 4–6). Research of Food Safety Event Detection Based on Multiple Data Sources. Proceedings of the 2015 International Conference on Cloud Computing and Big Data (CCBD), Shanghai, China.10.1109/CCBD.2015.36 ↗
42. Agricultural Heritage Systems and Agrobiodiversity10.1007/s10531-022-02460-3 ↗
43. Assessing the Visual Quality of Rural Landscapes10.1016/j.landurbplan.2003.10.029 ↗
44. Landscape Aesthetics: Assessing the General Publics’ Preferences Towards Rural Landscapes10.1016/j.ecolecon.2011.09.026 ↗
45. Misthos, L., Krassanakis, V., Merlemis, N., and Kesidis, A.L. (2023). Modeling the Visual Landscape: A Review on Approaches, Methods and Techniques. Sensors, 23.10.3390/s23198135 ↗
46. Quantifying Visual Landscape Quality in Rural Wales: A GIS-enabled Method for Extensive Monitoring of a Valued Cultural Ecosystem Service10.1016/j.ecoser.2016.11.004 ↗
47. Criado, M., Martinez-Grana, A., Santos-Frances, F., and Merchán, L. (2020). Landscape Evaluation As a Complementary Tool in Environmental Assessment. Study Case in Urban Areas: Salamanca (Spain). Sustainability, 12.10.3390/su12166395 ↗
48. Yao, X., and Sun, Y. (2024). Using a Public Preference Questionnaire and Eye Movement Heat Maps to Identify the Visual Quality of Rural Landscapes in Southwestern Guizhou, China. Land, 13.10.3390/land13050707 ↗
49. Research on Visual Quality Assessment and Landscape Elements Influence Mechanism of Rural Greenways10.1016/j.ecolind.2024.111844 ↗
50. Liang, T., and Peng, S. (2017). Using Analytic Hierarchy Process to Examine the Success Factors of Autonomous Landscape Development in Rural Communities. Sustainability, 9.10.3390/su9050729 ↗
51. Human Alteration of the Rural Landscape: Variations in Visual Perception
52. Ding, N., Zhong, Y., Li, J., Xiao, Q., Zhang, S., and Xia, H. (2022). Visual Preference of Plant Features in Different Living Environments Using Eye Tracking and EEG. PLoS ONE, 17.10.1371/journal.pone.0279596 ↗
53. Ye, F., Yin, M., Cao, L., Sun, S., and Wang, X. (2024). Predicting Emotional Experiences Through Eye-Tracking: A Study of Tourists’ Responses to Traditional Village Landscapes. Sensors, 24.10.3390/s24144459 ↗
54. Wang, Y., Wang, S., and Xu, M. (2022). Landscape Perception Identification and Classification Based on Electroencephalogram (EEG) Features. Int. J. Environ. Res. Public Health, 19.10.3390/ijerph19020629 ↗
55. Engaging the Brain: The Impact of Natural Versus Urban Scenes Using Novel EEG Methods in an Experimental Setting
56. Health Effects of Viewing Landscapes—Landscape Types in Environmental Psychology10.1016/j.ufug.2007.07.001 ↗
57. Representational validity of landscape visualizations: The effects of graphical realism on perceived scenic beauty of forest vistas10.1006/jevp.2000.0182 ↗
58. The validity of computer-generated graphic images of forest landscape10.1016/0272-4944(95)90021-7 ↗
59. Theoretical Base and Evaluating Indicator System of Rural Landscape Assessment in China
60. Research advance and index system of rural landscape evaluation
61. Measuring Emotion: The Self-Assessment Manikin and the Semantic Differential10.1016/0005-7916(94)90063-9 ↗
62. Jebb, A.T., Ng, V., and Tay, L. (2021). A Review of Key Likert Scale Development Advances: 1995–2019. Front. Psychol., 12.10.3389/fpsyg.2021.637547 ↗
63. Impedance and Noise of Passive and Active Dry EEG Electrodes: A Review10.1109/JSEN.2020.3012394 ↗
64. Evaluation of the Efficacy of Artificial Neural Network-Based Music Therapy for Depression10.1155/2022/9208607 ↗
65. Can Likert Scales Be Treated As Interval Scales?—A Simulation Study10.1080/01488376.2017.1329775 ↗
66. A Comparison of Psychometric Properties and Normality in 4-, 5-, 6-, and 11-Point Likert Scales10.1080/01488376.2011.580697 ↗
67. A Multimodal Exploration of Engineering Students’ Emotions and Electrodermal Activity in Design Activities10.1002/jee.20225 ↗
68. Siirtola, P., Tamminen, S., Chandra, G., Ihalapathirana, A., and Röning, J. (2023). Predicting Emotion with Biosignals: A Comparison of Classification and Regression Models for Estimating Valence and Arousal Level Using Wearable Sensors. Sensors, 23.10.3390/s23031598 ↗
69. Saiz-Manzanares, M.C., Perez, I.R., Rodriguez, A.A., Arribas, S.R., Almeida, L., and Martin, C.F. (2021). Analysis of the Learning Process Through Eye Tracking Technology and Feature Selection Techniques. Appl Sci, 11.10.3390/app11136157 ↗
70. Applying Dimension Reduction to EEG Data by Principal Component Analysis Reduces the Quality of Its Subsequent Independent Component Decomposition10.1016/j.neuroimage.2018.03.016 ↗
71. Data Fusion and Multiple Classifier Systems for Human Activity Detection and Health Monitoring: Review and Open Research Directions10.1016/j.inffus.2018.06.002 ↗
72. SMOTE: Synthetic Minority Over-Sampling Technique10.1613/jair.953 ↗
73. Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization
74. Bergstra, J., Bardenet, R., Bengio, Y., and Kégl, B. (2011, January 12–15). Algorithms for Hyper-Parameter Optimization. Proceedings of the Advances in Neural Information Processing Systems, Granada, Spain.
75. Cross-Validation for Imbalanced Datasets: Avoiding Overoptimistic and Overfitting Approaches [Research Frontier]10.1109/MCI.2018.2866730 ↗
76. Speech Emotion Recognition Based on SVM and ANN10.18178/ijmlc.2018.8.3.687 ↗
77. Ramadhan, W.P., Novianty, A., and Setianingsih, C. (2017, January 26–28). Sentiment Analysis Using Multinomial Logistic Regression. Proceedings of the 2017 International Conference on Control, Electronics, Renewable Energy and Communications (ICCREC), Yogyakarta, Indonesia.10.1109/ICCEREC.2017.8226700 ↗
78. Olsen, A.F., and Torresen, J. (2016, January 19–21). Smartphone Accelerometer Data Used for Detecting Human Emotions. Proceedings of the 2016 3rd International Conference on Systems and Informatics (ICSAI), Shanghai, China.10.1109/ICSAI.2016.7810990 ↗
79. Takahashi, K. (2004, January 8–10). Remarks on Emotion Recognition from Multi-Modal Bio-Potential Signals. Proceedings of the 2004 IEEE International Conference on Industrial Technology, 2004 IEEE Icit ‘04, Hammamet, Tunisia.
80. Kalimeri, K., and Saitis, C. (2016, January 12–16). Exploring Multimodal Biosignal Features for Stress Detection During Indoor Mobility. Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan.10.1145/2993148.2993159 ↗
81. Marin-Morales, J., Llinares, C., Guixeres, J., and Alcañiz, M. (2020). Emotion Recognition in Immersive Virtual Reality: From Statistics to Affective Computing. Sensors, 20.10.3390/s20185163 ↗
82. The Relation Between Valence and Arousal in Subjective Experience10.1037/a0030811 ↗