journal article·2025-02-20Open access

LePB-SA4RE: A Lexicon-Enhanced and Prompt-Tuning BERT Model for Evolving Requirements Elicitation from App Reviews

Zhiquan An, Hongyan Wan, Teng Xiong, Bangchao Wang

Applied Sciences· Volume 15· Issue 5

Abstract

Pre-trained language models with fine-tuning (FT) have achieved notable success in aspect-based sentiment analysis (ABSA) for automatic requirements elicitation from app reviews. However, the fixed parameters during FT progress often face challenges when applied to low-resource and noisy app review scenarios. Although prompt-tuning (PT) has gained attention in ABSA for its flexibility and adaptability, this improved performance can sometimes reduce the generalization and robustness of pre-trained models. To mitigate these issues, this study introduces LePB-SA4RE, a novel ABSA model that integrates the Bidirectional Encoder Representations from Transformers (BERT) architecture with a hard template-based PT method and embeds a lexicon-enhanced dynamic modulation layer. Specifically, the activation function of this layer incorporates weights designed with sentiment-oriented dynamic parameters to enhance the sensitivity of the model to diverse sentiment inputs, and a sentiment lexicon containing three hundred thousand word–sentiment polarity pairs is embedded into the model as additional semantic cues to increase prediction accuracy. The model retains the stability benefits of Hard-prompt methods while increasing the flexibility and adaptability necessary for ABSA in requirements elicitation from app reviews. Experimental results indicate that the proposed method surpasses state-of-the-art methods on the benchmark datasets, and the generalization of the model achieved the highest relative improvements of 72% and 36.6% under low-resource data settings and simulated noisy conditions. These promising findings suggest that LePB-SA4RE has the potential to provide an effective requirements elicitation solution for user-centric software evolution and maintenance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Software Engineering Research · Software Engineering Techniques and Practices · Sentiment Analysis and Opinion Mining

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China

Engineering Research Center of Hubei Province for Clothing Information, Wuhan Textile University, Wuhan 430200, China

Funding

National Natural Science Foundation of China · Opening Foundation of Engineering Research Center of Hubei Province for Clothing Information

References (53)

Show source-provided references
1. Aurum, A., and Wohlin, C. (2005). Requirements Elicitation: A Survey of Techniques, Approaches, and Tools. Engineering and Managing Software Requirements, Springer.10.1007/3-540-28244-0 ↗
2. Panichella, S., Di Sorbo, A., Guzman, E., Visaggio, C.A., Canfora, G., and Gall, H.C. (October, January 29). How can I improve my app? Classifying user reviews for software maintenance and evolution. Proceedings of the 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME), Bremen, Germany.10.1109/ICSM.2015.7332474 ↗
3. A systematic literature review: Opinion mining studies from mobile app store user reviews10.1016/j.jss.2016.11.027 ↗
4. Data-Driven Requirements Elicitation: A Systematic Literature Review10.1007/s42979-020-00416-4 ↗
5. Wan, H., An, Z., Wang, B., and Xiong, T. (2023, January 4–7). Sentiment Analysis for Requirements Elicitation from App Reviews: A Systematic Mapping Study. Proceedings of the 2023 30th Asia-Pacific Software Engineering Conference (APSEC), Melbourne, Australia.10.1109/APSEC60848.2023.00030 ↗
6. A Survey on Aspect-Based Sentiment Classification
7. Peng, J., and Su, B. (2024). Aspect Sentiment Triplet Extraction Based on Deep Relationship Enhancement Networks. Appl. Sci., 14.10.3390/app14052221 ↗
8. Alturaief, N., Aljamaan, H., and Baslyman, M. (2021, January 15–19). AWARE: Aspect-Based Sentiment Analysis Dataset of Apps Reviews for Requirements Elicitation. Proceedings of the 36th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW 2021), Melbourne, Australia.10.1109/ASEW52652.2021.00049 ↗
9. Opinion mining for app reviews: An analysis of textual representation and predictive models10.1007/s10515-021-00301-1 ↗
10. An automated approach to aspect-based sentiment analysis of apps reviews using machine and deep learning10.1007/s10515-023-00397-7 ↗
11. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing10.1145/3560815 ↗
12. The Biases of Pre-Trained Language Models: An Empirical Study on Prompt-Based Sentiment Analysis and Emotion Detection10.1109/TAFFC.2022.3204972 ↗
13. Rogers, A., Boyd-Graber, J., and Okazaki, N. (2023, January 9–14). Hard Sample Aware Prompt-Tuning. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, ON, Canada.
14. Muresan, S., Nakov, P., and Villavicencio, A. (2022, January 22–27). PPT: Pre-trained Prompt Tuning for Few-shot Learning. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland.
15. Wu, H., and Shi, X. (2022, January 22–27). Adversarial Soft Prompt Tuning for Cross-Domain Sentiment Analysis. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland.10.18653/v1/2022.acl-long.174 ↗
16. Wen, Y., Jain, N., Kirchenbauer, J., Goldblum, M., Geiping, J., and Goldstein, T. (2023, January 10–16). Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery. Proceedings of the 37th International Conference on Neural Information Processing Systems, New Orleans, LA, USA.
17. Guzman, E., and Maalej, W. (2014, January 25–29). How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews. Proceedings of the 2014 IEEE 22nd International Requirements Engineering Conference (RE), Karlskrona, Sweden.10.1109/RE.2014.6912257 ↗
18. Sentiment strength detection in short informal text10.1002/asi.21416 ↗
19. Liu, Y., Li, Y., Guo, Y., and Zhang, M. (December, January 28). Stratify Mobile App Reviews: E-LDA Model Based on Hot “Entity” Discovery. Proceedings of the 2016 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), Naples, Italy.10.1109/SITIS.2016.97 ↗
20. Shah, F.A., Sabanin, Y., and Pfahl, D. (2016, January 14). Feature-based evaluation of competing apps. Proceedings of the International Workshop on App Market Analytics, WAMA 2016, Seattle, WA, USA.10.1145/2993259.2993267 ↗
21. Comparing mobile apps by identifying ‘Hot’ features10.1016/j.future.2018.02.008 ↗
22. An adaptable fine-grained sentiment analysis for summarization of multiple short online reviews10.1016/j.datak.2017.03.009 ↗
23. Qian, Z., Shen, B., Mo, W., and Chen, Y. (2016, January 10–14). SatiIndicator: Leveraging User Reviews to Evaluate User Satisfaction of SourceForge Projects. Proceedings of the 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC), Atlanta, GA, USA.10.1109/COMPSAC.2016.183 ↗
24. Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C.D., Ng, A.Y., and Potts, C. (2013, January 18–21). Recursive deep models for semantic compositionality over a sentiment treebank. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA.10.18653/v1/D13-1170 ↗
25. Zhao, L., and Zhao, A. (2019). Sentiment Analysis Based Requirement Evolution Prediction. Future Internet, 11.10.3390/fi11020052 ↗
26. Gunathilaka, S., and De Silva, N. (December, January 30). Aspect-Based Sentiment Analysis on Mobile Application Reviews. Proceedings of the 2022 22nd International Conference on Advances in ICT for Emerging Regions (ICTer), Colombo, Sri Lanka.10.1109/ICTer58063.2022.10024070 ↗
27. A Novel Automated Framework for Fine-Grained Sentiment Analysis of Application Reviews Using Deep Neural Networks10.1007/s10515-024-00444-x ↗
28. The Graph Neural Network Model10.1109/TNN.2008.2005605 ↗
29. Breaking Down Linguistic Complexities: A Structured Approach to Aspect-Based Sentiment Analysis
30. Chen, C., Teng, Z., Wang, Z., and Zhang, Y. (2022, January 22–27). Discrete Opinion Tree Induction for Aspect-Based Sentiment Analysis. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland.10.18653/v1/2022.acl-long.145 ↗
31. Li, R., Chen, H., Feng, F., Ma, Z., Wang, X., and Hovy, E. (2021, January 1–6). Dual Graph Convolutional Networks for Aspect-Based Sentiment Analysis. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Virtual Event.10.18653/v1/2021.acl-long.494 ↗
32. Aspect-Based Sentiment Analysis via Affective Knowledge Enhanced Graph Convolutional Networks10.1016/j.knosys.2021.107643 ↗
33. Li, C., Gao, F., Bu, J., Xu, L., Chen, X., Gu, Y., Shao, Z., Zheng, Q., Zhang, N., and Wang, Y. (2021). SentiPrompt: Sentiment Knowledge Enhanced Prompt-Tuning for Aspect-Based Sentiment Analysis. arXiv.
34. A Prompt Model with Combined Semantic Refinement for Aspect Sentiment Analysis10.1016/j.ipm.2023.103462 ↗
35. Aspect Category Sentiment Analysis Based on Prompt-Based Learning with Attention Mechanism10.1016/j.neucom.2023.126994 ↗
36. Moens, M.-F., Huang, X., Specia, L., and Yih, S.W. (2021, January 7–11). Fast WordPiece Tokenization. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Online and Punta Cana, Dominican Republic.
37. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv.
38. Zhang, T., Wu, F., Katiyar, A., Weinberger, K.Q., and Artzi, Y. (2021). Revisiting Few-Sample BERT Fine-Tuning. arXiv.
39. Webber, B., Cohn, T., He, Y., and Liu, Y. (2020, January 16–20). AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.
40. Lexicon-Based Methods for Sentiment Analysis10.1162/COLI_a_00049 ↗
41. Cambria, E., Liu, Q., Decherchi, S., Xing, F., and Kwok, K. (2022, January 20–25). SenticNet 7: A Commonsense-Based Neurosymbolic AI Framework for Explainable Sentiment Analysis. Proceedings of the Thirteenth Language Resources and Evaluation Conference, Marseille, France.
42. Gel, E., Ntaimo, L., Shier, D., and Greenberg, H.J. (2018). Bayesian Optimization. Recent Advances in Optimization and Modeling of Contemporary Problems, INFORMS.10.1287/educ.2018 ↗
43. Snoek, J., Rippel, O., Swersky, K., Kiros, R., Satish, N., Sundaram, N., Patwary, M., Prabhat, M., and Adams, R. (2015, January 6–11). Scalable Bayesian Optimization Using Deep Neural Networks. Proceedings of the International Conference on Machine Learning, Lille, France.
44. On the Automatic Classification of App Reviews10.1007/s00766-016-0251-9 ↗
45. Dustdar, S., Yu, E., Salinesi, C., Rieu, D., and Pant, V. (2020). Mining User Opinions to Support Requirement Engineering: An Empirical Study. Advanced Information Systems Engineering, Lecture Notes in Computer Science, Springer International Publishing.10.1007/978-3-030-49435-3 ↗
46. Phrase Dependency Relational Graph Attention Network for Aspect-Based Sentiment Analysis10.1016/j.knosys.2021.107736 ↗
47. A Systematic Review of Statistical Power in Software Engineering Experiments10.1016/j.infsof.2005.08.009 ↗
48. Preliminary Guidelines for Empirical Research in Software Engineering10.1109/TSE.2002.1027796 ↗
49. Kitchenham, B.A., Dyba, T., and Jorgensen, M. (2004, January 28). Evidence-Based Software Engineering. Proceedings of the 26th International Conference on Software Engineering, Edinburgh, UK.
50. Data Sanitization Against Label Flipping Attacks Using AdaBoost-Based Semi-Supervised Learning Technology10.1007/s00500-021-06384-y ↗
51. Aït-Ameur, Y., and Crăciun, F. (2022). Repairing Adversarial Texts Through Perturbation. Theoretical Aspects of Software Engineering, Springer International Publishing.10.1007/978-3-031-10363-6 ↗
52. Knowledge distillation: A survey10.1007/s11263-021-01453-z ↗
53. Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., and Wesslén, A. (2012). Experimentation in Software Engineering, Springer Science & Business Media.10.1007/978-3-642-29044-2 ↗