journal article·2025-06-16Open access

Section Recommendation of Online Medical Platform Based on Keyword Expansion with Self-Adaptive-Attention-Prompt-BERT-RCNN Modeling

Tianbao Xie, Yuqi Han, Ganglong Duan, Siyu Yang, Shaoyang Zhang, Yongcheng Shao

Applied Sciences· Volume 15· Issue 12

Abstract

Background: Implementing automatic classification of short texts in online healthcare platforms is crucial to increase the efficiency of their services and improve the user experience. A short text classification method combining the keyword expansion technique and a deep learning model is constructed to solve the problems of feature sparsity and semantic ambiguity in short text classification. Methods: First, we use web crawlers to obtain patient data from the online medical platform “Good Doctor”; then, we use TF-IWF to weight the keyword importance and Word2vec to calculate the keyword similarity to expand the short text features; and then we integrate the cue learning and deep learning models to construct a self-adaptive attention model to solve the problem of sparse features and unclear semantics in short text classification in the adaptive-attention-Prompt-BERT-RCNN model to realize effective classification of medical short texts. Results: Empirical studies show that the classification effect after keyword expansion is significantly higher than that before expansion, the accuracy of the model in classifying medical short texts after expansion is as high as 97.84%, and the model performs well in different categories of medical short texts. Conclusions: The short text expansion methods of TF-IWF and Word2vec make up for the shortcomings of not taking into account the keyword rarity and the contextual information of the subwords, and the model can achieve effective classification of medical short texts by combining them. The model further improves the classification accuracy of short text by integrating Prompt’s bootstrapping, self-adaptive attention’s keyword weight weighting, BERT’s deep semantic understanding, and RCNN’s region awareness and feature extraction; however, the model’s accuracy in individual topics still needs to be improved. The results show that the recommender system can effectively improve the efficiency of patient consultation and support the development of online healthcare.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Text Analysis Techniques · Text and Document Classification Technologies · Sentiment Analysis and Opinion Mining

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Economics and Management Xi’an University of Technology, Xi’an 710048, China

Funding

School-Enterprise Collaborative Innovation Fund for graduate students of Xi’an University of Technology

References (24)

Show source-provided references
1. (2022). Circular on the issuance of the “14th Five-Year Plan” for national health informatization. Bulletin of the National Health Commission of the People′s Republic of China, NHC.
2. Analysis of Essentials in Network Health Information Ecology System
3. Automatic Q&A in Chinese medical Q&A community by fusing knowledge graph
4. Hu, F. (2024). Code of Ethics for Educational Virtual Communities for Learning Assistants, Beijing Science Press.
5. Zhang, Q., Wang, H., and Wang, L. (2016). A short text categorization method integrating word vector and LDA. Mod. Book Inf. Technol., 27–35.
6. Sentiment word co-occurrence and knowledge pair feature extraction based LDA short text clustering algorithm
7. A study on health question classification based on keyword word vector feature extension
8. He, D.P., He, Z.L., and Liu, C. (2020, January 1–3). Recommendation Algorithm Combining Tag Data and Naive Bayes Classification. Proceedings of the 2020 3rd International Conference on Electron Device and Mechanical Engineering (ICEDME), Suzhou, China.10.1109/ICEDME50972.2020.00156 ↗
9. Chinese Text Classification System on Regulatory Information Based on SVM10.1088/1755-1315/252/2/022133 ↗
10. The Lao Text Classification Method Based on KNN10.1016/j.procs.2020.02.053 ↗
11. Liu, W., Cao, Z., Wang, J., and Wang, X. (2016, January 14–17). Short text classification based on Wikipedia and Word2vec. Proceedings of the 2016 2nd IEEE International Conference on Computer and Communications (ICCC), Chengdu, China.
12. Short Text Classification Based on Synonym Dictionary Expansion
13. Sun, F., and Chen, H. (June, January 31). Feature extension for Chinese short text classification based on LDA and Word2vec. Proceedings of the 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA), Wuhan, China.10.1109/ICIEA.2018.8397890 ↗
14. Research on Semantic Enhancement for Short Text Classification
15. Cheng, J., Zhu, Y., and Liu, X. (2023). Innovation and Development of Library Service System in the Era of Big Data, China Social Science Press.
16. Research on short text categorization method based on category feature extension
17. Transformer’s Role in Brain MRI: A Scoping Review
18. Combining context-relevant features with multi-stage attention network for short text classification10.1016/j.csl.2021.101268 ↗
19. Shen, Y., Zhang, Q., Zhang, J., Huang, J., Lu, Y., and Lei, K. (2019). Improving medical short text classification with semantic expansion using word-cluster embedding. Information Science and Applications 2018: ICISA 2018, Springer.10.1007/978-981-13-1056-0_41 ↗
20. Timo, S., and Hinrich, S. (2021). Exploiting cloze questions for few shot text classification and natural language inference. arXiv.
21. Brian, L., Rami, A.-R., and Noah, C. (2021). The power of scale for parameter-efficient prompt tuning. arXiv.
22. GPT understands, too10.1016/j.aiopen.2023.08.012 ↗
23. Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing
24. Ju, Z. (2024). Research on Small Sample Text Categorization Method Based on Cue Learning. [Master’s Thesis, Qilu University of Technology].