journal article·2025-08-12Open access

A Survey of Multi-Label Text Classification Under Few-Shot Scenarios

Wenlong Hu, Qiang Fan, Hao Yan, Xinyao Xu, Shan Huang, Ke Zhang

Applied Sciences· Volume 15· Issue 16

Abstract

Multi-label text classification is a fundamental and important task in natural language processing, with widespread applications in specialized domains such as sentiment analysis, legal document classification, and medical coding. However, real-world applications often face challenges such as high annotation costs, data scarcity, and long-tailed label distributions. These issues are particularly pronounced in professional fields like healthcare and law, significantly limiting the performance of classification models. This paper focuses on the topic of few-shot multi-label text classification and provides a systematic survey of current research progress and mainstream techniques. From multiple perspectives, including modeling under few-shot settings, research status, technical approaches, commonly used datasets, and evaluation metrics, this study comprehensively reviews the existing literature and advances. At the technical level, the methods are broadly categorized into data augmentation and model training. The latter includes paradigms such as transfer learning, prompt learning, metric learning, meta-learning, graph neural networks, and attention mechanisms. In addition, this survey explores the research and progress of specific tasks under few-shot multi-label scenarios, such as multi-label aspect category detection, multi-label intent detection, and hierarchical multi-label text classification. In terms of experimental resources, this review compiles commonly used datasets along with their characteristics and categorizes evaluation metrics that are widely adopted in few-shot multi-label classification settings. Finally, it discusses the key research challenges and outlines future directions, offering insights to guide further investigation in this field.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Text and Document Classification Technologies · Sentiment Analysis and Opinion Mining · Topic Modeling

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electronics and Information Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China

The Sixty-Third Research Institute, National University of Defense Technology, Nanjing 210007, China

Laboratory for Big Data and Decision, National University of Defense Technology, Changsha 410073, China

Funding

Research Program of the National University of Defense Technology · National Natural Science Foundation of China

References (94)

Show source-provided references
1. A comprehensive survey of few-shot learning: Evolution, applications, challenges, and opportunities10.1145/3582688 ↗
2. Generalizing from a few examples: A survey on few-shot learning
3. Meta-learning in neural networks: A survey
4. Gao, T., Fisch, A., and Chen, D. (2020). Making pre-trained language models better few-shot learners. arXiv.10.18653/v1/2021.acl-long.295 ↗
5. Finn, C., Abbeel, P., and Levine, S. (2017, January 6–11). Model-agnostic meta-learning for fast adaptation of deep networks. Proceedings of the International Conference on Machine Learning, Sydney, NSW, Australia.
6. Falis, M., Dong, H., Birch, A., and Alex, B. (2022, January 26). Horses to zebras: Ontology-guided data augmentation and synthesis for ICD-9 coding. Proceedings of the 21st Workshop on Biomedical Language Processing, Dublin, Ireland.10.18653/v1/2022.bionlp-1.39 ↗
7. Zhou, Y., Qin, Y., Huang, R., Chen, Y., Lin, C., and Zhou, Y. (2024). Self-training improves few-shot learning in legal artificial intelligence tasks. Artificial Intelligence and Law, Springer Nature.10.1007/s10506-024-09403-z ↗
8. Zhang, D., Li, T., Zhang, H., and Yin, B. (2020). On data augmentation for extreme multi-label classification. arXiv.
9. Xu, P., Xiao, L., Liu, B., Lu, S., Jing, L., and Yu, J. (2023, January 7–14). Label-specific feature augmentation for long-tailed multi-label text classification. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.10.1609/aaai.v37i9.26259 ↗
10. Xu, P., Song, M., Li, Z., Lu, S., Jing, L., and Yu, J. (2024, January 14–19). Taming Prompt-Based Data Augmentation for Long-Tailed Extreme Multi-Label Text Classification. Proceedings of the ICASSP 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Republic of Korea.10.1109/ICASSP48485.2024.10446315 ↗
11. Zhao, Z., Alzubaidi, L., Zhang, J., Duan, Y., and Gu, Y. (2024). A comparison review of transfer learning and self-supervised learning: Definitions, applications, advantages and limitations. Expert Syst. Appl., 242.10.1016/j.eswa.2023.122807 ↗
12. Neural transfer learning for assigning diagnosis codes to EMRs10.1016/j.artmed.2019.04.002 ↗
13. Li, K., and Jing, L. (2022, January 19–21). Long-tailed Multi-label Text Classification via Label Co-occurrence-Aware Knowledge Transfer. Proceedings of the 2022 European Conference on Natural Language Processing and Information Retrieval (ECNLPIR), Hangzhou, China.10.1109/ECNLPIR57021.2022.00024 ↗
14. Wang, H., Xu, C., and Mcauley, J. (2022). Automatic multi-label prompting: Simple and interpretable few-shot classification. arXiv.10.18653/v1/2022.naacl-main.401 ↗
15. A Reproduction of Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification
16. Wei, L., Li, Y., Zhu, Y., Li, B., and Zhang, L. (2022). Prompt tuning for multi-label text classification: How to link exercises to knowledge concepts?. Appl. Sci., 12.10.3390/app122010363 ↗
17. Hu, S., Ding, N., Wang, H., Liu, Z., Wang, J., Li, J., Wu, W., and Sun, M. (2021). Knowledgeable prompt-tuning: Incorporating knowledge into prompt verbalizer for text classification. arXiv.10.18653/v1/2022.acl-long.158 ↗
18. Yang, Z., Wang, S., Rawat, B.P.S., Mitra, A., and Yu, H. (2023, January 25). Knowledge injected prompt based fine-tuning for multi-label few-shot icd coding. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Suzhou, China.10.18653/v1/2022.findings-emnlp.127 ↗
19. Yang, Z., Kwon, S., Yao, Z., and Yu, H. (2023, January 7–14). Multi-label few-shot icd coding as autoregressive generation with prompt. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.10.1609/aaai.v37i4.25668 ↗
20. Zhou, X., Yang, L., Wang, X., Zhan, H., and Sun, R. (2024). Two stages prompting for few-shot multi-intent detection. Neurocomputing, 579.10.1016/j.neucom.2024.127424 ↗
21. Zhuang, N., Wei, X., Li, J., Wang, X., Wang, C., Wang, L., and Dang, J. (2025, January 6–11). A prompt learning framework with large language model augmentation for few-shot multi-label intent detection. Proceedings of the ICASSP 2025–2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Hyderabad, India.10.1109/ICASSP49660.2025.10888364 ↗
22. Zhou, C., Huang, B., and Ling, Y. (2025). A Chinese few-shot named-entity recognition model based on multi-label prompts and boundary information. Appl. Sci., 15.10.3390/app15115801 ↗
23. Yang, W., Li, J., Fukumoto, F., and Ye, Y. (2020, January 16–20). HSCNN: A hybrid-siamese convolutional neural network for extremely imbalanced multi-label text classification. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.10.18653/v1/2020.emnlp-main.545 ↗
24. Csányi, G.M., Vági, R., Megyeri, A., Fülöp, A., Nagy, D., Vadász, J.P., and Uveges, I. (2023). Can triplet loss be used for multi-label few-shot classification? A Case study. Information, 14.10.3390/info14100520 ↗
25. Few-shot relation classification by context attention-based prototypical networks with BERT10.1186/s13638-020-01720-6 ↗
26. Wang, X., Du, Y., Chen, D., Li, X., Chen, X., Lee, Y.L., and Liu, J. (2023). Constructing better prototype generators with 3D CNNs for few-shot text classification. Expert Syst. Appl., 225.10.1016/j.eswa.2023.120124 ↗
27. A multi-label few-shot instance-level attention prototypical network classification method
28. Triple alliance prototype orthotist network for long-tailed multi-label text classification10.1109/TASLP.2023.3265860 ↗
29. Kong, F., Zhang, R., Guo, X., Chen, J., and Wang, Z. (May, January 28). Preserving label correlation for multi-label text classification by prototypical regularizations. Proceedings of the ACM on Web Conference 2025, Sydney, NSW, Australia.10.1145/3696410.3714797 ↗
30. Rios, A., and Kavuluru, R. (2018, January 23). EMR coding with semi-parametric multi-head matching networks. Proceedings of the conference Association for Computational Linguistics North American Chapter Meeting, New Orleans, LA, USA.10.18653/v1/N18-1189 ↗
31. Yuan, Z., Tan, C., and Huang, S. (2022). Code synonyms do matter: Multiple synonyms matching network for automatic ICD coding. arXiv.10.18653/v1/2022.acl-short.91 ↗
32. Thrun, S., and Pratt, L. (1998). Learning to learn: Introduction and overview. Learning to Learn, Springer.10.1007/978-1-4615-5529-2 ↗
33. Jiang, X., Havaei, M., Chartrand, G., Chouaib, H., Vincent, T., Jesson, A., Chapados, N., and Matwin, S. (2018, January 28). Attentive task-agnostic meta-learning for few-shot text classification. Proceedings of the ICLR 2019 Conference Blind Submission, New Orleans, LA, USA.
34. Wang, R., Su, X.A., Long, S., Dai, X., Huang, S., and Chen, J. (2021, January 7–11). Meta-LMTC: Meta-learning for large-scale multi-label text classification. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.10.18653/v1/2021.emnlp-main.679 ↗
35. Xiao, L., Zhang, X., Jing, L., Huang, C., and Song, M. (2021, January 2–9). Does head label help for long-tailed multi-label text classification. Proceedings of the AAAI Conference on Artificial Intelligence, Online.10.1609/aaai.v35i16.17660 ↗
36. MetaRisk: Semi-supervised few-shot operational risk classification in banking industry10.1016/j.ins.2020.11.027 ↗
37. Few-shot ICD coding with knowledge transfer and evidence representation10.1016/j.eswa.2023.121861 ↗
38. Wang, X., Ye, Y., and Gupta, A. (2018, January 18–23). Zero-shot recognition via semantic embeddings and knowledge graphs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00717 ↗
39. Rios, A., and Kavuluru, R. (November, January 31). Few-shot and zero-shot multi-label learning for structured label spaces. Proceedings of the Conference on Empirical Methods in Natural Language Processing Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.
40. Ge, X., Williams, R.D., Stankovic, J.A., and Alemzadeh, H. (2023). Dkec: Domain knowledge enhanced multi-label classification for electronic health records. arXiv.10.18653/v1/2024.emnlp-main.712 ↗
41. Lu, J., Du, L., Liu, M., and Dipnall, J. (2020). Multi-label few/zero-shot learning with knowledge aggregated from multiple label graphs. arXiv.10.18653/v1/2020.emnlp-main.235 ↗
42. Chen, L., Yan, X., Wang, Z., and Huang, H. (2023, January 18–23). Neural architecture search with heterogeneous representation learning for zero-shot multi-label text classification. Proceedings of the 2023 International Joint Conference on Neural Networks (IJCNN), Gold Coast, QLD, Australia.10.1109/IJCNN54540.2023.10191902 ↗
43. Chalkidis, I., Fergadiotis, M., Kotitsas, S., Malakasiotis, P., Aletras, N., and Androutsopoulos, I. (2020). An empirical study on large-scale multi-label text classification including few and zero-shot labels. arXiv.10.18653/v1/2020.emnlp-main.607 ↗
44. Wang, S., Ren, P., Chen, Z., Ren, Z., Liang, H., Yan, Q., Kanoulas, E., and de Rijke, M. (2021). Few-shot electronic health record coding through graph contrastive learning. arXiv.
45. Chen, J., Li, X., Xi, J., Yu, L., and Xiong, H. (2023, January 14). Rare codes count: Mining inter-code relations for long-tail clinical text classification. Proceedings of the 5th Clinical Natural Language Processing Workshop, Toronto, ON, Canada.10.18653/v1/2023.clinicalnlp-1.43 ↗
46. Rajaonarivo, L., Mine, T., and Arakawa, Y. (2023, January 26–29). Few-shot and LightGCN learning for multi-label estimation of lesser-known tourist sites using tweets. Proceedings of the 2023 IEEE/WIC International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), Venice, Italy.10.1109/WI-IAT59888.2023.00020 ↗
47. A model of saliency-based visual attention for rapid scene analysis10.1109/34.730558 ↗
48. Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv.
49. A review on the attention mechanism of deep learning10.1016/j.neucom.2021.03.091 ↗
50. Vu, T., Nguyen, D.Q., and Nguyen, A. (2020). A label attention model for ICD coding from clinical text. arXiv.10.24963/ijcai.2020/461 ↗
51. A soft prompt learning method for medical text classification with simulated human cognitive capabilities10.1007/s10462-025-11121-0 ↗
52. Yogarajan, V., Pfahringer, B., Smith, T., and Montiel, J. (2021). Improving predictions of tail-end labels using concatenated biomed-transformers for long medical documents. arXiv.
53. Rethmeier, N., and Augenstein, I. (2021, January 4). Self-supervised contrastive zero to few-shot learning from small, long-tailed text data. Proceedings of the ICLR 2021 Conference Blind Submission, Vienna, Austria.
54. A dual-branch learning model with gradient-balanced loss for long-tailed multi-label text classification10.1145/3597416 ↗
55. Xu, H., Vucetic, S., and Yin, W. (2024, January 7). X-SHOT: A Single System to Handle Frequent, Few-shot and Zero-shot Labels in Classification. Proceedings of the Twelfth International Conference on Learning Representations (ICLR 2024), Vienna, Austria.10.18653/v1/2024.findings-acl.276 ↗
56. Schopf, T., Blatzheim, A., Machner, N., and Matthes, F. (2024). Efficient few-shot learning for multi-label classification of scientific documents with many classes. arXiv.
57. Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., Manandhar, S., AL-Smadi, M., Al-Ayyoub, M., Zhao, Y., Qin, B., and Clercq, O.D. (2016). Semeval-2016 task 5: Aspect based sentiment analysis. Int. Workshop Semant. Eval., 19–30.10.18653/v1/S16-1002 ↗
58. Hu, M., Zhao, S., Guo, H., Xue, C., Gao, H., Gao, T., Cheng, R., and Su, Z. (2021). Multi-label few-shot learning for aspect category detection. arXiv.10.18653/v1/2021.acl-long.495 ↗
59. Liu, H., Zhang, F., Zhang, X., Zhao, S., Sun, J., Yu, H., and Zhang, X. (2022, January 14–18). Label-enhanced prototypical network with contrastive learning for multi-label few-shot aspect category detection. Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.10.1145/3534678.3539340 ↗
60. Zhao, F., Shen, Y., Wu, Z., and Dai, X. (2022). Label-driven denoising framework for multi-label few-shot aspect category detection. arXiv.10.18653/v1/2022.findings-emnlp.177 ↗
61. Wang, Z., and Iwaihara, M. (2023). Few-shot multi-label aspect category detection utilizing prototypical network with sentence-level weighting and label augmentation. Database and Expert Systems Applicationsthe, International Conference on Database and Expert Systems Applications, Penang, Malaysia, 28–30 August 2023, Springer.10.1007/978-3-031-39821-6_30 ↗
62. Zhao, S., Chen, W., and Wang, T. (2023, January 19–25). Learning few-shot sample-set operations for noisy multi-label aspect category detection. Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, Macao, China.10.24963/ijcai.2023/589 ↗
63. Peng, C., Chen, K., Shou, L., and Chen, G. (2024, January 20–27). Variational hybrid-attention framework for multi-label few-shot aspect category detection. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.10.1609/aaai.v38i13.29375 ↗
64. Few-shot multi-label aspect category detection based on prompt-enhanced prototypical networks
65. Guan, C., Zhu, Y., Bai, Y., and Wang, L. (2024). Label-guided prompt for multi-label few-shot aspect category detection. arXiv.
66. Zhao, S., Chen, W., Wang, T., Yao, J., Lu, D., and Zheng, J. (2025, January 6–11). Less is Enough: Relation graph guided few-shot learning for multi-label aspect category detection. Proceedings of the ICASSP 2025—2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Hyderabad, India.10.1109/ICASSP49660.2025.10889951 ↗
67. Pomdp-based statistical spoken dialog systems: A review10.1109/JPROC.2012.2225812 ↗
68. Qin, L., Xu, X., Che, W., and Liu, T. (2020). TD-GIN: Token-level dynamic graph-interactive network for joint multiple intent detection and slot filling. arXiv.10.18653/v1/2020.findings-emnlp.163 ↗
69. Xu, P., and Sarikaya, R. (2013). Exploiting shared information for multi-intent natural language sentence classification. Interspeech, 3785–3789.10.21437/Interspeech.2013-599 ↗
70. Hou, Y., Lai, Y., Wu, Y., Che, W., and Liu, T. (2021, January 2–9). Few-shot learning for multi-label intent detection. Proceedings of the AAAI Conference on Artificial Intelligence, Online.10.1609/aaai.v35i14.17541 ↗
71. Strengthened multiple correlation for multi-label few-shot intent detection10.1016/j.neucom.2022.12.047 ↗
72. Zhang, F., Chen, W., Ding, F., and Wang, T. (2023, January 9–14). Dual class knowledge propagation network for multi-label few-shot intent detection. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, ON, Canada.10.18653/v1/2023.acl-long.480 ↗
73. Zhang, X., Li, X., Liu, H., Liu, X., and Zhang, X. (2024, January 14–18). Label hierarchical structure-aware multi-label few-shot intent detection via prompt tuning. Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, Washington, DC, USA.10.1145/3626772.3657947 ↗
74. A coarse-to-fine prototype learning approach for multi-label few-shot intent detection
75. Sun, A., and Lim, E.-P. (December, January 29). Hierarchical text classification and evaluation. Proceedings of the 2001 IEEE International Conference on Data Mining, San Jose, CA, USA.
76. Chen, H., Ma, Q., Lin, Z., and Yan, J. (2021, January 1–6). Hierarchy-aware label semantics matching network for hierarchical text classification. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Bangkok, Thailand.10.18653/v1/2021.acl-long.337 ↗
77. Ji, K., Lian, Y., Gao, J., and Wang, B. (2023). Hierarchical verbalizer for few-shot hierarchical text classification. arXiv.10.18653/v1/2023.acl-long.164 ↗
78. Ji, K., Wang, P., Ke, W., Li, G., Liu, J., Gao, J., and Shang, Z. (2024). Domain-hierarchy adaptation via chain of iterative reasoning for few-shot hierarchical text classification. arXiv.10.24963/ijcai.2024/698 ↗
79. Hierarchy-aware biased bound margin loss function for hierarchical text classification
80. Retrieval-style in-context learning for few-shot hierarchical text classification10.1162/tacl_a_00697 ↗
81. Hierarchical multilabel classification for fine-level event extraction from aviation accident reports10.1287/ijds.2022.0032 ↗
82. Mcauley, J., and Leskovec, J. (2013, January 12–16). Hidden factors and hidden topics: Understanding rating dimensions with review text. Proceedings of the 7th ACM Conference on Recommender Systems, Hong Kong, China.10.1145/2507157.2507163 ↗
83. MIMIC-III, a freely accessible critical care database10.1038/sdata.2016.35 ↗
84. Lee, J., Scott, D.J., Villarroel, M., Clifford, G.D., Saeed, M., and Mark, R.G. (2011–3, January 30). Open-access MIMIC-II database for intensive care research. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA.
85. Yang, P., Sun, X., Li, W., Ma, S., Wu, W., and Wang, H. (2018). SGM: Sequence generation model for multi-label classification. arXiv.
86. Rcv1: A new benchmark collection for text categorization research
87. Loza Mencía, E., and Fürnkranz, J. (2024, January 8–12). Efficient pairwise multilabel classification for large-scale problems in the legal domain. Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Vilnius, Lithuania.
88. Zubiaga, A. (2012). Enhancing navigation on wikipedia with social tags. arXiv.
89. Dbpedia–a large-scale, multilingual knowledge base extracted from wikipedia
90. Williams, J.D., Raux, A., Ramachandran, D., and Black, A. (2012). Dialog State Tracking Challenge Handbook, Microsoft Research.
91. Eric, M., and Manning, C.D. (2017). Key-value retrieval networks for task-oriented dialogue. arXiv.10.18653/v1/W17-5506 ↗
92. Chalkidis, I., Fergadiotis, M., Malakasiotis, P., and Androutsopoulos, I. (2019). Large-scale multi-label text classification on EU legislation. arXiv.10.18653/v1/P19-1636 ↗
93. Bauman, K., Liu, B., and Tuzhilin, A. (2017, January 13–17). Aspect based recommendations: Recommending items with the most valuable aspects based on user reviews. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098170 ↗
94. Kowsari, K., Brown, D.E., Heidarysafa, M., Meimandi, K.J., Gerber, M.S., and Barnes, L.E. (2017, January 18–21). Hdltex: Hierarchical deep learning for text classification. Proceedings of the 16th IEEE International Conference on Machine Learning and Applications (ICMLA), Cancun, Mexico.10.1109/ICMLA.2017.0-134 ↗