Ten Natural Language Processing Tasks with Generative Artificial Intelligence
Source abstract
Abstract
The review enumerates the predominant applications of large language models (LLMs) in natural language processing (NLP) tasks, with a particular emphasis on the years 2023 to 2025. A particular emphasis is placed on applications pertaining to information retrieval, named entity recognition, text or document classification, text summarization, machine translation, question-and-answer generation, fake news or hate speech detection, and sentiment analysis of text. Furthermore, metrics such as ROUGE, BERT, METEOR, BART, and BLEU scores are presented to evaluate the capabilities of a given language model. The following example illustrates the calculation of scores for the aforementioned metrics, utilizing sentences generated by ChatGPT 3.5, which is free and publicly available.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Automated Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Security and Computer Science, University of the National Education Commission of Krakow, 2 Podchorazych Ave, 30-084 Krakow, Poland
Faculty of Electrical Engineering, Automatics, Computer Science and Biomedical Engineering, AGH University of Krakow, Mickiewicza 30, 30-059 Krakow, Poland
References (100+)
Show source-provided references
1. Generative AI: Here to stay, but for good?10.1016/j.techsoc.2023.102372 ↗
2. Current State and Future Directions for AI Research in the Corporate World
3. Generative AI in education: To embrace it or not?
4. Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators
5. AI in Medical Education: Global situation, effects and challenges10.1007/s10639-023-12009-8 ↗
6. Jošt, G., Taneski, V., and Karakatič, S. (2024). The impact of large language models on programming education and student learning outcomes. Appl. Sci., 14.10.3390/app14104115 ↗
7. Shanmugam, D., Agrawal, M., Movva, R., Chen, I.Y., Ghassemi, M., Jacobs, M., and Pierson, E. (2024). Generative AI in medicine. arXiv.
8. Revolutionizing health care: The transformative impact of large language models in medicine10.2196/59069 ↗
9. An evaluation framework for clinical use of large language models in patient interaction tasks10.1038/s41591-024-03328-5 ↗
10. Evaluating Cardiology Certification Using the ACCSAP Question Bank: Large Language Models vs Physicians10.1016/j.mayocp.2024.07.030 ↗
11. Artificial intelligence/machine learning education in radiology: Multi-institutional survey of radiology residents in the United States10.1016/j.acra.2023.01.005 ↗
12. The diagnostic performance of large language models and general radiologists in thoracic radiology cases: A comparative study10.1097/RTI.0000000000000805 ↗
13. Large language models for simplified interventional radiology reports: A comparative analysis10.1016/j.acra.2024.09.041 ↗
14. Emergency surgery in the era of artificial intelligence: ChatGPT could be the doctor’s right-hand man10.1097/JS9.0000000000000410 ↗
15. Artificial intelligence in surgery: The future is now
16. From Decision to Action in Surgical Autonomy: Multi-Modal Large Language Models for Robot-Assisted Blood Suction10.1109/LRA.2025.3535184 ↗
17. Artificial intelligence in genetics
18. Unveiling the potential of proteomic and genetic signatures for precision therapeutics in lung cancer management10.1016/j.cellsig.2023.110932 ↗
19. Routray, B.B. (2024). The Spectre of Generative AI Over Advertising, Marketing, and Branding. Authorea.10.22541/au.170534566.63147021/v1 ↗
20. Yoo, B., Kim, J., Park, S., Ahn, C.R., and Oh, T. (2024). Harnessing Generative Pre-Trained Transformers for Construction Accident Prediction with Saliency Visualization. Appl. Sci., 14.10.3390/app14020664 ↗
21. Li, C., Zhang, Z., Wu, H., Sun, W., Min, X., Liu, X., Zhai, G., and Lin, W. (2023). AGIQA-3K: An Open Database for AI-Generated Image Quality Assessment. arXiv.10.1109/TCSVT.2023.3319020 ↗
22. Bandi, A., Adapa, P.V.S.R., and Kuchi, Y.E.V.P.K. (2023). The power of generative ai: A review of requirements, models, input–output formats, evaluation metrics, and challenges. Future Internet, 15.10.3390/fi15080260 ↗
23. Ma, Y., Liu, J., and Yi, F. (2023). Is this abstract generated by ai? A research for the gap between ai-generated scientific text and human-written scientific text. arXiv.
24. AI-generated vs human-authored texts: A multidimensional comparison10.1016/j.acorp.2023.100083 ↗
25. Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., and Metzler, D. (2022). Emergent abilities of large language models. arXiv.
26. ChatGPT for good? On opportunities and challenges of large language models for education10.1016/j.lindif.2023.102274 ↗
27. Transformers and large language models for efficient intrusion detection systems: A comprehensive survey10.1016/j.inffus.2025.103347 ↗
28. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
29. Class-based n-gram Models of Natural Language
30. Using large language models (ChatGPT, Copilot, PaLM, Bard, and Gemini) in gross anatomy course: Comparative analysis10.1002/ca.24244 ↗
31. The silence of the LLMs: Cross-lingual analysis of guardrail-related political bias and false information prevalence in ChatGPT, Google Bard (Gemini), and Bing Chat10.1016/j.tele.2024.102211 ↗
32. Lo, C.K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Educ. Sci., 13.10.3390/educsci13040410 ↗
33. Patel, V.V. (2023). Revolutionizing Marketing Efficiency with ChatGpt, GSFC University. Technical Report.
34. Ye, H., Liu, T., Zhang, A., Hua, W., and Jia, W. (2023). Cognitive mirage: A review of hallucinations in large language models. arXiv.
35. Detecting hallucinations in large language models using semantic entropy10.1038/s41586-024-07421-0 ↗
36. Wilcox, E.G., Gauthier, J., Hu, J., Qian, P., and Levy, R. (2022). Learning syntactic structures from string input. Algebraic Structures in Natural Language, CRC Press.10.1201/9781003205388-6 ↗
37. Bai, J., Wang, Y., Chen, Y., Yang, Y., Bai, J., Yu, J., and Tong, Y. (2021). Syntax-BERT: Improving pre-trained transformers with syntax trees. arXiv.10.18653/v1/2021.eacl-main.262 ↗
38. Baroni, M. (2022). On the proper role of linguistically-oriented deep net analysis in linguistic theorizing. Algebraic Structures in Natural Language, CRC Press.10.1201/9781003205388-1 ↗
39. Dasgupta, I., Kaeser-Chen, C., Marino, K., Ahuja, A., Babayan, S., Hill, F., and Fergus, R. (2023). Collaborating with language models for embodied reasoning. arXiv.
40. Zhu, Y., Yuan, H., Wang, S., Liu, J., Liu, W., Deng, C., Dou, Z., and Wen, J.R. (2023). Large language models for information retrieval: A survey. arXiv.
41. Salton, G. (1983). Modern Information Retrieval, ACM Press.
42. A vector space model for automatic indexing10.1145/361219.361220 ↗
43. Mitra, B., and Craswell, N. (2017). Neural models for information retrieval. arXiv.10.1145/3018661.3022755 ↗
44. Zhao, W.X., Liu, J., Ren, R., and Wen, J.R. (2022). Dense text retrieval based on pretrained language models: A survey. arXiv.
45. Jiang, S., Chen, Z., Liang, J., Zhao, Y., Liu, M., and Qin, B. (2024, January 12–16). Infrared-LLaVA: Enhancing Understanding of Infrared Images in Multi-Modal Large Language Models. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, Miami, FL, USA.10.18653/v1/2024.findings-emnlp.501 ↗
46. Gao, L., Ma, X., Lin, J., and Callan, J. (2022). Precise zero-shot dense retrieval without relevance labels. arXiv.10.18653/v1/2023.acl-long.99 ↗
47. Srinivasan, K., Raman, K., Samanta, A., Liao, L., Bertelli, L., and Bendersky, M. (2022). QUILL: Query intent with large language models using retrieval augmentation and multi-stage distillation. arXiv.10.18653/v1/2022.emnlp-industry.50 ↗
48. Shen, T., Long, G., Geng, X., Tao, C., Zhou, T., and Jiang, D. (2023). Large Language Models are Strong Zero-Shot Retriever. arXiv.10.18653/v1/2024.findings-acl.943 ↗
49. Wang, L., Yang, N., and Wei, F. (2023). Query2doc: Query Expansion with Large Language Models. arXiv.10.18653/v1/2023.emnlp-main.585 ↗
50. Jagerman, R., Zhuang, H., Qin, Z., Wang, X., and Bendersky, M. (2023). Query Expansion by Prompting Large Language Models. arXiv.
51. Zhang, Z., Zhang, A., Li, M., Zhao, H., Karypis, G., and Smola, A. (2023). Multimodal chain-of-thought reasoning in language models. arXiv.
52. Exploring Biases Related to the Use of Large Language Models in a Multilingual Depression Corpus
53. Mackie, I., Sekulic, I., Chatterjee, S., Dalton, J., and Crestani, F. (2023). GRM: Generative Relevance Modeling Using Relevance-Aware Sample Estimation for Document Retrieval. arXiv.
54. Keraghel, I., Morbieu, S., and Nadif, M. (2024). A survey on recent advances in named entity recognition. arXiv.
55. Evolution and emerging trends of named entity recognition: Bibliometric analysis from 2000 to 202310.1016/j.heliyon.2024.e30053 ↗
56. Sharma, R., Katyayan, P., and Joshi, N. (2023, January 3–4). Improving the Quality of Neural Machine Translation Through Proper Translation of Name Entities. Proceedings of the 2023 6th International Conference on Information Systems and Computer Networks (ISCON), Mathura, India.10.1109/ISCON57294.2023.10111938 ↗
57. A Research Toward Chinese Named Entity Recognition Based on Transfer Learning10.1007/s44196-023-00244-3 ↗
58. FE-CFNER: Feature Enhancement-based approach for Chinese Few-shot Named Entity Recognition10.1016/j.csl.2024.101730 ↗
59. Abe, K. (2023). Application-Oriented Machine Translation: Design and Evaluation. [Ph.D. Thesis, Tohoku University].
60. TMD-NER: Turkish multi-domain named entity recognition for informal texts10.1007/s11760-023-02898-0 ↗
61. González-Gallardo, C.E., Tran, H.T.H., Hamdi, A., and Doucet, A. (2024, January 24–27). Leveraging open large language models for historical named entity recognition. Proceedings of the International Conference on Theory and Practice of Digital Libraries, Ljubljana, Slovenia.10.1007/978-3-031-72437-4_22 ↗
62. German Medical Named Entity Recognition Model and Data Set Creation Using Machine Translation and Word Alignment: Algorithm Development and Validation10.2196/39077 ↗
63. Rau, L.F. (1991, January 24–28). Extracting company names from text. Proceedings of the Seventh IEEE Conference on Artificial Intelligence Application, Miami Beach, FL, USA.
64. A survey of named entity recognition and classification10.1075/li.30.1.03nad ↗
65. Collobert, R. (2011). Deep learning for efficient discriminative parsing. JMLR Workshop and Conference Proceedings, Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA, 11–13 April 2011, JMLR.
66. GPT, large language models (LLMs) and generative artificial intelligence (GAI) models in geospatial science: A systematic review10.1080/17538947.2024.2353122 ↗
67. Zhang, Y., Wang, M., Li, Q., Tiwari, P., and Qin, J. (May, January 28). Pushing the limit of LLM capacity for text classification. Proceedings of the Companion Proceedings of the ACM on Web Conference 2025, Sydney, Australia.10.1145/3701716.3715528 ↗
68. A survey of text classification with transformers: How wide? How large? How long? How accurate? How expensive? How safe?10.1109/ACCESS.2024.3349952 ↗
69. Palanivinayagam, A., El-Bayeh, C.Z., and Damaševičius, R. (2023). Twenty Years of Machine-Learning-Based Text Classification: A Systematic Review. Algorithms, 16.10.3390/a16050236 ↗
70. Kowsari, K., Jafari Meimandi, K., Heidarysafa, M., Mendu, S., Barnes, L., and Brown, D. (2019). Text classification algorithms: A survey. Information, 10.10.3390/info10040150 ↗
71. Gasparetto, A., Marcuzzo, M., Zangari, A., and Albarelli, A. (2022). A survey on text classification algorithms: From text to predictions. Information, 13.10.3390/info13020083 ↗
72. Das, M., and Alphonse, P. (2023). A comparative study on tf-idf feature weighting method and its analysis using unstructured dataset. arXiv.
73. Lai, J., Yang, X., Luo, W., Zhou, L., Li, L., Wang, Y., and Shi, X. (2024). Rumorllm: A rumor large language model-based fake-news-detection data-augmentation approach. Appl. Sci., 14.10.3390/app14083532 ↗
74. Comparative Analysis of Traditional and Modern NLP Techniques on the CoLA Dataset: From POS Tagging to Large Language Models10.1109/OJCS.2025.3526712 ↗
75. Juraev, G., and Bozorov, O. (2023). Using TF-IDF in text classification. Proceedings of the AIP Conference Proceedings, AIP Publishing.10.1063/5.0145520 ↗
76. A Large Language Model-based Approach for Personalized Search Results Re-ranking in Professional Domains10.60087/ijls.v1.n2.001 ↗
77. A supervised deep learning-based sentiment analysis by the implementation of Word2Vec and GloVe Embedding techniques10.1007/s11042-024-19045-7 ↗
78. Malware classification with word2vec, hmm2vec, bert, and elmo
79. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv.
80. Pennington, J., Socher, R., and Manning, C.D. (2014, January 25–29). Glove: Global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1162 ↗
81. Logistic Regression Matching Pursuit algorithm for text classification10.1016/j.knosys.2023.110761 ↗
82. Almazaydeh, L., Abuhelaleh, M., Al Tawil, A., and Elleithy, K. (2023). Clinical Text Classification with Word Representation Features and Machine Learning Algorithms. Int. J. Online Biomed. Eng., 19.10.3991/ijoe.v19i04.36099 ↗
83. A novel filter feature selection method for text classification: Extensive Feature Selector10.1177/0165551521991037 ↗
84. Creating deep neural networks for text classification tasks using grammar genetic programming10.1016/j.asoc.2023.110009 ↗
85. Impact of convolutional neural network and FastText embedding on text classification10.1007/s11042-022-13459-x ↗
86. Improved recurrent neural networks for text classification and dynamic Sylvester equation solving10.1007/s11063-023-11176-6 ↗
87. Training language models to follow instructions with human feedback
88. Thoppilan, R., De Freitas, D., Hall, J., Shazeer, N., Kulshreshtha, A., Cheng, H.T., Jin, A., Bos, T., Baker, L., and Du, Y. (2022). Lamda: Language models for dialog applications. arXiv.
89. Doveh, S., Perek, S., Mirza, M.J., Lin, W., Alfassy, A., Arbelle, A., Ullman, S., and Karlinsky, L. (2025, January 17–18). Towards Multimodal In-context Learning for Vision and Language Models. Proceedings of the European Conference on Computer Vision, Dublin, Ireland.10.1007/978-3-031-93806-1_19 ↗
90. Cheng, C., Yu, X., Wen, H., Sun, J., Yue, G., Zhang, Y., and Wei, Z. (2025, January 6–11). Exploring the robustness of in-context learning with noisy labels. Proceedings of the ICASSP 2025—2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Hyderabad, India.10.1109/ICASSP49660.2025.10889281 ↗
91. Moslem, Y., Haque, R., Kelleher, J.D., and Way, A. (2023). Adaptive machine translation with large language models. arXiv.
92. A review of text style transfer using deep learning
93. Large language models: Their success and impact10.3390/forecast5030030 ↗
94. Improving Machine Translation Formality with Large Language Models
95. Lu, Q., Qiu, B., Ding, L., Xie, L., and Tao, D. (2023). Error analysis prompting enables human-like translation evaluation in large language models: A case study on chatgpt. arXiv.10.20944/preprints202303.0255.v1 ↗
96. Salute the classic: Revisiting challenges of machine translation in the age of large language models10.1162/tacl_a_00730 ↗
97. Vilar, D., Freitag, M., Cherry, C., Luo, J., Ratnakar, V., and Foster, G. (2023). Prompting PaLM for Translation: Assessing Strategies and Performance. arXiv.10.18653/v1/2023.acl-long.859 ↗
98. Zhu, W., Liu, H., Dong, Q., Xu, J., Huang, S., Kong, L., Chen, J., and Li, L. (2023). Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis. arXiv.10.18653/v1/2024.findings-naacl.176 ↗
99. Żelasko, P., Chen, Z., Wang, M., Galvez, D., Hrinchuk, O., Ding, S., Hu, K., Balam, J., Lavrukhin, V., and Ginsburg, B. (2025, January 6–11). Emmett: Efficient multimodal machine translation training. Proceedings of the ICASSP 2025—2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Hyderabad, India.10.1109/ICASSP49660.2025.10890312 ↗
100. Miah, M.S.U., Kabir, M.M., Sarwar, T.B., Safran, M., Alfarhood, S., and Mridha, M. (2024). A multimodal approach to cross-lingual sentiment analysis with ensemble of transformer and LLM. Sci. Rep., 14.10.1038/s41598-024-60210-7 ↗