Natural Language Processing Adoption in Governments and Future Research Directions: A Systematic Review
Source abstract
Abstract
Natural language processing (NLP), which is known as an emerging technology creating considerable value in multiple areas, has recently shown its great potential in government operations and public administration applications. However, while the number of publications on NLP is increasing steadily, there is no comprehensive review for a holistic understanding of how NLP is being adopted by governments. In this regard, we present a systematic literature review on NLP applications in governments by following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) protocol. The review shows that the current literature comprises three levels of contribution: automation, extension, and transformation. The most-used NLP techniques reported in government-related research are sentiment analysis, machine learning, deep learning, classification, data extraction, data mining, topic modelling, opinion mining, chatbots, and question answering. Data classification, management, and decision-making are the most frequently reported reasons for using NLP. The salient research topics being discussed in the literature can be grouped into four categories: (1) governance and policy, (2) citizens and public opinion, (3) medical and healthcare, and (4) economy and environment. Future research directions should focus on (1) the potential of chatbots, (2) NLP applications in the post-pandemic era, and (3) empirical research for government work.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Artificial Intelligence in Healthcare and Education · AI in Service Interactions · COVID-19 diagnosis using AI
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Applied Sciences, Macao Polytechnic University, Rua de Luís Gonzaga Gomes, Macao 999078, China
Department of Computer Science, State University of New York, Incheon 22012, Republic of Korea
Centre for Continuing Education, Macao Polytechnic University, Rua de Luís Gonzaga Gomes, Macao 999078, China
Funding
Macao Polytechnic University and the Macao Science and Technology Development Fund · Macao Polytechnic University
References (100+)
Show source-provided references
1. Implications of the Use of Artificial Intelligence in Public Governance: A Systematic Literature Review and a Research Agenda10.1016/j.giq.2021.101577 ↗
2. Schwarzer, M., Düver, J., Ploch, D., and Lommatzsch, A. (2016, January 12–14). An Interactive E-Government Question Answering System. Proceedings of the Lernen, Wissen, Daten, Analysen 2016, Potsdam, Germany.
3. Artificial Intelligence-Based Public Healthcare Systems: G2G Knowledge-Based Exchange to Enhance the Decision-Making Process10.1016/j.giq.2021.101618 ↗
4. Citizen Preferences and Government Chatbot Social Characteristics: Evidence from a Discrete Choice Experiment10.1016/j.giq.2022.101785 ↗
5. Building Citizen Trust Through E-Government10.1016/j.giq.2005.10.001 ↗
6. Song, Y., Li, Z., He, J., Li, Z., Fang, X., and Chen, D. (2019, January 15–18). Employing Auto-Annotated Data for Government Document Classification. Proceedings of the 2019 3rd International Conference on Innovation in Artificial Intelligence (ICIAI ‘19), Association for Computing Machinery, New York, NY, USA. Part F148152.10.1145/3319921.3319970 ↗
7. O. A Systematic Review of Natural Language Processing in Healthcare
8. Zhang, D., Zhang, J., Zhang, Y., and Wu, Y. (2021, January 27–29). Sentiment Analysis of China’s Education Policy Online Opinion Based on Text Mining. Proceedings of the 2021 9th International Conference on Information and Education Technology (ICIET), Okayama, Japan.10.1109/ICIET51873.2021.9419585 ↗
9. E-Government Services: Design and Evaluation of Crime Reporting Alternatives
10. Anand, T., Singh, V., Bali, B., Sahoo, B.M., Shivhare, B.D., and Gupta, A.D. (2020, January 17–19). Survey Paper: Sentiment Analysis for Major Government Decisions. Proceedings of the 2020 International Conference on Intelligent Engineering and Management (ICIEM), London, UK.10.1109/ICIEM48762.2020.9160252 ↗
11. Advancing E-Governance for Development: Digital Identification and Its Link to Socioeconomic Inclusion10.1016/j.giq.2021.101568 ↗
12. A Validation of the Modified Democratic E-Governance Website Evaluation Model10.1016/j.giq.2021.101616 ↗
13. Sentiment Analysis of Public Services for Smart Society: Literature Review and Future Research Directions10.1016/j.giq.2022.101708 ↗
14. Natural Language Processing of Clinical Notes on Chronic Diseases: Systematic Review10.2196/12239 ↗
15. Natural Language Processing in Medicine: A Review10.1016/j.tacc.2021.02.007 ↗
16. Bozyiit, F., and Kln, D. (2022). Practices of Natural Language Processing in the Finance Sector, Springer.10.1007/978-981-16-8997-0_9 ↗
17. Kim, K., and Joukov, N. (2017). Proceedings of the Information Science and Applications 2017, Springer.10.1007/978-981-10-4154-9 ↗
18. Gelbukh, A. (2005, January 6–9). Natural Language Processing. Proceedings of the Fifth International Conference on Hybrid Intelligent Systems (HIS’05), Rio de Janerio, Brazil.10.1109/ICHIS.2005.79 ↗
19. Natural Language Processing10.1002/aris.1440370103 ↗
20. Natural Language Processing: An Introduction10.1136/amiajnl-2011-000464 ↗
21. Natural Language Processing: State of the Art, Current Trends and Challenges10.1007/s11042-022-13428-4 ↗
22. Jumping NLP Curves: A Review of Natural Language Processing Research [Review Article]10.1109/MCI.2014.2307227 ↗
23. Advances in Natural Language Processing10.1126/science.aaa8685 ↗
24. Natural Language Processing
25. Using TF-IDF to Determine Word Relevance in Document Queries
26. Grootendorst, M. (2022). BERTopic: Neural Topic Modeling with a Class-Based TF-IDF Procedure. arXiv.
27. Research of Text Classification Based on TF-IDF and CNN-LSTM10.1088/1742-6596/2171/1/012021 ↗
28. A Study of the Application of Weight Distributing Method Combining Sentiment Dictionary and TF-IDF for Text Sentiment Analysis10.1109/ACCESS.2022.3160172 ↗
29. On the Design and Analysis of the Privacy-Preserving SVM Classifier10.1109/TKDE.2010.193 ↗
30. Yang, Y., Li, J., and Yang, Y. (2015, January 18–20). The Research of the Fast SVM Classifier Method. Proceedings of the 2015 12th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China.
31. What Is a Support Vector Machine?10.1038/nbt1206-1565 ↗
32. Ma, L., and Zhang, Y. (November, January 29). Using Word2Vec to Process Big Text Data. Proceedings of the 2015 IEEE International Conference on Big Data (Big Data), Santa Clara, CA, USA.10.1109/BigData.2015.7364114 ↗
33. Review on Natural Language Processing
34. Mutawa, M.A., and Rashid, H. (2020, January 10–14). Comprehensive Review on the Challenges That Impact Artificial Intelligence Applications in the Public Sector. Proceedings of the 5th NA International Conference on Industrial Engineering and Operations Management, Detroit, MI, USA.
35. Artificial Intelligence in Government: Taking Stock and Moving Forward10.1177/08944393211034087 ↗
36. How and Where Is Artificial Intelligence in the Public Sector Going? A Literature Review and Research Agenda10.1016/j.giq.2019.07.004 ↗
37. A next Generation Chatbot-Framework for the Public Administration; Communications in Computer and Information Science10.1007/978-3-319-93408-2_10 ↗
38. Lommatzsch, A., and Katins, J. (October, January 30). An Information Retrieval-Based Approach for Building Intuitive Chatbots for Large Knowledge Bases. Proceedings of the Conference on “Lernen, Wissen, Daten, Analysen”, Berlin, Germany.
39. Extracting Social Networks from E-Government by Sentiment Analysis of Users’ Comments
40. Perner, P. (2015). Proceedings of the Machine Learning and Data Mining in Pattern Recognition, Springer International Publishing.
41. Mahadzir, N.H., Omar, M.F., and Nawi, M.N.M. (2016, January 11–13). Towards Sentiment Analysis Application in Housing Projects. Proceedings of the International Conference on Applied Science and Technology 2016 (ICAST’16), Kedah, Malaysia.10.1063/1.4960900 ↗
42. Sentiment Analysis on Social Campaign “Swachh Bharat Abhiyan” Using Unigram Method10.1007/s00146-016-0672-5 ↗
43. Madanian, S., Airehrour, D., Samsuri, N.A., and Cherrington, M. (2021, January 27–30). Twitter Sentiment Analysis in Covid-19 Pandemic. Proceedings of the 2021 IEEE 12th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), Online (Virtual).10.1109/IEMCON53756.2021.9623124 ↗
44. Systematic Literature Reviews in Software Engineering—A Systematic Literature Review10.1016/j.infsof.2008.09.009 ↗
45. SEGRESS: Software Engineering Guidelines for REporting Secondary Studies10.1109/TSE.2022.3174092 ↗
46. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews10.1186/s13643-021-01626-4 ↗
47. Artificial Intelligence in Health Care: Bibliometric Analysis10.2196/18228 ↗
48. How to Write an Abstract10.1002/edn.93 ↗
49. Jiang, Y., Pang, P.C.-I., Ang, W.W., and Lau, Y. (2023). Proceedings of the 2022 10th International Conference on Information Technology: IoT and Smart City, Association for Computing Machinery.
50. The Digital Government Reference Library (DGRL) and Its Potential Formative Impact on Digital Government Research (DGR)10.1016/j.giq.2021.101613 ↗
51. Bird, S., Klein, E., and Loper, E. (2009). Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit, O’Reilly Media, Inc.
52. Hagberg, A., Swart, P.S., and Chult, D. (2008). Exploring Network Structure, Dynamics, and Function Using NetworkX, Los Alamos National Lab. (LANL).
53. Andreas Mueller (2023, October 13). WordCloud for Python Documentation. Available online: http://amueller.github.io/word_cloud/.
54. Hagen, L., Uzuner, O., Kotfila, C., Harrison, T.M., and LaManna, D. (2015, January 5–8). Understanding Citizens’ Direct Policy Suggestions to the Federal Government: A Natural Language Processing and Topic Modeling Approach. Proceedings of the 2015 48th Hawaii International Conference on System Sciences, Kauai, HI, USA.10.1109/HICSS.2015.257 ↗
55. Natural Language Processing and Psychology in E-Government Services: Evaluation of a Crime Reporting and Interviewing System10.4018/IJEGR.2015040101 ↗
56. Natural Language Processing of Russian Court Decisions for Digital Indicators Mapping for Oversight Process Control Efficiency: Disobeying a Police Officer Case
57. Aitamuro, T., Chen, K., Cherif, A., Saldivar, J., and Santana, L. (2016, January 17). Civic CrowdAnalytics: Making Sense of Crowdsourced Civic Input with Big Data Tools. Proceedings of the ACM Academic Mindtrek’16: Proceedings of the 20th International Academic Mindtrek Conference, Tampere, Finland.10.1145/2994310.2994366 ↗
58. Garg, S., Panwar, D.S., Gupta, A., and Katarya, R. (2020, January 6–8). A Literature Review on Sentiment Analysis Techniques Involving Social Media Platforms. Proceedings of the 2020 Sixth International Conference on Parallel, Distributed and Grid Computing (PDGC), Waknaghat, India.10.1109/PDGC50313.2020.9315735 ↗
59. Hasbullah, S.S., Maynard, D., Wan Chik, R.Z., Mohd, F., and Noor, M. Automated Content Analysis: A Sentiment Analysis on Malaysian Government Social Media. 2016.10.1145/2857546.2857577 ↗
60. Opinion Mining in Online Social Media: A Survey10.1007/s13278-021-00855-8 ↗
61. An Ontological Artifact for Classifying Social Media: Text Mining Analysis for Financial Data10.1016/j.accinf.2020.100469 ↗
62. International Bureaucrats in the UN Security Council Debates: A Speaker-Topic Network Analysis10.1080/13501763.2021.1998194 ↗
63. Measuring Discretion and Delegation in Legislative Texts: Methods and Application to US States10.1017/pan.2020.9 ↗
64. Prell, C. (2012). Social Network Analysis: History, Theory and Methodology, Sage Publications Ltd.
65. Transforming the Communication between Citizens and Government through AI-Guided Chatbots10.1016/j.giq.2018.10.001 ↗
66. Artificial Intelligence in the AEC Industry: Scientometric Analysis and Visualization of Research Activities10.1016/j.autcon.2020.103081 ↗
67. Both, A., Heinze, P., Perevalov, A., Bartsch, J.R., Iudin, R., Herkner, J.R., Schrader, T., Wunsch, J., Gürth, R., and Falkenhain, A.K. (2022, January 21–25). Quality Assurance of a German COVID-19 Question Answering Systems Using Component-Based Microbenchmarking. Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining, Tempe, AZ, USA.10.1145/3488560.3502196 ↗
68. Deep Contextualized Text Representation and Learning for Fake News Detection10.1016/j.ipm.2021.102723 ↗
69. Segura-Tinoco, A., Holgado-Sánchez, A., Cantador, I., and Cortés-Cediel, M.E. (2022, January 15–17). A Conversational Agent for Argument-Driven e-Participation. Proceedings of the Conference: DG.O 2022: The 23rd Annual International Conference on Digital Government Research, Online (Virtual).10.1145/3543434.3543447 ↗
70. Futia, G., Cairo, F., Morando, F., and Leschiutta, L. (2014). Exploiting Linked Open Data and Natural Language Processing for Classification of Political Speech, Edition Donau-Universität Krems; Danube University.
71. Guo, K., Jiang, T., and Zhang, H. (2020, January 10–13). Knowledge Graph Enhanced Event Extraction in Financial Documents. Proceedings of the 2020 IEEE International Conference on Big Data (Big Data), Atlanta, GA, USA.10.1109/BigData50022.2020.9378471 ↗
72. Papadopoulos, T., and Charalabidis, Y. (2020, January 23–25). What Do Governments Plan in the Field of Artificial Intelligence? Analysing National AI Strategies Using NLP. Proceedings of the ICEGOV 2020: 13th International Conference on Theory and Practice of Electronic Governance, Athens, Greece.10.1145/3428502.3428514 ↗
73. Topic Classification of Electric Vehicle Consumer Experiences with Transformer-Based Deep Learning10.1016/j.patter.2020.100195 ↗
74. E-Government Interoperability: Interaction of Policy, Management, and Technology Dimensions10.1177/0894439310392184 ↗
75. Modelling the System of Receiving Quick Answers for E-Government Services: Study for the Crime Domain in the Republic of Serbia10.12700/APH.14.8.2017.8.8 ↗
76. Misra, A., Misra, D.P., Mahapatra, S.S., and Biswas, S. (June, January 30). Digital Transformation Model: Analytic Approach on Participatory Governance & Community Engagement in India. Proceedings of the 19th Annual International Conference on Digital Government Research, Delft, The Netherlands.
77. Sentiment Analysis of Lockdown in India during COVID-19: A Case Study on Twitter10.1109/TCSS.2020.3042446 ↗
78. Lamba, A., Yadav, D., and Lele, A. (2016, January 13–16). CitizenPulse: A Text Analytics Framework for Proactive e-Governance—A Case Study of Mygov. in. Proceedings of the IKDD Conference on Data Science, 2016, Pune, India.10.1145/2888451.2888463 ↗
79. Understanding Citizens’ Emotional Pulse in a Smart City Using Artificial Intelligence10.1109/TII.2020.3009277 ↗
80. Applying and Understanding an Advanced, Novel Deep Learning Approach: A COVID-19, Text Based, Emotions Analysis Study10.1007/s10796-021-10152-6 ↗
81. Rezk, M.A., Ojo, A., Khayat, G., and Hussein, S. Proceedings of the 11th International Conference, ICEGOV ‘18: Proceedings of the 11th International Conference on Theory and Practice of Electronic Governance.
82. Assessing Canadians Health Activity and Nutritional Habits Through Social Media10.3389/fpubh.2019.00400 ↗
83. Evidence-Based Psychotherapy Trends among Posttraumatic Stress Disorder Patients in a National Healthcare System, 2001–201410.1002/da.22983 ↗
84. Lima, S., Teran, L., and Portmann, E. (2020, January 22–24). A Proposal for an Explainable Fuzzy-Based Deep Learning System for Skin Cancer Prediction. Proceedings of the 2020 Seventh International Conference on eDemocracy & eGovernment (ICEDEG), Buenos Aires, Argentina.10.1109/ICEDEG48599.2020.9096799 ↗
85. Long-Term Effects of the COVID-19 Pandemic on Public Sentiments in Mainland China: Sentiment Analysis of Social Media Posts10.2196/29150 ↗
86. Examining the Utility of Social Media in COVID-19 Vaccination: Unsupervised Learning of 672,133 Twitter Posts10.2196/29789 ↗
87. Pang, P.C.-I., Jiang, W., Pu, G., Chan, K.-S., and Lau, Y. (2022). Social Media Engagement in Two Governmental Schemes during the COVID-19 Pandemic in Macao. Int. J. Environ. Res. Public. Health, 19.10.3390/ijerph19158976 ↗
88. Greyling, T., and Rossouw, S. (2022). Positive Attitudes towards COVID-19 Vaccines: A Cross-Country Analysis. PLoS ONE, 17.10.1371/journal.pone.0264994 ↗
89. Local Government Debt Risk Assessment: A Deep Learning-Based Perspective10.1016/j.ipm.2022.102948 ↗
90. Joint Learning for Disaster Event Extraction
91. Arianto, R., Warnars, H.L.H.S., Gaol, F.L., and Trisetyarso, A. (2018, January 7–8). Mining Unstructured Data in Social Media for Natural Disaster Management in Indonesia. Proceedings of the 2018 Indonesian Association for Pattern Recognition International Conference (INAPR), Jakarta, Indonesia.10.1109/INAPR.2018.8627045 ↗
92. WATERSensing: A Smart Warning System for Natural Disasters in Spain10.1109/MCE.2021.3063703 ↗
93. Disaster Information System Using Natural Language Processing10.20965/jdr.2017.p0067 ↗
94. A Performant Deep Learning Model for Sentiment Analysis of Climate Change10.1007/s13278-022-01014-3 ↗
95. Chatbots: History, Technology, and Applications
96. A Survey on Providing Customer and Public Administration Based Services Using AI: Chatbot10.1007/s11042-021-11458-y ↗
97. Chatbot Use Cases in the COVID-19 Public Health Response10.1093/jamia/ocac014 ↗
98. ChatGPT: Five Priorities for Research10.1038/d41586-023-00288-7 ↗
99. Li, J., Pang, P.C.-I., Xiao, Y., and Wong, D. (2022). Changes in Doctor–Patient Relationships in China during COVID-19: A Text Mining Analysis. Int. J. Environ. Res. Public. Health, 19.10.3390/ijerph192013446 ↗
100. Forecast and Simulation of the Public Opinion on the Public Policy Based on the Markov Model10.1155/2021/9936965 ↗