Uncovering Research Trends on Artificial Intelligence Risk Assessment in Businesses: A State-of-the-Art Perspective Using Bibliometric Analysis
Source abstract
Abstract
This paper presents a quantitative vision of the study of artificial intelligence risk assessment in business based on a bibliometric analysis of the most relevant publications. The main goal is to determine whether the risk assessment of artificial intelligence systems used in businesses is really a subject of increasing interest and to identify the most influential and productive sources of scientific research in this area. Data were collected from the Web of Science Core Collection, one of the most complete and prestigious databases. Regarding the temporal evolution of publications and citations this study evidences, this research subject shows rapid growth in the number of publications (at a compound annual rate of 31.20% from 2018 to 2024 inclusive), showing its high attraction for researchers, responding to the need to implement systematic risk assessment processes in the organizations using AI to mitigate potential harms, ensure compliance with regulations, and enhance artificial intelligence systems’ trust and adoption. Especially after the surge of large language models like ChatGPT or Gemini, AI is revolutionizing the dynamics of human–computer interaction using natural language, video, and audio. However, as the scientific community initiates rigorous studies on AI risk assessment within organizational contexts, it is imperative to consider critical issues such as data privacy, ethics, bias, and hallucinations to ensure the successful integration and interaction of AI systems with human operators. Furthermore, this paper constitutes a starting point, including for any researcher who wants to be introduced to this topic, indicating new challenges that should be dealt by researchers interested in AI and hot topics, in addition to the most relevant literature, authors, and journals about this research subject.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Big Data and Business Intelligence · Impact of AI and Big Data on Business and Society · Artificial Intelligence in Healthcare and Education
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Departamento de Organización de Empresas, Universitat Politècnica de València, 46022 Valencia, Spain
Departamento de Sistemas Informáticos y Computación, Universitat Politècnica de València, 46022 Valencia, Spain
Funding
INCIBE’s Chair funded by the EU-NextGenerationEU through the Spanish government’s Plan de Recuperación, Transformación y Resiliencia
References (82)
Show source-provided references
1. When Machine Learning Meets Privacy: A Survey and Outlook
2. Artificial Intelligence (AI) Ethics: Ethics of AI and Ethical AI10.4018/JDM.2020040105 ↗
3. AI4People—An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations10.1007/s11023-018-9482-5 ↗
4. Gerke, S., Minssen, T., and Cohen, G. (2020). Ethical and Legal Challenges of Artificial Intelligence-Driven Healthcare. Artificial Intelligence in Healthcare, Academic Press.10.2139/ssrn.3570129 ↗
5. Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI10.1016/j.inffus.2019.12.012 ↗
6. Linardatos, P., Papastefanopoulos, V., and Kotsiantis, S. (2021). Explainable AI: A Review of Machine Learning Interpretability Methods. Entropy, 23.10.3390/e23010018 ↗
7. (2018). International Standards Organization International Standards Organization (Standard No. ISO 31000: 2018 (En)). Risk Management—Guidelines.
8. (2024). Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 Laying down Harmonised Rules on Artificial Intelligence and Amending Regulations (EC) No 300/2008, (EU) No 167/2013, (EU) No 168/2013, (EU) 2018/858, (EU) 2018/1139 and (EU) 2019/2144 and Directives 2014/90/EU, (EU) 2016/797 and (EU) 2020/1828 (Artificial Intelligence Act) Text with EEA Relevance, Official Journal of the European Union, L 2024/1689. European Parliament and Council of the European Union.
9. Elham, T. (2023). NIST Artificial Intelligence Risk Management Framework (AI RMF 1.0), National Institute of Standards and Technology.
10. Integrating Research Performance Analysis and Science Mapping10.1007/BF02459614 ↗
11. Crowdfunding: A Bibliometric Analysis10.1007/s11365-021-00784-0 ↗
12. Bibliometrics: Methods for Studying Academic Publishing10.1007/S40037-021-00695-4 ↗
13. Awakening the Beauty: A Journey through Dormant Gems in Strategic Management Literature10.1007/s11135-023-01806-5 ↗
14. A Bibliometric Analysis of Operations Research and Management Science10.1016/j.omega.2016.12.004 ↗
15. Sustainable Manufacturing in Industry 4.0: An Emerging Research Agenda10.1080/00207543.2019.1652777 ↗
16. Entrepreneurship Research: Mapping Intellectual Structures and Research Trends10.1007/s11846-017-0242-3 ↗
17. Passas, I. (2024). Bibliometric Analysis: The Main Steps. Encyclopedia, 4.10.3390/encyclopedia4020065 ↗
18. Research Landscape of Business Intelligence and Big Data Analytics: A Bibliometrics Study10.1016/j.eswa.2018.05.018 ↗
19. History, Evolution and Future of Big Data and Analytics: A Bibliometric Analysis of Its Relationship to Performance in Organizations10.1111/1467-8551.12340 ↗
20. Artificial Intelligence in E-Commerce: A Bibliometric Study and Literature Review10.1007/s12525-022-00537-z ↗
21. Blockchain Technology in Logistics and Supply Chain Management—A Bibliometric Literature Review from 2016 to January 202010.1109/TEM.2020.2980733 ↗
22. Digital Transformation: A Bibliometric Analysis10.4018/JOEUC.302637 ↗
23. Are We Preparing for a Good AI Society? A Bibliometric Review and Research Agenda10.1016/j.techfore.2020.120482 ↗
24. Health Care and Cybersecurity: Bibliometric Analysis of the Literature10.2196/12644 ↗
25. Ethics and Privacy of Artificial Intelligence: Understandings from Bibliometrics10.1016/j.knosys.2021.106994 ↗
26. Cybersecurity and Artificial Intelligence Applications: A Bibliometric Analysis Based on Scopus Database10.58496/MJCSC/2023/018 ↗
27. Taking AI Risks Seriously: A New Assessment Model for the AI Act10.1007/s00146-023-01723-z ↗
28. AI Risk Assessment: A Scenario-Based, Proportional Methodology for the AI Act10.1007/s44206-024-00095-1 ↗
29. The AI Risk Repository: A Comprehensive Meta-Review, Database, and Taxonomy of Risks from Artificial Intelligence10.70777/agi.v1i1.10881 ↗
30. Which H-Index?—A Comparison of WoS, Scopus and Google Scholar10.1007/s11192-008-0216-y ↗
31. As We May Search—Comparison of Major Features of the Web of Science, Scopus, and Google Scholar Citation-Based and Citation-Enhanced Databases
32. (2024, August 09). Web of Science Core Collection. Available online: https://clarivate.com/products/scientific-and-academic-research/research-discovery-and-workflow-solutions/webofscience-platform/web-of-science-core-collection/.
33. An Approach for Detecting, Quantifying, and Visualizing the Evolution of a Research Field: A Practical Application to the Fuzzy Sets Theory Field10.1016/j.joi.2010.10.002 ↗
34. An Index to Quantify an Individual’s Scientific Research Output10.1073/pnas.0507655102 ↗
35. Hua, P., Wan, J., and Wu, J. (2024, August 09). A Perfect Hirsch-Type Index? Experiences Using the Tapered h-Index (hT). Available online: http://eprints.rclis.org/14251/.
36. Chai, J.-C., Hua, P.-H., Rousseau, R., and Wan, J.-K. (2008, January 8). The Adapted Pure H-Index. Proceedings of the WIS 2008, Berlin Fourth International Conference on Webometrics, Informetrics and Scientometrics & Ninth COLLNET Meeting, Berlin, Germany.
37. Mathematical Theory of the H- and g-Index in Case of Fractional Counting of Authorship10.1002/asi.20845 ↗
38. Real and Rational Variants of the H-Index and the g-Index
39. Global Quantitative Analysis and Visualization of Big Data and Medical Devices Based on Bibliometrics10.1016/j.eswa.2024.124398 ↗
40. Bibliometrix: An R-Tool for Comprehensive Science Mapping Analysis
41. McCarthy, J., Minsky, M.L., Rochester, N., and Shannon, C. (2024, August 21). A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence. Available online: https://raysolomonoff.com/dartmouth/boxa/dart564props.pdf.
42. A New Fuzzy Support Vector Machine to Evaluate Credit Risk10.1109/TFUZZ.2005.859320 ↗
43. Risk Assessment in Social Lending via Random Forests10.1016/j.eswa.2015.02.001 ↗
44. Hesitant Fuzzy Linguistic Term Set and Its Application in Decision Making: A State-of-the-Art Survey10.1007/s40815-017-0432-9 ↗
45. Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networks10.1109/TKDE.2020.3008774 ↗
46. Financial Credit Risk Assessment: A Recent Review10.1007/s10462-015-9434-x ↗
47. Improving Returns on Stock Investment through Neural Network Selection10.1016/S0957-4174(99)00041-X ↗
48. Exploring the Behaviour of Base Classifiers in Credit Scoring Ensembles10.1016/j.eswa.2012.02.092 ↗
49. Dynamic Ensemble Classification for Credit Scoring Using Soft Probability10.1016/j.asoc.2018.01.021 ↗
50. Two-Level Classifier Ensembles for Credit Risk Assessment10.1016/j.eswa.2012.03.033 ↗
51. Enterprise Credit Risk Evaluation Based on Neural Network Algorithm10.1016/j.cogsys.2018.07.023 ↗
52. Furxhi, I., Murphy, F., Mullins, M., Arvanitis, A., and Poland, C.A. (2020). Practices and Trends of Machine Learning Application in Nanotoxicology. Nanomaterials, 10.10.3390/nano10010116 ↗
53. Unsupervised Quadratic Surface Support Vector Machine with Application to Credit Risk Assessment10.1016/j.ejor.2019.08.010 ↗
54. A Novel Tree-Based Dynamic Heterogeneous Ensemble Method for Credit Scoring10.1016/j.eswa.2020.113615 ↗
55. A Review of Artificial Intelligence Based Risk Assessment Methods for Capturing Complexity-Risk Interdependencies: Cost Overrun in Construction Projects10.1108/IJMPB-02-2019-0047 ↗
56. Short Term Rainfall-Runoff Modelling Using Several Machine Learning Methods and a Conceptual Event-Based Model10.1007/s00477-020-01910-0 ↗
57. Objective Risk Stratification of Prostate Cancer Using Machine Learning and Radiomics Applied to Multiparametric Magnetic Resonance Images10.1038/s41598-018-38381-x ↗
58. Improved TODIM Method for Intuitionistic Fuzzy MAGDM Based on Cumulative Prospect Theory and Its Application on Stock Investment Selection10.1007/s13042-020-01208-1 ↗
59. The Hemispheric Contrast in Cloud Microphysical Properties Constrains Aerosol Forcing10.1073/pnas.1922502117 ↗
60. A Machine Learning Approach Combining Expert Knowledge with Genetic Algorithms in Feature Selection for Credit Risk Assessment10.1016/j.asoc.2021.107391 ↗
61. Cybersecurity: Risk Management Framework and Investment Cost Analysis10.1016/j.bushor.2021.02.022 ↗
62. Application of Machine Learning Methods to Risk Assessment of Financial Statement Fraud: Evidence from China10.1002/for.2294 ↗
63. Machine Learning in Occupational Accident Analysis: A Review Using Science Mapping Approach with Citation Network Analysis10.1016/j.ssci.2020.104900 ↗
64. Nanotoxicology Data for in Silico Tools: A Literature Review10.1080/17435390.2020.1729439 ↗
65. Machine Learning and Credit Ratings Prediction in the Age of Fourth Industrial Revolution10.1016/j.techfore.2020.120309 ↗
66. Principles and Business Processes for Responsible AI10.1016/j.clsr.2019.04.007 ↗
67. A Machine Learning Approach for Monitoring Ship Safety in Extreme Weather Events10.1016/j.ssci.2021.105336 ↗
68. The Value of Meteorological Data in Marine Risk Assessment10.1016/j.ress.2021.107480 ↗
69. A Comparative Study of Forecasting Corporate Credit Ratings Using Neural Networks, Support Vector Machines, and Decision Trees10.1016/j.najef.2020.101251 ↗
70. Ramasamy, L.K., Khan, F., Shah, M., Prasad, B.V.V.S., Iwendi, C., and Biamba, C. (2022). Secure Smart Wearable Computing through Artificial Intelligence-Enabled Internet of Things and Cyber-Physical Systems for Health Monitoring. Sensors, 22.10.3390/s22031076 ↗
71. Development of Flood Hazard Map and Emergency Relief Operation System Using Hydrodynamic Modeling and Machine Learning Algorithm10.1016/j.jclepro.2021.127594 ↗
72. CHEN, N. (2024, August 13). Renamed Chinese Post-Graduate University Holds First Opening Ceremony—Chinese Academy of Sciences. Available online: https://english.cas.cn/newsroom/archive/news_archive/nu2012/201502/t20150215_140273.shtml.
73. (2024, August 14). Population & Demography Data Explorer. Available online: https://ourworldindata.org/explorers/population-and-demography.
74. (2024, August 14). KeyWords Plus Generation, Creation, and Changes. Available online: https://support.clarivate.com/ScientificandAcademicResearch/s/article/KeyWords-Plus-generation-creation-and-changes?language=en_US.
75. The Herfindahl-Hirschman Index
76. Bradford, S.C. (1953). Documentation, C. Lockwood.
77. What Can We Learn from What a Machine Has Learned? Interpreting Credit Risk Machine Learning Models
78. Interpretable Selective Learning in Credit Risk10.1016/j.ribaf.2023.101940 ↗
79. Feature-Weighted Counterfactual-Based Explanation for Bankruptcy Prediction10.1016/j.eswa.2022.119390 ↗
80. Pnevmatikakis, A., Kanavos, S., Matikas, G., Kostopoulou, K., Cesario, A., and Kyriazakos, S. (2021). Risk Assessment for Personalized Health Insurance Based on Real-World Data. Risks, 9.10.3390/risks9030046 ↗
81. PsyCredit: An Interpretable Deep Learning-Based Credit Assessment Approach Facilitated by Psychometric Natural Language Processing10.1016/j.eswa.2022.116847 ↗
82. Towards an Equitable Digital Society: Artificial Intelligence (AI) and Corporate Digital Responsibility (CDR)10.1007/s12115-021-00594-8 ↗