journal article·2022-04-17Open access

A Survey of Artificial Intelligence Challenges: Analyzing the Definitions, Relationships, and Evolutions

Ali Mohammad Saghiri, S. Mehdi Vahidipour, Mohammad Reza Jabbarpour, Mehdi Sookhak, Agostino Forestiero

Applied Sciences· Volume 12· Issue 8

Abstract

In recent years, artificial intelligence has had a tremendous impact on every field, and several definitions of its different types have been provided. In the literature, most articles focus on the extraordinary capabilities of artificial intelligence. Recently, some challenges such as security, safety, fairness, robustness, and energy consumption have been reported during the development of intelligent systems. As the usage of intelligent systems increases, the number of new challenges increases. Obviously, during the evolution of artificial narrow intelligence to artificial super intelligence, the viewpoint on the challenges such as security will be changed. In addition, the recent development of human-level intelligence cannot appropriately happen without considering whole challenges in designing intelligent systems. Considering the mentioned situation, no study in the literature summarizes the challenges in designing artificial intelligence. In this paper, a review of the challenges is presented. Then, some important research questions about the future dynamism of challenges and their relationships are answered.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Ethics and Social Impacts of AI · Anomaly Detection Techniques and Applications · Big Data and Digital Economy

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Soft Computing Lab, Computer Engineering and Information Technology Department, Amirkabir University of Technology (Tehran Polytechnic), Tehran 1591634311, Iran

Computer Engineering Department, University of Kashan, Kashan 8731753153, Iran

Information and Communications Technology Research Department, Niroo Research Institute, Tehran 1468613113, Iran

Department of Computer Science, Texas A&M University, Corpus Christ, TX 78412, USA

Institute for High Performance Computing and Networking (ICAR), National Research Council of Italy (CNR), 00185 Rende, CS, Italy

References (100+)

Show source-provided references
1. Binu, D., and Rajakumar, B.R. (2021). Artificial Intelligence in Data Mining: Theories and Applications, Academic Press.
2. Ahmadi, A., Meybodi, M.R., and Saghiri, A.M. (2016, January 9). Adaptive search in unstructured peer-to-peer networks based on ant colony and Learning Automata. Proceedings of the 2016 Artificial Intelligence and Robotics, Qazvin, Iran.10.1109/RIOS.2016.7529503 ↗
3. Cheng, X., Lin, X., Shen, X.-L., Zarifis, A., and Mou, J. (2022). The dark sides of AI. Electron. Mark., 1–5.10.1007/s12525-022-00531-5 ↗
4. Jabbarpour, M.R., Saghiri, A.M., and Sookhak, M. (2021). A framework for component selection considering dark sides of artificial intelligence: A case study on autonomous vehicle. Electronics, 10.10.3390/electronics10040384 ↗
5. Scary dark side of artificial intelligence: A perilous contrivance to mankind
6. Mahmoud, A.B., Tehseen, S., and Fuxman, L. (2020). The dark side of artificial intelligence in retail innovation. Retail Futures, Emerald Publishing Limited.10.1108/978-1-83867-663-620201019 ↗
7. The dark sides of artificial intelligence: An integrated AI governance framework for public administration10.1080/01900692.2020.1749851 ↗
8. Hanif, M.A., Khalid, F., Putra, R.V.W., Rehman, S., and Shafique, M. (2018, January 2–4). Robust machine learning systems: Reliability and security for deep neural networks. Proceedings of the 2018 IEEE 24th International Symposium on On-Line Testing and Robust System Design (IOLTS), Platja d’Aro, Spain.10.1109/IOLTS.2018.8474192 ↗
9. Varshney, K.R. (February, January 31). Engineering safety in machine learning. Proceedings of the 2016 Information Theory and Applications Workshop (ITA), La Jolla, CA, USA.10.1109/ITA.2016.7888195 ↗
10. AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias10.1147/JRD.2019.2942287 ↗
11. Strubell, E., Ganesh, A., and McCallum, A. (2019). Energy and policy considerations for deep learning in NLP. arXiv.10.18653/v1/P19-1355 ↗
12. The EU approach to ethics guidelines for trustworthy artificial intelligence10.9785/cri-2019-200402 ↗
13. A collection of definitions of intelligence
14. Legg, S. (2008). Machine Super Intelligence. [Ph.D. Thesis, University of Lugano].
15. Saghiri, A.M. (2020, January 22–23). A Survey on Challenges in Designing Cognitive Engines. Proceedings of the 2020 6th International Conference on Web Research (ICWR), Tehran, Iran.10.1109/ICWR49608.2020.9122273 ↗
16. Boström, N. (2014). Superintelligence: Paths, Dangers, Strategies, Oxford University Press.
17. Chollet, F. (2019). On the measure of intelligence. arXiv.
18. Yampolskiy, R.V. (2020). Human is not equal to AGI. arXiv.
19. Minds, brains, and programs10.1017/S0140525X00005756 ↗
20. Russell, S.J., and Norvig, P. (1994). Artificial Intelligence: A Modern Approach, Prentice Hall. [3rd ed.].
21. Linz, P. (2006). An Introduction to Formal Languages and Automata, Jones & Bartlett Learning.
22. Cyc: Toward programs with common sense10.1145/79173.79176 ↗
23. Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning: An Introduction, Cambridge University Press.10.1109/TNN.1998.712192 ↗
24. Quantum computing10.1088/0034-4885/61/2/002 ↗
25. Learning automata based energy-efficient AI hardware design for IoT applications10.1098/rsta.2019.0593 ↗
26. Priya, S., and Inman, D.J. (2009). Energy Harvesting Technologies, Springer.10.1007/978-0-387-76464-1 ↗
27. Wireless energy harvesting for the Internet of Things10.1109/MCOM.2015.7120024 ↗
28. Big Data Tools: Advantages and Disadvantages
29. Critical analysis of Big Data challenges and analytical methods10.1016/j.jbusres.2016.08.001 ↗
30. A survey of machine learning for big data processing10.1186/s13634-016-0355-x ↗
31. Secure and robust machine learning for healthcare: A survey10.1109/RBME.2020.3013489 ↗
32. Bhagoji, A.N., Cullina, D., Sitawarin, C., and Mittal, P. (2018, January 21–23). Enhancing robustness of machine learning systems via data transformations. Proceedings of the 2018 52nd Annual Conference on Information Sciences and Systems (CISS), Princeton, NJ, USA.10.1109/CISS.2018.8362326 ↗
33. Rozsa, A., Günther, M., and Boult, T.E. (2016, January 18–20). Are accuracy and robustness correlated. Proceedings of the 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA), Anaheim, CA, USA.10.1109/ICMLA.2016.0045 ↗
34. Pérez-Rosas, V., Abouelenien, M., Mihalcea, R., and Burzo, M. (2015, January 9–13). Deception detection using real-life trial data. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, Seattle, WA, USA.10.1145/2818346.2820758 ↗
35. Krishnamurthy, G., Majumder, N., Poria, S., and Cambria, E. (2018). A deep learning approach for multimodal deception detection. arXiv.
36. Randhavane, T., Bhattacharya, U., Kapsaskis, K., Gray, K., Bera, A., and Manocha, D. (2019). The Liar’s Walk: Detecting Deception with Gait and Gesture. arXiv.
37. Zhao, S., Jiang, G., Huang, T., and Yang, X. (2005, January 14–16). The deception detection and restraint in multi-agent system. Proceedings of the 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI’05), Hong Kong, China.
38. Zlotkin, G., and Rosenschein, J.S. (1991, January 24–30). Incomplete Information and Deception in Multi-Agent Negotiation. Proceedings of the IJCAI, Sydney, Australia.
39. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada.
40. Lies, Line Drawing, and Deep Fake News
41. Intrusion detection by machine learning: A review10.1016/j.eswa.2009.05.029 ↗
42. Genetic algorithm with variable length chromosomes for network intrusion detection10.1007/s11633-014-0870-x ↗
43. Kinsner, W. (2012, January 22–24). Towards cognitive security systems. Proceedings of the 11th International Conference on Cognitive Informatics and Cognitive Computing, Kyoto, Japan.10.1109/ICCI-CC.2012.6311207 ↗
44. Security evaluation of pattern classifiers under attack10.1109/TKDE.2013.57 ↗
45. Barreno, M., Nelson, B., Sears, R., Joseph, A.D., and Tygar, J.D. (2006, January 21–24). Can machine learning be secure?. Proceedings of the 2006 ACM Symposium on Information, Computer and Communications Security, Taipei, Taiwan.10.1145/1128817.1128824 ↗
46. Yampolskiy, R.V. (2018). Artificial Intelligence Safety and Security, CRC Press.10.1201/9781351251389 ↗
47. Huang, L., Joseph, A.D., Nelson, B., Rubinstein, B.I., and Tygar, J. (2011, January 21). Adversarial machine learning. Proceedings of the 4th ACM Workshop on Security and Artificial Intelligence, Chicago, IL, USA.10.1145/2046684.2046692 ↗
48. Ateniese, G., Felici, G., Mancini, L.V., Spognardi, A., Villani, A., and Vitali, D. (2013). Hacking smart machines with smarter ones: How to extract meaningful data from machine learning classifiers. arXiv.
49. Tucker, C., Agrawal, A., Gans, J., and Goldfarb, A. (2018). Privacy, algorithms, and artificial intelligence. The Economics of Artificial Intelligence: An Agenda, Oxford University Press.10.7208/chicago/9780226613475.001.0001 ↗
50. Federated machine learning: Concept and applications10.1145/3339474 ↗
51. Zhang, W., and Ntoutsi, E. (2019). Faht: An adaptive fairness-aware decision tree classifier. arXiv.10.24963/ijcai.2019/205 ↗
52. Kamani, M.M., Haddadpour, F., Forsati, R., and Mahdavi, M. (2022). Efficient fair principal component analysis. Machine Learning, Springer.10.1007/s10994-021-06100-9 ↗
53. Dwork, C., Hardt, M., Pitassi, T., Reingold, O., and Zemel, R. (2012, January 8–10). Fairness through awareness. Proceedings of the 3rd Innovations in Theoretical Computer Science Conference, Cambridge, MA, USA.10.1145/2090236.2090255 ↗
54. Kamiran, F., and Calders, T. (2009, January 17–18). Classifying without discriminating. Proceedings of the 2009 2nd International Conference on Computer, Control and Communication, Karachi, Pakistan.10.1109/IC4.2009.4909197 ↗
55. Calders, T., Kamiran, F., and Pechenizkiy, M. (2009, January 6). Building classifiers with independency constraints. Proceedings of the 2009 IEEE International Conference on Data Mining Workshops, Miami, FL, USA.10.1109/ICDMW.2009.83 ↗
56. Quy, T.L., Roy, A., Iosifidis, V., and Ntoutsi, E. (2021). A survey on datasets for fairness-aware machine learning. arXiv.
57. Equality of opportunity in supervised learning
58. Kamishima, T., Akaho, S., and Sakuma, J. (2011, January 11). Fairness-aware learning through regularization approach. Proceedings of the 2011 IEEE 11th International Conference on Data Mining Workshops, Vancouver, BC, Canada.10.1109/ICDMW.2011.83 ↗
59. Satisfying real-world goals with dataset constraints
60. Three naive Bayes approaches for discrimination-free classification10.1007/s10618-010-0190-x ↗
61. Empirical risk minimization under fairness constraints
62. Morgenstern, J., Samadi, S., Singh, M., Tantipongpipat, U., and Vempala, S. (2019). Fair dimensionality reduction and iterative rounding for sdps. arXiv.
63. The price of fair pca: One extra dimension
64. On fairness and calibration
65. Adadi, A., and Berrada, M. (2020). Explainable AI for healthcare: From black box to interpretable models. Embedded Systems and Artificial Intelligence, Springer.10.1007/978-981-15-0947-6_31 ↗
66. Gade, K., Geyik, S.C., Kenthapadi, K., Mithal, V., and Taly, A. (2019, January 4–8). Explainable AI in industry. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.10.1145/3292500.3332281 ↗
67. Došilović, F.K., Brčić, M., and Hlupić, N. (2018, January 21–25). Explainable artificial intelligence: A survey. Proceedings of the 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.10.23919/MIPRO.2018.8400040 ↗
68. Samek, W., and Müller, K.-R. (2019). Towards explainable artificial intelligence. Explainable AI: Interpreting, Explaining and Visualizing Deep Learning, Springer.10.1007/978-3-030-28954-6 ↗
69. Sharma, S., Nag, A., Cordeiro, L., Ayoub, O., Tornatore, M., and Nekovee, M. (2020, January 1–4). Towards explainable artificial intelligence for network function virtualization. Proceedings of the 16th International Conference on Emerging Networking EXperiments and Technologies, Barcelona, Spain.10.1145/3386367.3431673 ↗
70. The responsibility gap: Ascribing responsibility for the actions of learning automata10.1007/s10676-004-3422-1 ↗
71. Neri, E., Coppola, F., Miele, V., Bibbolino, C., and Grassi, R. (2020). Artificial Intelligence: Who Is Responsible for the Diagnosis?, Springer.10.1007/s11547-020-01135-9 ↗
72. X-machines and the halting problem: Building a super-Turing machine10.1007/BF01888233 ↗
73. On the strongly generic undecidability of the Halting Problem10.1016/j.tcs.2007.02.010 ↗
74. Yampolskiy, R.V. (2020). On Controllability of AI. arXiv.
75. Russell, S. (2019). Human Compatible: Artificial Intelligence and the Problem of Control, Penguin.
76. Yampolskiy, R. (2020). On Controllability of Artificial Intelligence, University of Louisville. Technical Report.
77. Dawson, J. (1996). Logical Dilemmas: The Life and Work of Kurt Gödel, CRC Press.10.1201/9780429294884 ↗
78. Yampolskiy, R.V. (2019). Unpredictability of AI. arXiv.
79. Hofstadter, D.R. (2007). I Am a Strange Loop, Basic Books.
80. Musiolik, G. (2021). Predictability of AI Decisions. Analyzing Future Applications of AI, Sensors, and Robotics in Society, IGI Global.10.4018/978-1-7998-3499-1 ↗
81. Delange, M., Aljundi, R., Masana, M., Parisot, S., Jia, X., Leonardis, A., Slabaugh, G., and Tuytelaars, T. (2021). A continual learning survey: Defying forgetting in classification tasks. IEEE Trans. Pattern Anal. Mach. Intell.10.1109/TPAMI.2021.3057446 ↗
82. Shin, H., Lee, J.K., Kim, J., and Kim, J. (2017, January 4–9). Continual learning with deep generative replay. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
83. Artificial intelligence (AI) or intelligence augmentation (IA): What is the future?10.3390/ai1020008 ↗
85. Kumar, A., Boehm, M., and Yang, J. (2017, January 14–19). Data management in machine learning: Challenges, techniques, and systems. Proceedings of the 2017 ACM International Conference on Management of Data, Chicago, IL, USA.10.1145/3035918.3054775 ↗
86. 40 years of cognitive architectures: Core cognitive abilities and practical applications10.1007/s10462-018-9646-y ↗
87. The semantic web
88. The semantic web in action10.1038/scientificamerican1207-90 ↗
89. Jumping NLP curves: A review of natural language processing research10.1109/MCI.2014.2307227 ↗
90. Trends in agent communication language10.1111/1467-8640.00184 ↗
91. Ontology learning for the semantic web10.1109/5254.920602 ↗
92. Teslya, N., and Smirnov, A. (2018, January 4–5). Blockchain-based framework for ontology-oriented robots’ coalition formation in cyberphysical systems. Proceedings of the MATEC Web of Conferences, Anyer, Indonesia.10.1051/matecconf/201816103018 ↗
93. On the Morality of Artificial Intelligence10.1109/MTS.2020.2967486 ↗
94. Abdel-Fattah, A.M., Besold, T.R., Gust, H., Krumnack, U., Schmidt, M., Kuhnberger, K.-U., and Wang, P. (2012, January 1–4). Rationality-guided AGI as cognitive systems. Proceedings of the Annual Meeting of the Cognitive Science Society, Sapporo, Japan.
95. Gigerenzer, G., and Selten, R. (2001). Rethinking rationality. Bounded Rationality: The Adaptive Toolbox, MIT Press.10.7551/mitpress/1654.001.0001 ↗
96. Algorithmic rationality: Game theory with costly computation10.1016/j.jet.2014.04.007 ↗
97. Rationality and intelligence10.1016/S0004-3702(97)00026-X ↗
98. Knowing me, knowing you: Theory of mind in AI10.1017/S0033291720000835 ↗
99. Rabinowitz, N., Perbet, F., Song, F., Zhang, C., Eslami, S.A., and Botvinick, M. (2018, January 10–15). Machine theory of mind. Proceedings of the International Conference on Machine Learning, Vienna, Austria.
100. Theory of mind: A foundational component of human general intelligence10.1017/S0140525X16001618 ↗