journal article·2022-01-20Open access

Certifiable AI

Jobst Landgrebe

Applied Sciences· Volume 12· Issue 3

Abstract

Implicit stochastic models, including both ‘deep neural networks’ (dNNs) and the more recent unsupervised foundational models, cannot be explained. That is, it cannot be determined how they work, because the interactions of the millions or billions of terms that are contained in their equations cannot be captured in the form of a causal model. Because users of stochastic AI systems would like to understand how they operate in order to be able to use them safely and reliably, there has emerged a new field called ‘explainable AI’ (XAI). When we examine the XAI literature, however, it becomes apparent that its protagonists have redefined the term ‘explanation’ to mean something else, namely: ‘interpretation’. Interpretations are indeed sometimes possible, but we show that they give at best only a subjective understanding of how a model works. We propose an alternative to XAI, namely certified AI (CAI), and describe how an AI can be specified, realized, and tested in order to become certified. The resulting approach combines ontologies and formal logic with statistical learning to obtain reliable AI systems which can be safely used in technical applications.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Explainable Artificial Intelligence (XAI) · Adversarial Robustness in Machine Learning · Bayesian Modeling and Causal Inference

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Philosophy, University at Buffalo, 135 Park Hall, Buffalo, NY 14260, USA

References (52)

Show source-provided references
1. Hastie, T., Tibshirani, R., and Friedman, J. (2008). The Elements of Statistical Learning, Springer. [2nd ed.].
2. Goodfellow, I.J., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
3. Brown, T.B., Mann, B.P., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., and Askell, A. (2020). Language Models are Few-Shot Learners. arXiv.
4. Bommasani, R., Hudson, D.A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M.S., Bohg, J., Bosselut, A., and Brunskill, E. (2021). On the Opportunities and Risks of Foundation Models. arXiv.
5. Van den Oord, A., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., and Kavukcuoglu, K. (2016). WaveNet: A Generative Model for Raw Audio. arXiv.
6. Van den Oord, A., Li, Y., and Vinyals, O. (2019). Representation Learning with Contrastive Predictive Coding. arXiv.
7. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead10.1038/s42256-019-0048-x ↗
8. Semantics derived automatically from language corpora contain human-like biases10.1126/science.aal4230 ↗
9. Weber, M. (1988). Gesammelte Aufsätze zur Wissenschaftslehre, J.C.B. Mohr.
10. Hesse, M. (1963). Models and Analogies in Science, Sheed and Ward.
11. Poser, H. (2001). Wissenschaftstheorie: Eine Philosophische Einführung, Reclam.
12. Hermeneutik
13. Tinsley, H.E., and Weiss, D.J. (2000). Interrater reliability and agreement. Handbook of Applied Multivariate Statistics and Mathematical Modeling, Elsevier.10.1016/B978-012691360-6/50005-7 ↗
14. Towards multi-modal causability with Graph Neural Networks enabling information fusion for explainable AI10.1016/j.inffus.2021.01.008 ↗
15. Hayek, F.A.V. (1952). The Sensory Order. An Inquiry into the Foundations of Theoretical Psychology, Chicago University Press.
16. The magical number seven, plus or minus two: Some limits on our capacity for processing information10.1037/h0043158 ↗
17. Coronary risk factor screening in three rural communities
18. The revival of the Gini importance?10.1093/bioinformatics/bty373 ↗
19. Fahrmeir, L., Kneib, T., Lang, S., and Marx, B. (2013). Regression Models, Springer.10.1007/978-3-642-34333-9 ↗
20. Unmasking Clever Hans Predictors and Assessing What Machines Really Learn10.1038/s41467-019-08987-4 ↗
21. Lundberg, S., and Lee, S.I. (2017). A Unified Approach to Interpreting Model Predictions. arXiv.
22. Doshi-Velez, F., and Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv.
23. Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.R., and Samek, W. (2015). On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE, 10.10.1371/journal.pone.0130140 ↗
24. Moosavi-Dezfooli, S., Fawzi, A., Fawzi, O., and Frossard, P. (2017, January 21–26). Universal Adversarial Perturbations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.17 ↗
25. Jo, J., and Bengio, Y. (2017). Measuring the Tendency of CNNs to Learn Surface Statistical Regularities. arXiv.
26. Mu, J., and Andreas, J. (2021). Compositional Explanations of Neurons. arXiv.
27. Activation atlas10.23915/distill.00015 ↗
28. Gaver, W.W. (May, January 27). Technology affordances. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Orleans Louisiana, LA, USA.
29. Bau, D., Zhou, B., Khosla, A., Oliva, A., and Torralba, A. (2017, January 21–26). Network dissection: Quantifying interpretability of deep visual representations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.354 ↗
30. An introduction to circuits10.23915/distill.00024.001 ↗
31. Multimodal neurons in artificial neural networks10.23915/distill.00030 ↗
32. Convolutional neural networks as a model of the visual system: Past, present, and future10.1162/jocn_a_01544 ↗
33. Making AI Meaningful Again10.1007/s11229-019-02192-y ↗
34. Landgrebe, J., and Smith, B. (2022). Why Machines Will Never Rule the Earth, Routledge.10.4324/9781003310105 ↗
35. Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., and Garnett, R. (2016). Learning What and Where to Draw. Advances in Neural Information Processing Systems, Curran Associates, Inc.
36. Zhai, L., Juefei-Xu, F., Guo, Q., Xie, X., Ma, L., Feng, W., Qin, S., and Liu, Y. (2020). It’s Raining Cats or Dogs? Adversarial Rain Attack on DNN Perception. arXiv.
37. A note on the Entscheidungsproblem10.2307/2269326 ↗
38. Boolos, G.S., Burgess, J.P., and Jeffrey, R.C. (2007). Computability and Logic, Cambridge University Press.10.1017/CBO9780511804076 ↗
39. Hilbert’s Tenth Problem. Diophantine Equations: Positive Aspects of a Negative Solution10.1090/pspum/028.2/0432534 ↗
40. Teuscher, C. (2004). The Myth of Hypercomputation. Alan Turing: Life and Legacy of a Great Thinker, Springer.10.1007/978-3-662-05642-4 ↗
41. Landgrebe, J., and Smith, B. (2021). An argument for the impossibility of machine intelligence. arXiv.10.4324/9781003310105-4 ↗
42. Caldwell, B. (2014). The pretence of knowledge. The Market and Other Orders, University of Chicago Press.10.4324/9781315734866 ↗
43. Thurner, S., Klimek, P., and Hanel, R. (2018). Introduction to the Theory of Complex Systems, Oxford University Press.10.1093/oso/9780198821939.001.0001 ↗
44. Baader, F., Calvanese, D., McGuinness, D., Patel-Schneider, P., and Nardi, D. (2003). The Description Logic Handbook: Theory, Implementation and Applications, Cambridge University Press.
45. Cowell, R.G., Dawid, A.P., Lauritzen, S.L., and Spiegelhalter, D.J. (2007). Probabilistic Networks and Expert Systems, Springer.
46. Learning credible DNNs via incorporating prior knowledge and model local explanation10.1007/s10115-020-01517-5 ↗
47. Diligenti, M., Roychowdhury, S., and Gori, M. (2017, January 18–21). Integrating prior knowledge into deep learning. Proceedings of the 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA), Cancun, Mexico.10.1109/ICMLA.2017.00-37 ↗
48. Incorporating prior information in machine learning by creating virtual examples10.1109/5.726787 ↗
49. Borg, M., Englund, C., Wnuk, K., Duran, B., Levandowski, C., Gao, S., Tan, Y., Kaijser, H., Lönn, H., and Törnqvist, J. (2018). Safely entering the deep: A review of verification and validation for machine learning and a challenge elicitation in the automotive industry. arXiv.10.2991/jase.d.190131.001 ↗
50. Greydanus, S., Dzamba, M., and Yosinski, J. (2019). Hamiltonian Neural Networks. arXiv.
51. Medical artificial intelligence: The European legal perspective10.1145/3458652 ↗
52. The Ten Commandments of ethical medical AI10.1109/MC.2021.3074263 ↗