journal article·2024Open access

Assessor Feedback Mechanism for Machine Learning Model

Musulmon Lolaev, Anand Paul, Jeonghong Kim

Computers, Materials & Continua· Volume 81· Issue 3

Abstract

Evaluating artificial intelligence (AI) systems is crucial for their successful deployment and safe operation in real-world applications. The assessor meta-learning model has been recently introduced to assess AI system behav... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Neural Networks and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (27)

Show source-provided references
1. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
2. J. Li, “Recent advances in end-to-end automatic speech recognition,” 2022, arXiv:2111.01690.10.1561/116.00000050 ↗
3. Neural machine translation: A review and survey10.1613/jair.1.12007 ↗
4. Sentiment analysis using product review data10.1186/s40537-015-0015-2 ↗
5. D. Dasgupta, D. Venugopal, and K. Gupta, “A review of generative ai from historical perspectives,” 2023. doi: 10.36227/techrxiv.22097942.10.36227/techrxiv.22097942.v1 ↗
6. D. Amodei, O. Christopher, J. Steinhardt, P. Christiano, J. Schulman and D. Manê, “Concrete problems in AI safety,” 2016, arXiv:1606.06565.
7. Training on the test set: Mapping the system-problem space in ai
8. AI safety: State of the field through quantitative lens
9. Interpreting adversarial examples in deep learning: A review10.1145/3594869 ↗
10. Adversarial examples in the physical world
11. Adversarial attack and defense: A survey10.3390/electronics11081283 ↗
12. L. Schwinn, D. Dobre, S. Günnemann, and G. Gidel, “Adversarial attacks and defenses in large language models: Old and new threats,” 2023, arXiv:2310.19737.
13. When AI difficulty is easy: The explanatory power of predicting IRT difficulty
14. O. Wiles et al., “A fine grained analysis on distribution shift,” 2021, arXiv:2110.11328.
15. T. Fujimoto, J. Suetterlein, S. Chatterjee, and A. Ganguly, “Assessing the impact of distribution shift on reinforcement learning performance,” 2024, arXiv:2402.03590.
16. Bridle · Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition · 1990
17. Black-box adversarial attacks in autonomous vehicle technology
18. Fabra-Boluda · EBeM’22: Workshop on AI Evaluation Beyond Metrics · Jul. 25, 2022 · 107
19. An instance level analysis of data complexity10.1007/s10994-013-5422-z ↗
20. Auto-WEKA: Combined selection and hyperparameter optimization of classification algorithms
21. Hutter · Challenges in Machine Learning · 2019
22. Item response theory based ensemble in machine learning10.1007/s11633-020-1239-y ↗
23. Oliveira · EBeM’22: Workshop on AI Evaluation Beyond Metrics · Jul. 25, 2022 · 107
24. Zhou · EBeM’22: Workshop on AI Evaluation Beyond Metrics · Jul. 25, 2022 · 107
25. Corbière · Addressing Failure Prediction by Learning Model Confidence · 2019
26. Buza · Data Analysis, Machine Learning and Knowledge Discovery · Aug. 2021 · 145
27. D. Dua and C. Graff, “UCI machine learning repository,” Accessed: Nov. 17, 2024. [Online]. Available: https://archive.ics.uci.edu/