Innovative Guardrails for Generative AI: Designing an Intelligent Filter for Safe and Responsible LLM Deployment
Source abstract
Abstract
This paper proposes a technological framework designed to mitigate the inherent risks associated with the deployment of artificial intelligence (AI) in decision-making and task execution within the management processes. The Agreement Validation Interface (AVI) functions as a modular Application Programming Interface (API) Gateway positioned between user applications and LLMs. This gateway architecture is designed to be LLM-agnostic, meaning it can operate with various underlying LLMs without requiring specific modifications for each model. This universality is achieved by standardizing the interface for requests and responses and applying a consistent set of validation and enhancement processes irrespective of the chosen LLM provider, thus offering a consistent governance layer across a diverse LLM ecosystem. AVI facilitates the orchestration of multiple AI subcomponents for input–output validation, response evaluation, and contextual reasoning, thereby enabling real-time, bidirectional filtering of user interactions. A proof-of-concept (PoC) implementation of AVI was developed and rigorously evaluated using industry-standard benchmarks. The system was tested for its effectiveness in mitigating adversarial prompts, reducing toxic outputs, detecting personally identifiable information (PII), and enhancing factual consistency. The results demonstrated that AVI reduced successful fast injection attacks by 82%, decreased toxic content generation by 75%, and achieved high PII detection performance (F1-score ≈ 0.95). Furthermore, the contextual reasoning module significantly improved the neutrality and factual validity of model outputs. Although the integration of AVI introduced a moderate increase in latency, the overall framework effectively enhanced the reliability, safety, and interpretability of LLM-driven applications. AVI provides a scalable and adaptable architectural template for the responsible deployment of generative AI in high-stakes domains such as finance, healthcare, and education, promoting safer and more ethical use of AI technologies.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Simulation Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Industrial Management, Korea University of Technology and Education (KOREATECH), Cheonan-si 31254, Republic of Korea
Funding
Korea government (MSIT) · Educational Research Promotion Project
References (70)
Show source-provided references
1. Anthropic (2025, February 01). Claude: Constitutional AI and Alignment. Available online: https://www.anthropic.com.
2. Bender, E.M., Gebru, T., McMillan-Major, A., and Shmitchell, S. (2021, January 3–10). On the dangers of stochastic parrots. Proceedings of the FAccT ‘21: 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event.10.1145/3442188.3445922 ↗
3. Brown, T., Mann, B., and Ryder, N. (2020, January 6–12). Language models are few-shot learners. Proceedings of the 34th International Conference on Neural Information Processing Systems, Vancouver, BC, Canada.
4. Carlini, N., Tramer, F., and Wallace, E. (2021, January 11–13). Extracting training data from large language models. Proceedings of the USENIX Security Symposium, Vancouver, BC, Canada.
5. Holistic AI (2025, April 03). AI Governance and Safety Solutions. Available online: https://www.holisticai.com.
6. Survey of hallucination in natural language generation10.1145/3571730 ↗
7. Kandaswamy, R., Kumar, S., and Qiu, L. (2021, January 1–6). Toxicity Detection in Open-Domain Dialogue. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics (ACL 2021), Bangkok, Thailand. Available online: https://aclanthology.org/2021.acl-long.25.
8. Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., and Rocktäschel, T. (2020, January 6–12). Retrieval-augmented generation for knowledge-intensive NLP tasks. Proceedings of the 34th International Conference on Neural Information Processing Systems, Vancouver, BC, Canada.
9. LLM-AE-MP: Web attack detection using a large language model with adversarial examples and multi-prompting
10. Oguz, B., Zeng, W., Hou, L., Karpukhin, V., Sen, P., Chang, Y., Yih, W., Mehdad, Y., and Gupta, S. (2022, January 7–11). Domain-specific grounding for safety and factuality. Proceedings of the EMNLP Finding, Abu Dhabi, United Arab Emirates.
11. OpenAI (2023). GPT-4 technical report. arXiv.
12. European Union (2016). Regulation
13. (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data (General Data Protection Regulation). Off. J. Eur. Union, L119, 1-88. Available online: https://eur-lex.europa.eu/eli/reg/2016/679/oj.
14. Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C.L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., and Ray, A. (2022). Training Language Models to Follow Instructions with Human Feedback. arXiv.
15. Rae, J.W., Borgeaud, S., Cai, T., Millican, K., Hoffmann, J., Song, H.F., Aslanides, J., Henderson, S., Ring, R., and Young, S. (2021). Scaling Language Models: Methods, Analysis & Insights from Training Gopher. arXiv.
16. Ethics-aware language generation
17. Metz, C. (2024, September 13). What Should ChatGPT Tell You? It Depends, The New York Times, Available online: https://www.nytimes.com/2023/03/08/technology/chatbots-disrupt-internet-industry.html?searchResultPosition=3.
18. Brown, T.B., Mann, B., Ryder, N., and Subbiah, M. (2020). Language Models are Few-Shot Learners. arXiv.
19. Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Huang, P.-S., Uesato, J., and Gabriel, I. (2021). Ethical and Social Risks of Harm from Language Models. arXiv.
20. Dixon, L., Li, J., Sorensen, J., Thain, N., and Vasserman, L. (2018, January 2–3). Measuring and mitigating unintended bias in text classification. Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society, New Orleans, LA, USA.10.1145/3278721.3278729 ↗
21. Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., Van Den Driessche, G., Lespiau, J.-B., Damoc, B., and Clark, A. (2022, January 17–23). Improving Language Models by Retrieving from Trillions of Tokens. Proceedings of the 39th International Conference on Machine Learning (ICML 2022), Baltimore, MD, USA. Available online: https://proceedings.mlr.press/v162/borgeaud22a.html.
22. Feretzakis, G., Papaspyridis, K., Gkoulalas-Divanis, A., and Verykios, V.S. (2024). Privacy-Preserving Techniques in Generative AI and Large Language Models: A Review. Information, 15.10.3390/info15110697 ↗
23. Assessing the Guidelines on the Use of Generative Artificial Intelligence Tools in Higher Education: A Global Perspective
24. Mylrea, M., and Robinson, N. (2023). Artificial Intelligence Trust Framework and Maturity Model: An Entropy-Based Approach. Entropy, 25.10.3390/e25101429 ↗
25. Get your vitamin C! Robust fact verification
26. Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., and Azhar, F. (2023). LLaMA: Open and efficient foundation language models. arXiv.
27. Zhou, M., Zhang, L., and Zhao, W. (2023, January 25). PromptArmor: Robustness-enhancing middleware for LLMs. Proceedings of the IEEE S&P Workshops, San Francisco, CA, USA.
28. Izacard, G., and Grave, É. (2021, January 19–23). Leveraging passage retrieval with generative models for open domain question answering. Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2021), Online.10.18653/v1/2021.eacl-main.74 ↗
29. Ogunleye, B., Zakariyyah, K.I., Ajao, O., Olayinka, O., and Sharma, H. (2024). A Systematic Review of Generative AI for Teaching and Learning Practice. Educ. Sci., 14.10.3390/educsci14060636 ↗
30. Microsoft Report (2024, December 09). What Is Responsible AI?. Microsoft Support, Available online: https://support.microsoft.com/en-us/topic/what-is-responsible-ai-33fc14be-15ea-4c2c-903b-aa493f5b8d92.
31. Machine learning with contextual integrity
32. The law of AI transparency
33. ChatGPT for good? On opportunities and challenges of large language models for education
34. Krafft, P.M., Young, M., and Katell, M. (2020, January 7–9). Defining AI in policy versus practice. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW2), New York, NY, USA.
35. Generative Artificial Intelligence and the Evolving Challenge of Deepfakes: A Review
36. Raji, I.D., Smart, A., White, R.N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., and Barnes, P. (2020, January 27–30). Closing the AI accountability gap: Defining responsibility for harm in machine learning. Proceedings of the 2020 FAT Conference, Barcelona, Spain.10.1145/3351095.3372873 ↗
37. Demystifying the draft EU Artificial Intelligence Act10.9785/cri-2021-220402 ↗
38. Marcus, G., and Davis, E. (2020). Transparency: Motivations and challenges. Rebooting AI: Building Artificial Intelligence We Can Trust, Pantheon.
39. European Commission (2025, May 01). Proposal for a Regulation Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act). Publications Office of the European Union., Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A52021PC0206.
40. Competition-level code generation with AlphaCode10.1126/science.abq1158 ↗
41. AI safety for everyone
42. Bowman, S.R., Angeli, G., Potts, C., and Manning, C.D. (2015, January 17–21). A large annotated corpus for learning natural language inference. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP), Lisbon, Portugal.10.18653/v1/D15-1075 ↗
43. Decentralized Learning in the Era of Foundation Models: A Practical Perspective
44. Differentially Private Deep Learning: A Survey on Techniques and Applications
45. Homomorphic Encryption for Data Security in Cloud: State-of-the-Art and Research Challenges. Comput
46. Reimers, N., and Gurevych, I. (2019, January 3–7). Sentence-BERT: Sentence embeddings using Siamese BERT-networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing, Hong Kong, China.10.18653/v1/D19-1410 ↗
47. Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q.V., and Zhou, D. (December, January 28). Chain-of-thought prompting elicits reasoning in large language models. Proceedings of the 36th International Conference on Neural Information Processing Systems, New Orleans, LA, USA.
48. Reimers, N., and Gurevych, I. (2025, May 15). Sentence Transformers: Multilingual Sentence, Paragraph, and Image Embeddings. Available online: https://www.sbert.net/.
49. Gehman, S., Gururangan, S., Sap, M., Choi, Y., and Smith, N.A. (2020). RealToxicityPrompts: Evaluating neural toxic degeneration in language models. Findings of the Association for Computational Linguistics: EMNLP 2020, Association for Computational Linguistics.10.18653/v1/2020.findings-emnlp.301 ↗
50. Zhang, M., Tandon, S., and Liu, Q. (2022, January 23–26). Prompt Chaining Attacks on Language Models. Proceedings of the 43rd IEEE Symposium on Security and Privacy, San Francisco, CA, USA.
51. Privacy considerations in large language models: A survey
52. Wang, Z., Zhu, R., Zhou, D., Zhang, Z., Mitchell, J., Tang, H., and Wang, X. (2021, January 15–19). DPAdapter: Improving Differentially Private Deep Learning through Noise Tolerance Pre-training. Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security, Virtual.
53. Badawi, A., Melis, L., Ricotti, A., Gascón, A., and Vitali, F. (2022, January 24–28). Privacy-Preserving Neural Network Inference with Fully Homomorphic Encryption for Transformer-based Models. Proceedings of the NDSS, San Diego, CA, USA.
54. Parisi, L., Zanella, M., and Gennaro, R. (2023, January 26–30). Efficient Hybrid Homomorphic Encryption for Large-Scale Transformer Architectures. Proceedings of the 30th ACM Conference on Computer and Communications Security (CCS), Copenhagen, Denmark.
55. Trusted Execution Environments for Neural Model Confidentiality: A Practical Assessment of Enclave-Based Solutions
56. Lee, J., Kim, H., and Eldefrawy, K. (2022). Multi-Party Computation for Large-Scale Language Models: Challenges and Solutions. Financial Cryptography and Data Security (FC), Springer.
57. Kalodanis, K., Rizomiliotis, P., Feretzakis, G., Papapavlou, C., and Anagnostopoulos, D. (2025). High-Risk AI Systems. Future Internet, 17.10.3390/fi17010026 ↗
58. Zhang, B., and Liu, T.X. (December, January 28). Empirical Analysis of Large-Scale Language Models for Data Privacy. Proceedings of the NeurIPS, New Orleans, LA, USA.
59. A Survey on Secure and Private AI for Next-Generation NLP
60. He, C., Li, S., So, J., Zhang, M., Wang, H., Wang, X., Vepakomma, P., Singh, A., Qiu, H., and Shen, L. (2023, January 23–29). FedML-HE: An efficient homomorphic-encryption-based privacy-preserving federated learning system. Proceedings of the 40th International Conference on Machine Learning (ICML 2023), Honolulu, HI, USA. Available online: https://proceedings.mlr.press/v202/he23a.html.
61. Nasr, M., Shokri, R., and Houmansadr, A. (2021, January 12–16). Comprehensive privacy analysis of deep learning: Stand-alone and federated learning under passive and active white-box inference attacks. Proceedings of the Privacy Enhancing Technologies, Online.
62. Jigsaw & Google Counter Abuse Technology Team (2025, May 04). Perspective API: A Free API to Detect Toxicity in Online Conversations. Available online: https://www.perspectiveapi.com.
63. European Union (2024). Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence and amending Regulations (EC) No 300/2008, (EU) No 167/2013, (EU) No 168/2013, (EU) 2018/858, (EU) 2018/1139 and (EU) 2019/2144 and Directives 2014/90/EU, (EU) 2016/797 and (EU) 2020/1828 (Artificial Intelligence Act). Off. J. Eur. Union, L2024/1689, Available online: https://eur-lex.europa.eu/eli/reg/2024/1689/oj.
64. Salavi, R., Math, M.M., and Kulkarni, U.P. (2022). A Comprehensive Survey of Fully Homomorphic Encryption from Its Theory to Applications. Cyber Security and Digital Forensics: Challenges and Future Trends, Wiley.10.1002/9781119795667.ch4 ↗
65. Speech emotion recognition based on Graph-LSTM neural network
66. Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H.B., Patel, S., Ramage, D., Segal, A., and Seth, K. (November, January 30). Practical Secure Aggregation for Privacy-Preserving Machine Learning. Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security, Dallas, TX, USA.10.1145/3133956.3133982 ↗
67. Yin, D., Chen, Y., Kannan, R., and Bartlett, P.L. (2019, January 9–15). Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates. Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA.
68. Marshall, D., and Liu, T. (2022, January 24–28). Security-as-Code: Continuous Integration Strategies for Privacy-Preserving AI. Proceedings of the Network and Distributed System Security Symposium (NDSS), San Diego, CA, USA.
69. Multicriterial approach to investment projects’ estimation under risk conditions
70. Shvetsova, O.A. (2019). Technology Management in International Entrepreneurship: Innovative Development and Sustainability, Nova Publishing.10.52305/JVLR2758 ↗