journal article·2025-11-12Open access

Development and Evaluation of a Next-Generation Medication Safety Support System Based on AI and Mixed Reality: A Study from South Korea

Nathan Lucien Vieira, Su Jin Kim, Sangah Ahn, Ji Sim Yoon, Sook Hyun Park, Jeong Hee Hong, Min-Jeoung Kang, Il Kim, Meong Hi Son, Won Chul Cha, Junsang Yoo

Applied Sciences· Volume 15· Issue 22

Abstract

Medication errors pose a significant threat to patient safety. Although Bar-Code Medication Administration (BCMA) has reduced error rates, it is constrained by handheld devices, workflow interruptions, and incomplete safeguards against wrong patients, wrong doses, or drug incompatibility. In this study, we developed and evaluated a next-generation BCMA system by integrating artificial intelligence and mixed reality technologies for real-time safety checks: Optical Character Recognition verifies medication–label concordance, facial recognition confirms patient identity, and a rules engine evaluates drug–diluent compatibility. Computer vision models achieved high recognition accuracy for drug vials (100%), medication labels (90%), QR codes (90%), and patient faces (90%), with slightly lower performance for intravenous fluids (80%). A mixed-methods evaluation was conducted in a simulated environment using the System Usability Scale (SUS), Reduced Instructional Materials Motivation Survey (RIMMS), Virtual Reality Sickness Questionnaire (VRSQ), and NASA Task Load Index (NASA-TLX). The results indicated excellent usability (median SUS = 82.5/100), strong user motivation (RIMMS = 3.7/5), minimal cybersickness (VRSQ = 0.4/6), and manageable cognitive workload (NASA-TLX = 31.7/100). Qualitative analysis highlighted the system’s potential to streamline workflow and serve as a digital “second verifier.” These findings suggest strong potential for clinical integration, enhancing medication safety at the point of care.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Patient Safety and Medication Errors · Electronic Health Records Systems · Artificial Intelligence in Healthcare and Education

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Digital Health, Samsung Advanced Institute for Health Sciences & Technology (SAIHST), Sungkyunkwan University, Seoul 06355, Republic of Korea

Department of Nursing, Samsung Medical Center, Seoul 06355, Republic of Korea

Graduate School of Clinical Nursing Science, Sungkyunkwan University, Suwon 16419, Republic of Korea

Department of Medicine, Division of General Internal Medicine, Brigham and Women’s Hospital, Boston, MA 02115, USA

Harvard Medical School, Boston, MA 02115, USA

SurgicalMind Inc., Gwangju 61962, Republic of Korea

Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul 06351, Republic of Korea

Digital Innovation, Samsung Medical Center, Seoul 06351, Republic of Korea

Funding

the Ministry of Health and Welfare, Republic of Korea

References (28)

Show source-provided references
1. Tariq, R.A., Vashisht, R., Sinha, A., and Scherbak, Y. (2025, July 02). Medication dispensing errors and prevention, StatPearls, Available online: https://www.ncbi.nlm.nih.gov/books/NBK519065/.
2. Kohn, L.T., Corrigan, J.M., and Donaldson, M.S. (2000). To Err Is Human: Building a Safer Health System, National Academies Press.
3. World Health Organization (2025, July 02). Medication Without Harm. Available online: https://www.who.int/initiatives/medication-without-harm.
4. Ministry of Health and Welfare, and Korea Institute for Healthcare Accreditation (2024). Korean Patient Safety Incident Report 2023, Korea Institute for Healthcare Accreditation. Available online: http://www.kops.or.kr.
5. Effect of Bar-Code Technology on the Safety of Medication Administration10.1056/NEJMsa0907115 ↗
6. Medication Errors and Considerations Related to Injectable Drugs
7. Impact on Use of Barcode Scanners in Medication Administration: An Integrative Review
8. Workarounds to Barcode Medication Administration Systems: Their Occurrences, Causes, and Threats to Patient Safety10.1197/jamia.M2616 ↗
9. The potential of artificial intelligence to improve patient safety: A scoping review10.1038/s41746-021-00423-6 ↗
10. Augmented Reality in Medicine: Systematic and Bibliographic Review10.2196/10967 ↗
11. Alowais, S.A., Alghamdi, S.S., Alsuhebany, N., Alqahtani, T., Alshaya, A.I., Almohareb, S.N., Aldairem, A., Alrashed, M., Bin Saleh, K., and Badreldin, H.A. (2023). Revolutionizing Healthcare: The Role of Artificial Intelligence in Clinical Practice. BMC Med. Educ., 23.10.1186/s12909-023-04698-z ↗
12. Huo, Y., Gang, S., and Guan, C. (2023). FCIHMRT: Feature Cross-Layer Interaction Hybrid Method Based on Res2Net and Transformer for Remote Sensing Scene Classification. Electronics, 12.10.3390/electronics12204362 ↗
13. Ankam, V.S.S., Hong, G.Y., and Fong, A.C. (2024). Design of a Mixed-Reality Application to Reduce Pediatric Medication Errors in Prehospital Emergency Care. Appl. Sci., 14.10.3390/app14188426 ↗
14. Palumbo, A. (2022). Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects. Sensors, 22.10.3390/s22207709 ↗
15. Microsoft (2025, July 10). Mixed Reality Toolkit 3 (MRTK3) Overview. Microsoft Learn: Updated 10 February 2025. Available online: https://learn.microsoft.com/ko-kr/windows/mixed-reality/mrtk-unity/mrtk3-overview/.
16. Strecker, J., García, K., Bektaş, K., Mayer, S., and Ramanathan, G. (2023, January 6–8). SOCRAR: Semantic OCR through Augmented Reality. Proceedings of the ACM International Conference, Lisbon, Portugal.
17. NAVER Cloud Corporation (2025, July 02). CLOVA OCR Overview. NAVER Cloud Platform Guide., Available online: https://guide.ncloud-docs.com/docs/clovaocr-overview.
18. Ageitgey (2025, March 13). Face_Recognition: The World’s Simplest Facial Recognition API for Python and the Command Line. Available online: https://github.com/ageitgey/face_recognition.
19. ARTHUR: Authoring Human–Robot Collaboration Processes with Augmented Reality Using Hybrid User Interfaces10.1007/s10055-025-01149-6 ↗
20. SUS: A quick and dirty usability scale
21. Validation of the Instructional Materials Motivation Survey (IMMS) in a Self-Directed Instructional Setting Aimed at Working with Technology10.1111/bjet.12138 ↗
22. Virtual Reality Sickness Questionnaire (VRSQ): Motion Sickness Measurement Index in a Virtual Reality Environment10.1016/j.apergo.2017.12.016 ↗
23. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research10.1016/S0166-4115(08)62386-9 ↗
24. An Empirical Evaluation of the System Usability Scale10.1080/10447310802205776 ↗
25. Implementing a Theory-Driven Gamification Model in Higher Education Flipped Courses: Effects on Out-of-Class Activity Completion and Quality of Artifacts10.1016/j.compedu.2018.06.018 ↗
26. Johnston, M., O’Mahony, M., O’Brien, N., Connolly, M., Iohom, G., Kamal, M., Shehata, A., and Shorten, G. (2024). The Feasibility and Usability of Mixed Reality Teaching in a Hospital Setting Based on Self-Reported Perceptions of Medical Students. BMC Med. Educ., 24.10.1186/s12909-024-05591-z ↗
27. Connolly, M., Iohom, G., O’Brien, N., Volz, J., O’Muircheartaigh, A., Serchan, P., Biculescu, A., Gadre, K.G., Soare, C., and Griseto, L. (2024). Delivering Clinical Tutorials to Medical Students Using the Microsoft HoloLens 2: A Mixed-Methods Evaluation. BMC Med. Educ., 24.10.1186/s12909-024-05475-2 ↗
28. Fully Immersive Learning with Virtual Reality for Assessing Students in Art History10.1007/s10055-023-00920-x ↗