Deep Learning Model-Based Real-Time Inspection System for Foreign Particles inside Flexible Fluid Bags
Source abstract
Abstract
Intravenous fluid bags are essential in hospitals, but foreign particles can contaminate them during mass production, posing significant risks. Although produced in sanitary environments, contamination can cause severe problems if products reach consumers. Traditional inspection methods struggle with the flexible nature of these bags, which deform easily, complicating particle detection. Recent deep learning advancements offer promising solutions in regard to quality inspection, but high-resolution image processing remains challenging. This paper introduces a real-time deep learning-based inspection system addressing bag deformation and memory constraints for high-resolution images. The system uses object-level background rejection, filtering out objects similar to the background to isolate moving foreign particles. To further enhance performance, the method aggregates object patches, reducing unnecessary data and preserving spatial resolution for accurate detection. During aggregation, candidate objects are tracked across frames, forming tracks re-identified as bubbles or particles by the deep learning model. Ensemble detection results provide robust final decisions. Experiments demonstrate that this system effectively detects particles in real-time with over 98% accuracy, leveraging deep learning advancements to tackle the complexities of inspecting flexible fluid bags.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Advanced Neural Network Applications · Currency Recognition and Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Micro-Degree College, Shinhan University, 95, Hoam-ro, Uijeongbu-si 11644, Republic of Korea
Department of Smart Electrical and Electronics, Kwangwoon University, 20, Gwangun-ro, Nowon-gu, Seoul 01897, Republic of Korea
References (23)
Show source-provided references
1. Particulate Matter in Injectable Drug Products10.5731/pdajpst.2013.00922 ↗
2. Infantile Pulmonary Hypertension Associated with Foreign Body Vasculitis10.1093/ajcp/75.4.609 ↗
3. Plastic Particle Migration During Intravenous Infusion Assisted by a Peristaltic Finger Pump in an Animal Model10.1007/s00383-002-0810-7 ↗
4. The Potential Clinical Relevance of Visible Particles in Parenteral Drugs10.1002/jps.23217 ↗
5. Automated Machine Vision System for Liquid Particle Inspection of Pharmaceutical Injection10.1109/TIM.2018.2800258 ↗
6. Camera as the Instrument: The Rising Trend of Vision Based Measurement10.1109/MIM.2014.6825388 ↗
7. Ishii, A., Mizuta, T., and Todo, S. (1998, January 20). Detection of Foreign Substances Mixed in a Plastic Bottle of Medicinal Solution Using Real-time Video Image Processing. Proceedings of the Fourteenth International Conference on Pattern Recognition, Brisbane, QLD, Australia.
8. Shi, X., Tang, Z., Wang, Y., Xie, H., and Xu, L. (2022). HOG-SVM Impurity Detection Method for Chinese Liquor (Baijiu) Based on Adaptive GMM Fusion Frame Difference. Foods, 11.10.3390/foods11101444 ↗
9. Detection of Foreign Matter in Transfusion Solution Based on Gaussian Background Modeling and an Optimized BP Neural Network10.3390/s141119945 ↗
10. Kappeler, A., Katsaggelos, A.K., Bertos, G.A., Ashline, K.A., and Zupec, N.A. (2015). Visual Inspection System for Automated Detection of Particulate Matter in Flexible Medical Containers. (20150213616A1), U.S. Patent.
11. A system for Automated Detection of Ampoule Injection Impurities10.1109/TASE.2015.2490061 ↗
12. A Vision-based Intelligent Inspector for Wine Production10.1007/s13042-011-0051-y ↗
13. Feng, M., Wang, Y., and Wu, C. (2015, January 24–27). Foreign Particle Inspection for Infusion Fluids via Robust Dictionary Learning. Proceedings of the 10th International Conference on Intelligent Systems and Knowledge Engineering, ISKE 2015, Taipei, Taiwan.10.1109/ISKE.2015.62 ↗
14. Pharmaceutical Foreign Particle Detection: An Efficient Method Based on Adaptive Convolution and Multiscale Attention10.1109/TETCI.2022.3160702 ↗
15. A Novel Approach for Foreign Substances Detection in Injection Using Clustering and Frame Difference10.3390/s111009121 ↗
16. A Deep Learning-Based Framework for Visual Inspection of Plastic Bottles10.1109/ACCESS.2023.3329565 ↗
17. Deep Learning for Automatic Vision-Based Recognition of Industrial Surface Defects: A Survey10.1109/ACCESS.2023.3271748 ↗
18. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
19. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11–14). SSD: Single Shot MultiBox Detector. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
20. Huang, B., Liu, J., Zhang, Q., Liu, K., Liu, X., and Wang, J. (2023). Improved Faster R-CNN Network for Liquid Bag Foreign Body Detection. Processes, 11.10.3390/pr11082364 ↗
21. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
22. Bewley, A., Ge, Z., Ott, L., Ramos, F.T., and Upcroft, B. (2016, January 25–28). Simple Online and Realtime Tracking. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7533003 ↗
23. Wojke, N., Bewley, A., and Paulus, D. (2017, January 17–20). Simple Online and Realtime Tracking with a Deep Association Metric. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.10.1109/ICIP.2017.8296962 ↗