A Lightweight Knowledge-Distillation-Based Model for the Detection and Classification of Impacted Mandibular Third Molars
Source abstract
Abstract
The extraction of impacted third molars is one of the most common dental operations. When the impacted third molar is extracted, the operation plan is generally different because of the different impacted positions of the tooth. Therefore, judging the impacted type of the third molar is the basis of the third molar extraction operation. At present, oral health professionals usually analyze panoramic radiographs to determine the types of impacted third molars, but the diagnosis is easily affected by oral health professionals’ subjective consciousnesses. Computer vision technology can help doctors analyze medical images faster and more accurately, so it is very desirable to use computer vision to detect and classify the impacted third molars. Based on the panoramic radiographs of the School of Stomatology, Lanzhou University, this paper establishes an object detection dataset containing six types of impacted third molars. On the basis of this dataset, the lightweight third molar impacted detection and classification model is studied in this paper. This study introduces the method of knowledge distillation on the basis of YOLOv5s and uses YOLOv5x as the teacher’s model to guide YOLOv5s, which not only ensures the light weight of the model but also improves the accuracy of the model. Finally, the YOLOv5s-x model is obtained. The experimental results show that the introduction of knowledge distillation effectively improves the accuracy of the model while ensuring its light weight, the mAP of YOLOv5s-x is increased by 2.9% compared with the original model, and the amount of parameters and calculations is also reduced to a certain extent. Compared with mainstream object detection networks, including YOLOv8, YOLOv5s-x also has certain advantages, which can provide oral health professionals with better impacted third molar detection and classification services.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Dental Radiography and Imaging · AI in cancer detection · Dental Research and COVID-19
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Stomatology, Lanzhou University, Lanzhou 730030, China
College of Information and Electrical Engineering, China Agricultural University, Beijing 100193, China
College of Information Engineering, Sichuan Agricultural University, Ya’an 625014, China
Funding
Gansu Science and Technology Foundation Oral Disease Clinical Research Center · Clinical Research Foundation of Western Stomatology of Chinese Stomatological Association
References (29)
Show source-provided references
1. The unresolved problem of the third molar: Would people be better off without it?10.14219/jada.archive.2003.0194 ↗
2. Evaluation of the agreement by examiners according to classifications of third molars10.4317/medoral.17483 ↗
3. Impacted wisdom teeth
4. Assessment of different patterns of impacted mandibular third molars and their associated pathologies
5. Prevalence of impacted mandibular and maxillary third molars: A radiographic study in patients reporting Madina teaching hospital, Faisal abad
6. Third molar impaction and agenesis: A review
7. Comparative study of third molar impaction in rural and urban areas of South-Western Nigeria
8. Prevalence of impacted teeth and associated pathology in middle-aged and older Swedish women10.1111/j.1600-0528.1991.tb00124.x ↗
9. Adjacent tooth trauma in complicated mandibular third molar surgery: Risk degree classification and digital surgical simulation10.1038/srep39126 ↗
10. Complication in third molar extractions
11. Prevention of iatrogenic inferior alveolar nerve injuries in relation to dental procedures
12. A proposal for the Dartmouth summer research project on artificial intelligence, August 31, 1955
13. Deep learning: A primer for dentists and dental researchers10.1016/j.jdent.2023.104430 ↗
14. Artificial Intelligence in Medicine and Dentistry10.15644/asc57/1/8 ↗
15. Multi-class disease detection using deep learning and human brain medical imaging10.1016/j.bspc.2023.104875 ↗
16. COVIDiagnosis-Net: Deep Bayes-SqueezeNet based diagnosis of the coronavirus disease 2019 (COVID-19) from X-ray images10.1016/j.mehy.2020.109761 ↗
17. da Silva Rocha, É., and Endo, P.T. (2022). A Comparative Study of Deep Learning Models for Dental Segmentation in Panoramic Radiograph. Appl. Sci., 12.10.20944/preprints202202.0354.v1 ↗
18. Celik, M.E. (2022). Deep Learning Based Detection Tool for Impacted Mandibular Third Molar Teeth. Diagnostics, 12.10.3390/diagnostics12040942 ↗
19. Winter, G. (1926). Impacted Mandibular Third Molars, American Medical Book Co.
20. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
21. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
22. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
23. Bochkovskiy, A., Wang, C.Y., and Liao HY, M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv.
24. Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., and Nie, W. (2022). YOLOv6: A single-stage object detection framework for industrial applications. arXiv.
25. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2023, January 18–22). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
26. Terven, J., and Cordova-Esparza, D. (2023). A comprehensive review of YOLO: From YOLOv1 to YOLOv8 and beyond. arXiv.
27. Face recognition of a Lorisidae species based on computer vision10.1016/j.gecco.2023.e02511 ↗
28. Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv.
29. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23–28). End-to-end object detection with transformers. Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK. Part I 16.10.1007/978-3-030-58452-8_13 ↗