journal article·2023-07-06Open access

Teeth Segmentation in Panoramic Dental X-ray Using Mask Regional Convolutional Neural Network

Giulia Rubiu, Marco Bologna, Michaela Cellina, Maurizio Cè, Davide Sala, Roberto Pagani, Elisa Mattavelli, Deborah Fazzini, Simona Ibba, Sergio Papa, Marco Alì

Applied Sciences· Volume 13· Issue 13

Abstract

Background and purpose: Accurate instance segmentation of teeth in panoramic dental X-rays is a challenging task due to variations in tooth morphology and overlapping regions. In this study, we propose a new algorithm, for instance, segmentation of the different teeth in panoramic dental X-rays. Methods: An instance segmentation model was trained using the architecture of a Mask Region-based Convolutional Neural Network (Mask-RCNN). The data for the training, validation, and testing were taken from the Tuft dental database (1000 panoramic dental radiographs). The number of the predicted label was 52 (20 deciduous and 32 permanent). The size of the training, validation, and test sets were 760, 190, and 70 images, respectively, and the split was performed randomly. The model was trained for 300 epochs, using a batch size of 10, a base learning rate of 0.001, and a warm-up multistep learning rate scheduler (gamma = 0.1). Data augmentation was performed by changing the brightness, contrast, crop, and image size. The percentage of correctly detected teeth and Dice in the test set were used as the quality metrics for the model. Results: In the test set, the percentage of correctly classified teeth was 98.4%, while the Dice score was 0.87. For both the left mandibular central and lateral incisor permanent teeth, the Dice index result was 0.91 and the accuracy was 100%. For the permanent teeth right mandibular first molar, mandibular second molar, and third molar, the Dice indexes were 0.92, 0.93, and 0.78, respectively, with an accuracy of 100% for all three different teeth. For deciduous teeth, the Dice indexes for the right mandibular lateral incisor, right mandibular canine, and right mandibular first molar were 0.89, 0.91, and 0.85, respectively, with an accuracy of 100%. Conclusions: A successful instance segmentation model for teeth identification in panoramic dental X-ray was developed and validated. This model may help speed up and automate tasks like teeth counting and identifying specific missing teeth, improving the current clinical practice.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Dental Radiography and Imaging · Radiomics and Machine Learning in Medical Imaging · AI in cancer detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

SynbrAin S.r.l., Milan Operational Office, Via Bernardo Rucellai 10, 20162 Milan, Italy

Radiology Department, Fatebenefratelli Hospital, ASST Fatebenefratelli Sacco, Piazza Principessa Clotilde 3, 20121 Milan, Italy

Radiology Department, Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy

Emme Esse M.S. S.r.l., Via Privata Giuba 11, 20132 Milan, Italy

Department of Diagnostic Imaging and Stereotactic Radiosurgery, Centro Diagnostico Italiano, S.p.A., Via Saint Bon 20, 20147 Milan, Italy

Bracco Imaging S.p.A., Via Egidio Folli, 50, 20134 Milan, Italy

References (36)

Show source-provided references
1. The Orthopantomography-Its Basic Images10.2334/josnusd1959.15.44 ↗
2. Three-Dimensional Imaging Techniques: A Literature Review10.4103/1305-7456.126269 ↗
3. Diagnostic Imaging Modalities in Head and Neck Disease
4. Caloro, E., Cè, M., Gibelli, D., Palamenghi, A., Martinenghi, C., Oliva, G., and Cellina, M. (2023). Artificial Intelligence (AI)-Based Systems for Automatic Skeletal Maturity Assessment through Bone and Teeth Analysis: A Revolution in the Radiological Workflow?. Appl. Sci., 13.10.3390/app13063860 ↗
5. Forensic Genetics: Scope and Application from Forensic Odontology Perspective10.4103/jomfp.jomfp_341_21 ↗
6. Jader, G., Fontineli, J., Ruiz, M., Abdalla, K., Pithon, M., and Oliveira, L. (November, January 29). Deep Instance Segmentation of Teeth in Panoramic X-ray Images. Proceedings of the 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Paraná, Brazil.10.1109/SIBGRAPI.2018.00058 ↗
7. Automatic Detection and Classification of Radiolucent Lesions in the Mandible on Panoramic Radiographs Using a Deep Learning Object Detection Technique10.1016/j.oooo.2019.05.014 ↗
8. Application of a Fully Deep Convolutional Neural Network to the Automation of Tooth Segmentation on Panoramic Radiographs10.1016/j.oooo.2019.11.007 ↗
9. Deep Learning for Caries Lesion Detection in Near-Infrared Light Transillumination Images: A Pilot Study10.1016/j.jdent.2019.103260 ↗
10. A Survey on Deep Learning in Medical Image Analysis10.1016/j.media.2017.07.005 ↗
11. Irmici, G., Cè, M., Caloro, E., Khenkina, N., Della Pepa, G., Ascenti, V., Martinenghi, C., Papa, S., Oliva, G., and Cellina, M. (2023). Chest X-ray in Emergency Radiology: What Artificial Intelligence Applications Are Available?. Diagnostics, 13.10.3390/diagnostics13020216 ↗
12. State-of-the-Art Deep Learning in Cardiovascular Image Analysis10.1016/j.jcmg.2019.06.009 ↗
13. Convolutional Neural Networks for Dental Image Diagnostics: A Scoping Review10.1016/j.jdent.2019.103226 ↗
14. Cellina, M., Cè, M., Irmici, G., Ascenti, V., Khenkina, N., Toto-Brocchi, M., Martinenghi, C., Papa, S., and Carrafiello, G. (2022). Artificial Intelligence in Lung Cancer Imaging: Unfolding the Future. Diagnostics, 12.10.3390/diagnostics12112644 ↗
15. Cellina, M., Cè, M., Irmici, G., Ascenti, V., Caloro, E., Bianchi, L., Pellegrino, G., D’Amico, N., Papa, S., and Carrafiello, G. (2022). Artificial Intelligence in Emergency Radiology: Where Are We Going?. Diagnostics, 12.10.3390/diagnostics12123223 ↗
16. Bilgir, E., Bayrakdar, İ.Ş., Çelik, Ö., Orhan, K., Akkoca, F., Sağlam, H., Odabaş, A., Aslan, A.F., Ozcetin, C., and Kıllı, M. (2021). An Artifıcial Intelligence Approach to Automatic Tooth Detection and Numbering in Panoramic Radiographs. BMC Med. Imaging, 21.10.1186/s12880-021-00656-7 ↗
17. Automated Detection of Third Molars and Mandibular Nerve by Deep Learning10.1038/s41598-019-45487-3 ↗
18. Automatic Segmenting Teeth in X-Ray Images: Trends, a Novel Data Set, Benchmarking and Future Perspectives10.1016/j.eswa.2018.04.001 ↗
19. Wirtz, A., Mirashi, S.G., and Wesarg, S. (2018). Medical Image Computing and Computer Assisted Intervention, Proceedings of the MICCAI 2018: 21st International Conference, Granada, Spain, 16–20 September 2018, Springer International Publishing.
20. Koch, T.L., Perslev, M., Igel, C., and Brandt, S.S. (2019, January 8–11). Accurate Segmentation of Dental Panoramic Radiographs with U-NETS. Proceedings of the 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), Venice, Italy.10.1109/ISBI.2019.8759563 ↗
21. Kim, C., Kim, D., Jeong, H., Yoon, S.-J., and Youm, S. (2020). Automatic Tooth Detection and Numbering Using a Combination of a CNN and Heuristic Algorithm. Appl. Sci., 10.10.3390/app10165624 ↗
22. Tooth Detection and Numbering in Panoramic Radiographs Using Convolutional Neural Networks10.1259/dmfr.20180051 ↗
23. Tooth Detection and Classification on Panoramic Radiographs for Automatic Dental Chart Filing: Improved Classification by Multi-Sized Input Data10.1007/s11282-019-00418-w ↗
24. Artificial Intelligence-Driven Novel Tool for Tooth Detection and Segmentation on Panoramic Radiographs10.1007/s00784-020-03544-6 ↗
25. Tufts Dental Database: A Multimodal Panoramic X-Ray Dataset for Benchmarking Diagnostic Systems10.1109/JBHI.2021.3117575 ↗
26. (2023, May 20). Kaggle. Available online: https://www.kaggle.com/datasets/deepologylab/tufts-dental-database.
27. (2016). Dentistry—Designation System for Teeth and Areas of the Oral Cavity (Standard No. ISO 3950:2016). Available online: https://www.iso.org/standard/68292.html.
28. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
29. (2023, May 20). Github/Detectron2. Available online: https://github.com/facebookresearch/detectron2.
30. Application of Age Estimation Methods Based on Teeth Eruption: How Easy Is Olze Method to Use?10.1007/s00414-014-1006-0 ↗
31. Quantification of Odontological Differences of the Upper First and Second Molar by 3D-3D Superimposition: A Novel Method to Assess Anatomical Matches10.1007/s12024-019-00140-3 ↗
32. El Bsat, A.R., Shammas, E., Asmar, D., Sakr, G.E., Zeno, K.G., Macari, A.T., and Ghafari, J.G. (2022). Semantic Segmentation of Maxillary Teeth and Palatal Rugae in Two-Dimensional Images. Diagnostics, 12.10.3390/diagnostics12092176 ↗
33. Exploiting Multimodal CNN Architecture for Automated Teeth Segmentation on Dental Panoramic X-Ray Images10.1177/09544119231157137 ↗
34. Adnan, N., Khalid, W.B., and Umer, F. (2023). An Artificial Intelligence Model for Teeth Segmentation and Numbering on Orthopantomograms. Int. J. Comput. Dent.
35. Teeth U-Net: A Segmentation Model of Dental Panoramic X-Ray Images for Context Semantics and Contrast Enhancement10.1016/j.compbiomed.2022.106296 ↗
36. Gardiyanoğlu, E., Ünsal, G., Akkaya, N., Aksoy, S., and Orhan, K. (2023). Automatic Segmentation of Teeth, Crown–Bridge Restorations, Dental Implants, Restorative Fillings, Dental Caries, Residual Roots, and Root Canal Fillings on Orthopantomographs: Convenience and Pitfalls. Diagnostics, 13.10.3390/diagnostics13081487 ↗