Diagnosis of Tympanic Membrane Disease and Pediatric Hearing Using Convolutional Neural Network Models with Multi-Layer Perceptrons
Source abstract
Abstract
In this study, we propose a method of classification for tympanic membrane diseases and regression of pediatric hearing, using a deep learning model of artificial neural networks. Based on the B7 Backbone model of EfficientNet, a state-of-the-art convolutional neural network model, drop connect was applied in the encoder for generalization, and multi-layer perceptron, which is mainly used in the transformer, was applied to the decoder for improved accuracy. For the training data, the open-access tympanic membrane dataset, divided into four classes, was used as the benchmark dataset, and the SCH tympanic membrane dataset with five classes of tympanic membrane diseases and pediatric hearing was also used as the training dataset. In the benchmark using the open-access tympanic membrane dataset, the proposed model showed the highest performance among the five comparative models with an average accuracy of 93.59%, an average sensitivity of 87.19%, and an average specificity of 95.73%. In the experiment trained on the SCH tympanic membrane disease dataset, the average accuracy was 98.28%, the average sensitivity was 89.66%, the average specificity was 98.68%, and the average inference time was 0.2 s. In the experiment trained on the SCH pediatric hearing dataset, the mean absolute error was 6.8678, the mean squared logarithmic error was 0.2887, and the average inference time was 0.2 s.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Speech and Audio Processing · Hand Gesture Recognition Systems · Phonocardiography and Auscultation Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Haewootech Co., Ltd., Busan 46742, Republic of Korea
Department Computer Engineering, Kyungnam University, Changwon 51767, Republic of Korea
Department of Otolaryngology-Head and Neck Surgery, Cheonan Hospital, Soonchunhyang University College of Medicine, Cheonan 31151, Republic of Korea
Funding
Korea Technology & Information Promotion Agency for SMEs · Soonchunhyang Research Fund
References (40)
Show source-provided references
1. The aetiology of otitis media with effusion: A review10.1046/j.1365-2273.2000.00350.x ↗
2. Clinical practice guideline: Otitis media with effusion (update)
3. Otitis media with effusion in children: Pathophysiology, diagnosis, and treatment. A review10.1016/j.joto.2019.01.005 ↗
4. Diseases of the middle ear in childhood
5. Screening for otitis media with effusion in preschool children10.1016/S0140-6736(89)91317-2 ↗
6. Tympanic membrane atrophy, scarring, atelectasis and attic retraction in persistent, untreated otitis media with effusion and following ventilation tube insertion10.1016/0165-5876(94)90060-4 ↗
7. Spontaneous course of secretory otitis and changes of the eardrum10.1001/archotol.1984.00800310005002 ↗
8. A fast learning algorithm for deep belief nets10.1162/neco.2006.18.7.1527 ↗
9. Bengio, Y., Lamblin, P., Popovici, D., and Larochelle, H. (2007, January 3–8). Greedy layer-wise training of deep networks. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.10.7551/mitpress/7503.003.0024 ↗
10. A logical calculus of the ideas immanent in nervous activity10.1007/BF02478259 ↗
11. Artificial intelligence in healthcare: Review and prediction case studies10.1016/j.eng.2019.08.015 ↗
12. Advances in Artificial Intelligence to Diagnose Otitis Media: State of the Art Review10.1177/01945998221083502 ↗
13. Assessing diagnostic accuracy and tympanocentesis skills in the management of otitis media10.1001/archpedi.155.10.1137 ↗
14. Automated classification platform for the identification of otitis media using optical coherence tomography10.1038/s41746-019-0094-0 ↗
15. Backpropagation applied to handwritten zip code recognition10.1162/neco.1989.1.4.541 ↗
16. McClelland, J.L., Rumelhart, D.E., and Hinton, G.E. (1986). Parallel Distributed Processing: Explorations in the Microstructures of Cognition, MIT Press.10.7551/mitpress/5236.001.0001 ↗
17. Song, D., Song, I.S., Kim, J., Choi, J., and Lee, Y. (2022). Semantic decomposition and anomaly detection of tympanic membrane endoscopic images. Appl. Sci., 12.10.3390/app122211677 ↗
18. Kingma, D.P., and Welling, M. (2014, January 14–16). Auto-encoding variational bayes. Proceedings of the 2nd International Conference on Learning Representations ICLR 2014 Conference Track Proceedings, Banff, AB, Canada.
19. Yue, Y., Zeng, X., Shi, X., Zhang, M., Zhang, F., Liu, Y., Li, Z., and Li, Y. (2023). Ear-keeper: Real-time diagnosis of ear lesions utilizing ultralight-ultrafast convnet and large-scale ear endoscopic dataset. arXiv.
20. Ma, N., Zhang, X., Zheng, H.T., and Sun, J. (2018, January 8–14). ShuffleNet V2: Practical guidelines for efficient CNN architecture design. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01264-9_8 ↗
21. Efficient and accurate identification of ear diseases using an ensemble deep learning model10.1038/s41598-021-90345-w ↗
22. Low-dose CT image denoising using classification densely connected residual network
23. (2024, January 03). Open-Access Tympanic Membrane Dataset. Available online: https://www.kaggle.com/datasets/erdalbasaran/eardrum-dataset-otitis-media.
24. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for MobileNetV3. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
25. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA.
26. Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., and Xie, S. (2022, January 21–24). A ConvNet for the 2020s. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01167 ↗
27. Müller, R., Kornblith, S., and Hinton, G.E. (2019, January 8–14). When does label smoothing help?. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.
28. Dropout: A simple way to prevent neural networks from overfitting
29. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA.
30. Wan, L., Zeiler, M., Zhang, S., LeCun, Y., and Fergus, R. (2013, January 16–21). Regularization of neural networks using Drop Connect. Proceedings of the 30th International Conference on Machine Learning, Atlanta, GA, USA.
31. Cubuk, E.D., Zoph, B., Shlens, J., and Le, Q.V. (2020, January 14–19). Randaugment: Practical automated data augmentation with a reduced search space. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.10.1109/CVPRW50498.2020.00359 ↗
32. Lim, S., Kim, I., Kim, T., Kim, C., and Kim, S. (2019, January 8–14). Fast AutoAugment. Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, BC, Canada.
33. Zhuang, J., Tang, T., Ding, Y., Tatikonda, S., Dvornek, N., Papademetris, X., and Duncan, J.S. (2020, January 6–12). AdaBelief optimizer: Adapting stepsizes by the belief in observed gradients. Proceedings of the Annual Conference on Neural Information Processing Systems 2020 (NIPS 2020), Virtual.
34. Kingma, D.P., and Ba, J. (2015, January 7–9). Adam: A method for stochastic optimization. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA.
35. Keskar, N.S., and Socher, R. (2017). Improving generalization performance by switching from Adam to SGD. arXiv.
36. Nishikawa, S., and Yamada, I. (2020, January 8–11). Studio Ousia at the NTCIR-15 SHINRA2020-ML Task. Proceedings of the 15th NTCIR Conference on Evaluation of Information Access Technologies, Tokyo, Japan.
37. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the 32nd International Conference on Machine Learning (ICML), Lille, France.
38. Robust estimation of a location parameter10.1214/aoms/1177703732 ↗
39. Xie, Q., Luong, M.T., Hovy, E., and Le, Q.V. (2020, January 14–19). Self-training with noisy student improves imagenet classification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Virtual.10.1109/CVPR42600.2020.01070 ↗
40. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-CAM: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.74 ↗