journal article·2021-07-29Open access

Detecting the Absence of Lung Sliding in Lung Ultrasounds Using Deep Learning

Miroslav Jaščur, Marek Bundzel, Marek Malík, Anton Dzian, Norbert Ferenčík, František Babič

Applied Sciences· Volume 11· Issue 15

Abstract

Certain post-thoracic surgery complications are monitored in a standard manner using methods that employ ionising radiation. A need to automatise the diagnostic procedure has now arisen following the clinical trial of a novel lung ultrasound examination procedure that can replace X-rays. Deep learning was used as a powerful tool for lung ultrasound analysis. We present a novel deep-learning method, automated M-mode classification, to detect the absence of lung sliding motion in lung ultrasound. Automated M-mode classification leverages semantic segmentation to select 2D slices across the temporal dimension of the video recording. These 2D slices are the input for a convolutional neural network, and the output of the neural network indicates the presence or absence of lung sliding in the given time slot. We aggregate the partial predictions over the entire video recording to determine whether the subject has developed post-surgery complications. With a 64-frame version of this architecture, we detected lung sliding on average with a balanced accuracy of 89%, sensitivity of 82%, and specificity of 92%. Automated M-mode classification is suitable for lung sliding detection from clinical lung ultrasound videos. Furthermore, in lung ultrasound videos, we recommend using time windows between 0.53 and 2.13 s for the classification of lung sliding motion followed by aggregation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Ultrasound in Clinical Applications · Phonocardiography and Auscultation Techniques · Radiology practices and education

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Cybernetics and Artificial Intelligence, Faculty of Electrical Engineering and Informatics, Technical University of Košice, Letná 9, 04001 Košice, Slovakia

Department of Thoracic Surgery, Jessenius Faculty of Medicine in Martin, Comenius University in Bratislava and University Hospital in Martin, Kollarova 4248/2, 03659 Martin, Slovakia

Department of Biomedical Engineering and Measurement, Faculty of Mechanical Engineering, Technical University of Košice, Letná 9, 04001 Košice, Slovakia

Funding

Agentúra na Podporu Výskumu a Vývoja

References (22)

Show source-provided references
1. Agreement between chest ultrasonography and chest X-ray in patients who have undergone thoracic surgery: Preliminary results10.4081/mrm.2019.9 ↗
2. Malík, M., Dzian, A., Skaličanová, M., Hamada, L., Zeleňák, K., and Grendár, M. (2020). Chest ultrasound can reduce the use of X-ray in postoperative care after thoracic surgery. Ann. Thorac. Surg.10.1016/j.athoracsur.2020.10.019 ↗
3. Kim, K., and Choi, H. (2021). High-efficiency high-voltage class F amplifier for high-frequency wireless ultrasound systems. PLoS ONE, 16.10.1371/journal.pone.0249034 ↗
4. Mayo, P., Copetti, R., Feller-Kopman, D., Mathis, G., Maury, E., Mongodi, S., Mojoli, F., Volpicelli, G., and Zanobetti, M. (2019). Thoracic ultrasonography: A narrative review. Intensive Care Med., 1–12.10.1007/s00134-019-05725-8 ↗
5. Relevance of lung ultrasound in the diagnosis of acute respiratory failure*: The BLUE protocol10.1378/chest.07-2800 ↗
6. A bedside ultrasound sign ruling out pneumothorax in the critically III: Lung sliding10.1378/chest.108.5.1345 ↗
7. Pathophysiology of pneumothorax following ultrasound-guided thoracentesis10.1016/S0012-3692(15)51155-0 ↗
8. Sonographic diagnosis of pneumothorax10.4103/0974-2700.93116 ↗
9. BLUE-protocol and FALLS-protocol: Two applications of lung ultrasound in the critically ill10.1378/chest.14-1313 ↗
10. Diagnostic accuracy of a novel software technology for detecting pneumothorax in a porcine model10.1016/j.ajem.2017.03.073 ↗
11. Lindsey, T., Lee, R., Grisell, R., Vega, S., and Veazey, S. (2019). Automated Pneumothorax Diagnosis Using Deep Neural Networks. Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, Springer International Publishing.10.1007/978-3-030-13469-3_84 ↗
12. Kulhare, S., Zheng, X., Mehanian, C., Gregory, C., Zhu, M., Gregory, K., Xie, H., Jones, J.M., and Wilson, B. (2018). Ultrasound-based detection of lung abnormalities using single shot detection convolutional neural networks. Simulation, Image Processing, and Ultrasound Systems for Assisted Diagnosis and Navigation, Springer.10.1007/978-3-030-01045-4_8 ↗
13. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
14. Mehanian, C., Kulhare, S., Millin, R., Zheng, X., Gregory, C., Zhu, M., Xie, H., Jones, J., Lazar, J., and Halse, A. (2019). Deep learning-based pneumothorax detection in ultrasound videos. Smart Ultrasound Imaging and Perinatal, Preterm and Paediatric Image Analysis, Springer.10.1007/978-3-030-32875-7_9 ↗
15. Tzutalin, D. (2021, June 14). Labelimg. Available online: https://github.com/tzutalin/labelImg.
16. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
17. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
18. Zhong, Z., Zheng, L., Kang, G., Li, S., and Yang, Y. (2020, January 7–12). Random Erasing Data Augmentation. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.
19. Moving beyond P values: Data analysis with estimation graphics10.1038/s41592-019-0470-3 ↗
20. Shrikumar, A., Greenside, P., and Kundaje, A. (2017, January 6–11). Learning important features through propagating activation differences. Proceedings of the International Conference on Machine Learning, Sydney, Australia.
21. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.74 ↗
22. Sundararajan, M., Taly, A., and Yan, Q. (2017, January 6–11). Axiomatic attribution for deep networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia.