journal article·2024-12-27Open access

Optimizing Automated Hematoma Expansion Classification from Baseline and Follow-Up Head Computed Tomography

Anh T. Tran, Dmitriy Desser, Tal Zeevi, Gaby Abou Karam, Julia Zietz, Andrea Dell’Orco, Min-Chiun Chen, Ajay Malhotra, Adnan I. Qureshi, Santosh B. Murthy, Shahram Majidi, Guido J. Falcone, Kevin N. Sheth, Jawed Nawabi, Seyedmehdi Payabvash

Applied Sciences· Volume 15· Issue 1

Abstract

Hematoma expansion (HE) is an independent predictor of poor outcomes and a modifiable treatment target in intracerebral hemorrhage (ICH). Evaluating HE in large datasets requires segmentation of hematomas on admission and follow-up CT scans, a process that is time-consuming and labor-intensive in large-scale studies. Automated segmentation of hematomas can expedite this process; however, cumulative errors from segmentation on admission and follow-up scans can hamper accurate HE classification. In this study, we combined a tandem deep-learning classification model with automated segmentation to generate probability measures for false HE classifications. With this strategy, we can limit expert review of automated hematoma segmentations to a subset of the dataset, tailored to the research team’s preferred sensitivity or specificity thresholds and their tolerance for false-positive versus false-negative results. We utilized three separate multicentric cohorts for cross-validation/training, internal testing, and external validation (n = 2261) to develop and test a pipeline for automated hematoma segmentation and to generate ground truth binary HE annotations (≥3, ≥6, ≥9, and ≥12.5 mL). Applying a 95% sensitivity threshold for HE classification showed a practical and efficient strategy for HE annotation in large ICH datasets. This threshold excluded 47–88% of test-negative predictions from expert review of automated segmentations for different HE definitions, with less than 2% false-negative misclassification in both internal and external validation cohorts. Our pipeline offers a time-efficient and optimizable method for generating ground truth HE classifications in large ICH datasets, reducing the burden of expert review of automated hematoma segmentations while minimizing misclassification rate.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Intracerebral and Subarachnoid Hemorrhage Research · Acute Ischemic Stroke Management · Machine Learning in Healthcare

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT 06519, USA

Department of Neuroradiology, Charité—Universitätsmedizin Berlin, Humboldt-Universität Zu Berlin, Freie Universität Berlin, Berlin Institute of Health, 10117 Berlin, Germany

Zeenat Qureshi Stroke Institute and Department of Neurology, University of Missouri, Columbia, MO 65201, USA

Department of Neurology, Weill Cornell School of Medicine, New York, NY 10065, USA

Department of Neurosurgery, Mount Sinai School of Medicine, New York, NY 10029, USA

Department of Neurology, Yale School of Medicine, New Haven, CT 06510, USA

Department of Radiology, Columbia University Medical Center, New York, NY 10032, USA

Funding

Doris Duke Charitable Foundation · NIH

References (66)

Show source-provided references
1. The Story of Intracerebral Hemorrhage: From Recalcitrant to Treatable Disease10.1161/STROKEAHA.121.033484 ↗
2. Li, Z., You, M., Long, C., Bi, R., Xu, H., He, Q., and Hu, B. (2020). Hematoma Expansion in Intracerebral Hemorrhage: An Update on Prediction and Treatment. Front. Neurol., 11.10.3389/fneur.2020.00702 ↗
3. Abou Karam, G., Chen, M.C., Zeevi, D., Harms, B.C., Torres-Lopez, V.M., Rivier, C.A., Malhotra, A., de Havenon, A., Falcone, G.J., and Sheth, K.N. (2024). Time-Dependent Changes in Hematoma Expansion Rate after Supratentorial Intracerebral Hemorrhage and Its Relationship with Neurological Deterioration and Functional Outcome. Diagnostics, 14.10.3390/diagnostics14030308 ↗
4. In spontaneous intracerebral hematoma patients, prediction of the hematoma expansion risk and mortality risk using radiological and clinical markers and a newly developed scale10.1080/01616412.2020.1870338 ↗
5. Time course of early postadmission hematoma expansion in spontaneous intracerebral hemorrhage10.1161/STROKEAHA.113.003608 ↗
6. Hematoma expansion is more frequent in deep than lobar intracerebral hemorrhage10.1212/WNL.0000000000010990 ↗
7. Location of intracerebral haemorrhage predicts haematoma expansion10.1177/2396987317715836 ↗
8. Zaman, S., Dierksen, F., Knapp, A., Haider, S.P., Abou Karam, G., Qureshi, A.I., Falcone, G.J., Sheth, K.N., and Payabvash, S. (2024). Radiomic Features of Acute Cerebral Hemorrhage on Non-Contrast CT Associated with Patient Survival. Diagnostics, 14.10.3390/diagnostics14090944 ↗
9. Effect of Recombinant Activated Coagulation Factor VII on Hemorrhage Expansion Among Patients With Spot Sign-Positive Acute Intracerebral Hemorrhage: The SPOTLIGHT and STOP-IT Randomized Clinical Trials10.1001/jamaneurol.2019.2636 ↗
10. Tranexamic acid for hyperacute primary IntraCerebral Haemorrhage (TICH-2): An international randomised, placebo-controlled, phase 3 superiority trial10.1016/S0140-6736(18)31033-X ↗
11. Clinical Trial Protocol for BEACH: A Phase 2a Study of MW189 in Patients with Acute Nontraumatic Intracerebral Hemorrhage10.1007/s12028-023-01867-2 ↗
12. Volume of intracerebral hemorrhage. A powerful and easy-to-use predictor of 30-day mortality10.1161/01.STR.24.7.987 ↗
13. Defining hematoma expansion in intracerebral hemorrhage: Relationship with patient outcomes10.1212/WNL.0b013e3182143317 ↗
14. Arab, A., Chinda, B., Medvedev, G., Siu, W., Guo, H., Gu, T., Moreno, S., Hamarneh, G., Ester, M., and Song, X. (2020). A fast and fully-automated deep-learning approach for accurate hemorrhage segmentation and volume quantification in non-contrast whole-head CT. Sci. Rep., 10.10.1038/s41598-020-76459-7 ↗
15. Fully Automated Segmentation Algorithm for Hematoma Volumetric Analysis in Spontaneous Intracerebral Hemorrhage10.1161/STROKEAHA.119.026561 ↗
16. Cao, H., Morotti, A., Mazzacane, F., Desser, D., Schlunk, F., Guttler, C., Kniep, H., Penzkofer, T., Fiehler, J., and Hanning, U. (2023). External Validation and Retraining of DeepBleed: The First Open-Source 3D Deep Learning Network for the Segmentation of Spontaneous Intracerebral and Intraventricular Hemorrhage. J. Clin. Med., 12.10.1101/2023.02.27.23286358 ↗
17. Semantic Segmentation of Spontaneous Intracerebral Hemorrhage, Intraventricular Hemorrhage, and Associated Edema on CT Images Using Deep Learning10.1148/ryai.220096 ↗
18. Peng, Q., Chen, X., Zhang, C., Li, W., Liu, J., Shi, T., Wu, Y., Feng, H., Nian, Y., and Hu, R. (2022). Deep learning-based computed tomography image segmentation and volume measurement of intracerebral hemorrhage. Front. Neurosci., 16.10.3389/fnins.2022.965680 ↗
19. Piao, Z., Gu, Y.H., Jin, H., and Yoo, S.J. (2023). Intracerebral hemorrhage CT scan image segmentation with HarDNet based transformer. Sci. Rep., 13.10.1038/s41598-023-33775-y ↗
20. A Robust Deep Learning Segmentation Method for Hematoma Volumetric Detection in Intracerebral Hemorrhage10.1161/STROKEAHA.120.032243 ↗
21. Intensive Blood-Pressure Lowering in Patients with Acute Cerebral Hemorrhage10.1056/NEJMoa1603460 ↗
22. The coronal plane maximum diameter of deep intracerebral hemorrhage predicts functional outcome more accurately than hematoma volume10.1177/17474930211050749 ↗
23. Multilesion Segmentations in Patients with Intracerebral Hemorrhage: Reliability of ICH, IVH and PHE Masks10.3390/tomography9010008 ↗
24. Kohavi, R. (1995, January 20–25). A study of cross-validation and bootstrap for accuracy estimation and model selection. Proceedings of the IJCAI’95: Proceedings of the 14th International Joint Conference on Artificial Intelligence, Montreal, QC, Canada.
25. Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer.10.1007/978-0-387-84858-7 ↗
26. Learning to Optimize: Training Deep Neural Networks for Interference Management10.1109/TSP.2018.2866382 ↗
27. Rafael Gonzalez, R.W. (2017). Digital Image Processing, Pearson.
28. Uncertainty-aware deep-learning model for prediction of supratentorial hematoma expansion from admission non-contrast head computed tomography scan10.1038/s41746-024-01007-w ↗
29. nnU-Net: A self-configuring method for deep learning-based biomedical image segmentation10.1038/s41592-020-01008-z ↗
30. Measures of the Amount of Ecologic Association Between Species10.2307/1932409 ↗
31. Rockafellar, R.T.W., and Roger, J.-B. (2005). Variational Analysis, Springer.
32. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2016, January 27–30). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2017.243 ↗
33. Saito, T., and Rehmsmeier, M. (2015). The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PLoS ONE, 10.10.1371/journal.pone.0118432 ↗
34. The meaning and use of the area under a receiver operating characteristic (ROC) curve10.1148/radiology.143.1.7063747 ↗
35. Support-vector networks10.1007/BF00994018 ↗
36. Tiwari, P., Upadhyay, D., Pant, B., and Mohd, N. (2022, January 22–23). Multiclass Classification of Disease Using CNN and SVM of Medical Imaging. Proceedings of the Advances in Computing and Data Sciences. ICACDS 2022. Communications in Computer and Information Science, Kurnool, India.10.1007/978-3-031-12641-3_8 ↗
37. Convolutional neural networks in medical image understanding: A survey10.1007/s12065-020-00540-3 ↗
38. Buitinck, L., Louppe, G., Blondel, M., Pedregosa, F., Mueller, A., Grisel, O., Niculae, V., Prettenhofer, P., Gramfort, A., and Grobler, J. (2013, January 23–27). API design for machine learning software: Experiences from the scikit-learn project. Proceedings of the ECML PKDD Workshop: Languages for Data Mining and Machine Learning, Prague, Czech Republic.
39. Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation
40. Murphy, K.P. (2012). Machine Learning: A Probabilistic Perspective, The MIT Press.
41. Rainio, O., Teuho, J., and Klen, R. (2024). Evaluation metrics and statistical tests for machine learning. Sci. Rep., 14.10.1038/s41598-024-56706-x ↗
42. A Review of the F-Measure: Its History, Properties, Criticism, and Alternatives
43. An introduction to ROC analysis10.1016/j.patrec.2005.10.010 ↗
44. Tests of statistical hypotheses concerning several parameters when the number of observations is large10.1090/S0002-9947-1943-0012401-3 ↗
45. Agresti, A. (2007). An Introduction to Categorical Data Analysis, Wiley-Interscience. [2nd ed.].10.1002/0470114754 ↗
46. George, W., and Snecdecor, W.G.C. (1989). Statistical Methods, Iowa State University Press. [8th ed.].
47. The ENIGMA Stroke Recovery Working Group: Big data neuroimaging to study brain-behavior relationships after stroke10.1002/hbm.25015 ↗
48. Artificial Intelligence for Neuroimaging and Musculoskeletal Radiology: Overview of Current Commercial Algorithms10.1053/j.ro.2023.03.002 ↗
49. Recombinant factor VIIa for hemorrhagic stroke treatment at earliest possible time (FASTEST): Protocol for a phase III, double-blind, randomized, placebo-controlled trial10.1177/17474930211042700 ↗
50. Tranexamic acid in patients with intracerebral haemorrhage (STOP-AUST): A multicentre, randomised, placebo-controlled, phase 2 trial10.1016/S1474-4422(20)30369-0 ↗
51. Imaging of Spontaneous Intracerebral Hemorrhage10.1016/j.nic.2021.02.003 ↗
52. Tanioka, S., Aydin, O.U., Hilbert, A., Ishida, F., Tsuda, K., Araki, T., Nakatsuka, Y., Yago, T., Kishimoto, T., and Ikezawa, M. (2024). Prediction of hematoma expansion in spontaneous intracerebral hemorrhage using a multimodal neural network. Sci. Rep., 14.10.1038/s41598-024-67365-3 ↗
53. Hematoma expansion prediction in patients with intracerebral hemorrhage using a deep learning approach10.21037/jmai-24-5 ↗
54. Hematoma expansion prediction in intracerebral hemorrhage patients by using synthesized CT images in an end-to-end deep learning framework10.1016/j.compmedimag.2024.102430 ↗
55. Haider, S.P., Qureshi, A.I., Jain, A., Tharmaseelan, H., Berson, E.R., Zeevi, T., Werring, D.J., Gross, M., Mak, A., and Malhotra, A. (2023). Radiomic markers of intracerebral hemorrhage expansion on non-contrast CT: Independent validation and comparison with visual markers. Front. Neurosci., 17.10.3389/fnins.2023.1225342 ↗
56. Teng, L., Ren, Q., Zhang, P., Wu, Z., Guo, W., and Ren, T. (2021). Artificial Intelligence Can Effectively Predict Early Hematoma Expansion of Intracerebral Hemorrhage Analyzing Noncontrast Computed Tomography Image. Front. Aging Neurosci., 13.10.3389/fnagi.2021.632138 ↗
57. Semi-automated method for brain hematoma and edema quantification using computed tomography10.1016/j.compmedimag.2009.02.001 ↗
58. Segmentation and quantification of intra-ventricular/cerebral hemorrhage in CT scans by modified distance regularized level set evolution technique10.1007/s11548-012-0670-0 ↗
59. Gong, S., Zhong, Y., Gong, Y., Chan, N.Y., Ma, W., Mak, C.H.K., Abrigo, J., and Dou, Q. (2024, January 27–30). Segmentation of Tiny Intracranial Hemorrhage Via Learning-to-Rank Local Feature Enhancement. Proceedings of the 2024 IEEE International Symposium on Biomedical Imaging (ISBI), Athens, Greece.10.1109/ISBI56570.2024.10635853 ↗
60. Toikkanen, M., Kwon, D., and Lee, M. (2021). ReSGAN: Intracranial Hemorrhage Segmentation with Residuals of Synthetic Brain CT Scans, Springer.10.1007/978-3-030-87193-2_38 ↗
61. Lesion synthesis to improve intracranial hemorrhage detection and classification for CT images10.1016/j.compmedimag.2021.101929 ↗
62. Agarap, A.F. (2017). An Architecture Combining Convolutional Neural Network (CNN) and Support Vector Machine (SVM) for Image Classification. arXiv.
63. A Hybrid CNN-SVM Threshold Segmentation Approach for Tumor Detection and Classification of MRI Brain Images10.1016/j.irbm.2021.06.003 ↗
64. Khoramipour, S., Gandomkar, M., and Shakiba, M. (2024). Enhancement of brain tumor classification from MRI images using multi-path convolutional neural network with SVM classifier. Biomed. Signal Process. Control, 93.10.1016/j.bspc.2024.106117 ↗
65. Liu, T., Ye, X., and Sun, B. Combining Convolutional Neural Network and Support Vector Machine for Gait-based Gender Recognition. 2018 Chinese Automation Congress (CAC), Xi'an, China.10.1109/CAC.2018.8623118 ↗
66. A novel hybrid CNN–SVM classifier for recognizing handwritten digits10.1016/j.patcog.2011.09.021 ↗