journal article·2022-10-24Open access

Weakly Supervised Learning with Positive and Unlabeled Data for Automatic Brain Tumor Segmentation

Daniel Wolf, Sebastian Regnery, Rafal Tarnawski, Barbara Bobek-Billewicz, Joanna Polańska, Michael Götz

Applied Sciences· Volume 12· Issue 21

Abstract

A major obstacle to the learning-based segmentation of healthy and tumorous brain tissue is the requirement of having to create a fully labeled training dataset. Obtaining these data requires tedious and error-prone manual labeling with respect to both tumor and non-tumor areas. To mitigate this problem, we propose a new method to obtain high-quality classifiers from a dataset with only small parts of labeled tumor areas. This is achieved by using positive and unlabeled learning in conjunction with a domain adaptation technique. The proposed approach leverages the tumor volume, and we show that it can be either derived with simple measures or completely automatic with a proposed estimation method. While learning from sparse samples allows reducing the necessary annotation time from 4 h to 5 min, we show that the proposed approach further reduces the necessary annotation by roughly 50% while maintaining comparative accuracies compared to traditionally trained classifiers with this approach.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Radiomics and Machine Learning in Medical Imaging · Advanced Neural Network Applications · AI in cancer detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Section Experimental Radiology, Department for Diagnostic and Internventional Radiology, University Hospital Ulm, 89081 Ulm, Germany

Visual Computing Group, Institute of Media Informatics, Ulm University, 89081 Ulm, Germany

Department of Radiation Oncology, Heidelberg University Hospital, 69120 Heidelberg, Germany

IIIrd Radiotherapy and Chemotherapy Department, Maria Sklodowska-Curie National Research Institute of Oncology, 44-101 Gliwice, Poland

Radiology and Diagnostic Imaging Department, Maria Sklodowska-Curie National Research Institute of Oncology, 44-102 Gliwice, Poland

Department of Data Science and Engineering, The Silesian University of Technology, 44-100 Gliwice, Poland

Funding

University of Ulm

References (53)

Show source-provided references
1. Intra- and interobserver variability in skeletal muscle measurements using computed tomography images10.1016/j.ejrad.2018.10.031 ↗
2. Reliability of Single-Slice–Based 2D CT Texture Analysis of Renal Masses: Influence of Intra- and Interobserver Manual Segmentation Variability on Radiomic Feature Reproducibility10.2214/AJR.19.21212 ↗
3. MITK Phenotyping: An open-source toolchain for image-based personalized medicine with radiomics10.1016/j.radonc.2018.11.021 ↗
4. Longitudinal gray matter changes in multiple sclerosis—Differential scanner and overall disease-related effects10.1002/hbm.21279 ↗
5. Adrenal lesions: Variability in attenuation over time, between scanners, and between observers10.1177/0284185113482688 ↗
6. nnU-Net: A self-configuring method for deep learning-based biomedical image segmentation10.1038/s41592-020-01008-z ↗
7. Pre-examinations Improve Automated Metastases Detection on Cranial MRI10.1097/RLI.0000000000000745 ↗
8. Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H.R., and Xu, D. (2022, January 3–8). UNETR: Transformers for 3D Medical Image Segmentation. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV51458.2022.00181 ↗
9. Roth, H.R., Yang, D., Xu, Z., Wang, X., and Xu, D. (2021). Going to Extremes: Weakly Supervised Medical Image Segmentation. Mach. Learn. Knowl. Extr., 3.10.3390/make3020026 ↗
10. A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains10.1007/s11263-020-01373-4 ↗
11. Goetz, M., Weber, C., Stieltjes, B., and Maier-Hein, K. (2014, January 13). Learning from Small Amounts of Labeled Data in a Brain Tumor Classification Task. Proceedings of the NIPS Workshop on Transfer and Multi-task learning: Theory Meets Practice, Montreal, QC, Canada.
12. DALSA: Domain Adaptation for Supervised Learning From Sparsely Annotated MR Images10.1109/TMI.2015.2463078 ↗
13. Deep Learning for Hemorrhagic Lesion Detection and Segmentation on Brain CT Images10.1109/JBHI.2020.3028243 ↗
14. A positive/unlabeled approach for the segmentation of medical sequences using point-wise supervision10.1016/j.media.2021.102185 ↗
15. Reconciling modern machine-learning practice and the classical bias–variance trade-off10.1073/pnas.1903070116 ↗
16. Kiryati, N., and Landau, Y. (2021). Dataset Growth in Medical Image Analysis Research. J. Imaging, 7.10.3390/jimaging7080155 ↗
17. Kleesiek, J., Biller, A., Urban, G., Kothe, U., Bendszus, M., and Hamprecht, F. (2014, January 14). Ilastik for Multi-modal Brain Tumor Segmentation. Proceedings of the MICCAI-BRATS, Boston, MA, USA.
18. An efficient approach for brain tumor detection and segmentation in MR brain images using random forest classifier10.1177/1063293X211010542 ↗
19. Csaholczi, S., Kovács, L., and Szilágyi, L. (2021, January 21–23). Automatic Segmentation of Brain Tumor Parts from MRI Data Using a Random Forest Classifier. Proceedings of the 2021 IEEE 19th World Symposium on Applied Machine Intelligence and Informatics (SAMI), Herlany, Slovakia.10.1109/SAMI50585.2021.9378618 ↗
20. Recognition of acute lymphoblastic leukemia and lymphocytes cell subtypes in microscopic images using random forest classifier10.1007/s13246-021-00993-5 ↗
21. Hartmann, D., Müller, D., Soto-Rey, I., and Kramer, F. (2021). Assessing the Role of Random Forests in Medical Image Segmentation. arXiv.
22. PIxel-Level Segmentation of Bladder Tumors on MR Images Using a Random Forest Classifier10.1177/15330338221086395 ↗
23. A learning-based, fully automatic liver tumor segmentation pipeline based on sparsely annotated training data
24. Machine-Learning based Comparison of CT-Perfusion maps and Dual Energy CT for Pancreatic Tumor Detection
25. Criminisi, A., and Shotton, J. (2013). Decision Forests for Computer Vision and Medical Image Analysis, Springer Science & Business Media.10.1007/978-1-4471-4929-3 ↗
26. Elkan, C., and Noto, K. (2008, January 24–27). Learning classifiers from only positive and unlabeled data. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, NV, USA.10.1145/1401890.1401920 ↗
27. Elkan, C. (2001, January 4–10). The foundations of cost-sensitive learning. Proceedings of the International Joint Conference on Artificial Intelligence, Seattle, WA, USA.
28. Du Plessis, M.C., Niu, G., and Sugiyama, M. (2022, October 04). Analysis of Learning from Positive and Unlabeled Data. Advances in Neural Information Processing Systems 27. Available online: https://proceedings.neurips.cc/paper/2014/file/35051070e572e47d2c26c241ab88307f-Paper.pdf.
29. Class Prior Estimation from Positive and Unlabeled Data
30. Improving predictive inference under covariate shift by weighting the log-likelihood function
31. Sugiyama, M., and Kawanabe, M. (2012). Machine Learning in Non-Stationary Environments: Introduction to Covariate Shift Adaptation, MIT Press.10.7551/mitpress/9780262017091.001.0001 ↗
32. The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)10.1109/TMI.2014.2377694 ↗
33. The Virtual Skeleton Database: An Open Access Repository for Biomedical Research and Collaboration10.2196/jmir.2930 ↗
34. Measures of the Amount of Ecologic Association Between Species10.2307/1932409 ↗
35. A brain tumor segmentation framework based on outlier detection10.1016/j.media.2004.06.007 ↗
36. Brain Tumor Segmentation using Convolutional Neural Networks in MRI Images10.1109/TMI.2016.2538465 ↗
37. Deep Learning for Semantic Segmentation vs. Classification in Computational Pathology: Application to Mitosis Analysis in Breast Cancer Grading10.3389/fbioe.2019.00145 ↗
38. Kontschieder, P., Fiterau, M., Criminisi, A., and Bulo, S.R. (2015, January 7–13). Deep Neural Decision Forests. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.172 ↗
39. Adaptive learning cost-sensitive convolutional neural network10.1049/cvi2.12027 ↗
40. Validation of neuroradiologic response assessment in gliomas: Measurement by RECIST, two-dimensional, computer-assisted tumor area, and computer-assisted tumor volume methods110.1215/15228517-2005-005 ↗
41. Measures of Response: RECIST, WHO, and New Alternatives10.1200/JCO.2006.06.5599 ↗
42. Multicenter evaluation of MRI-based radiomic features: A phantom study10.1002/mp.14173 ↗
43. Wennmann, M., Bauer, F., Klein, A., Chmelik, J., Grözinger, M., Rotkopf, L.T., Neher, P., Gnirs, R., Kurz, F.T., and Nonnenmacher, T. (2022). In Vivo Repeatability and Multiscanner Reproducibility of MRI Radiomics Features in Patients With Monoclonal Plasma Cell Disorders: A Prospective Bi-institutional Study. Investig. Radiol., online ahead of print.10.1097/RLI.0000000000000927 ↗
44. Test–Retest Data for Radiomics Feature Stability Analysis: Generalizable or Study-Specific?10.18383/j.tom.2016.00208 ↗
45. Optimal Statistical Incorporation of Independent Feature Stability Information into Radiomics Studies
46. A Postreconstruction Harmonization Method for Multicenter Radiomic Studies in PET10.2967/jnumed.117.199935 ↗
47. The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping10.1148/radiol.2020191145 ↗
48. Quantitative radiomics studies for tissue characterization: A review of technology and methodological procedures10.1259/bjr.20160665 ↗
49. Combining Deep Learning and Radiomics for Automated, Objective, Comprehensive Bone Marrow Characterization From Whole-Body MRI: A Multicentric Feasibility Study10.1097/RLI.0000000000000891 ↗
50. Lisson, C.S., Lisson, C.G., Achilles, S., Mezger, M.F., Wolf, D., Schmidt, S.A., Thaiss, W.M., Bloehdorn, J., Beer, A.J., and Stilgenbauer, S. (2022). Longitudinal CT Imaging to Explore the Predictive Power of 3D Radiomic Tumour Heterogeneity in Precise Imaging of Mantle Cell Lymphoma (MCL). Cancers, 14.10.3390/cancers14020393 ↗
51. Lisson, C.S., Lisson, C.G., Mezger, M.F., Wolf, D., Schmidt, S.A., Thaiss, W.M., Tausch, E., Beer, A.J., Stilgenbauer, S., and Beer, M. (2022). Deep Neural Networks and Machine Learning Radiomics Modelling for Prediction of Relapse in Mantle Cell Lymphoma. Cancers, 14.10.3390/cancers14082008 ↗
52. Maier-Hein, L., Mersmann, S., Kondermann, D., Bodenstedt, S., Sanchez, A., Stock, C., Kenngott, H.G., Eisenmann, M., and Speidel, S. (2014). Can Masses of Non-Experts Train Highly Accurate Image Classifiers?. Medical Image Computing and Computer-Assisted Intervention—MICCAI 2014, Springer.10.1007/978-3-319-10470-6_55 ↗
53. Maier-Hein, L., Ross, T., Gröhl, J., Glocker, B., Bodenstedt, S., Stock, C., Heim, E., Götz, M., Wirkert, S., and Kenngott, H. (2016). Crowd-algorithm collaboration for large-scale endoscopic image annotation with confidence. Medical Image Computing and Computer-Assisted Intervention—MICCAI 2016, Springer International Publishing.10.1007/978-3-319-46723-8_71 ↗