Multiple Instance Classification for Gastric Cancer Pathological Images Based on Implicit Spatial Topological Structure Representation
Source abstract
Abstract
Gastric cancer is a malignant tumor with high incidence. Computer-aided screening systems for gastric cancer pathological images can contribute to reducing the workload of specialists and improve the efficiency of disease diagnosis. Due to the high resolution of images, it is common to divide the whole slide image (WSI) into a set of image patches with overlap before utilizing deep neural networks for further analysis. However, not all patches split from the same cancerous WSI contain information of cancerous issues. This restriction naturally satisfies the assumptions of multiple instance learning (MIL). Moreover, the spatial topological structure relationships between local areas in a WSI are destroyed in the process of patch partitioning. Most existing multiple instance classification (MIC) methods fail to take into account the topological relationships between instances. In this paper, we propose a novel multiple instance classification framework based on graph convolutional networks (GCNs) for gastric microscope image classification. Firstly, patch embeddings were generated by feature extraction. Then, a graph structure was introduced to model the spatial topological structure relationships between instances. Additionally, a graph classification model with hierarchical pooling was constructed to achieve this multiple instance classification task. To certify the effectiveness and generalization of our method, we conducted comparative experiments on two different modes of gastric cancer pathological image datasets. The proposed method achieved average fivefold cross-validation precisions of 91.16% and 98.26% for gastric cancer classification on the two datasets, respectively.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image Retrieval and Classification Techniques · Advanced Image and Video Retrieval Techniques · AI in cancer detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Science and Technology, Fudan University, Shanghai 200433, China
Research Center of Smart Networks and Systems, School of Information Science and Technology, Fudan University, Shanghai 200433, China
References (25)
Show source-provided references
1. Deep Convolutional Neural Networks for Automatic Classification of Gastric Carcinoma Using Whole Slide Images in Digital Histopathology10.1016/j.compmedimag.2017.06.001 ↗
2. RMDL: Recalibrated Multi-Instance Deep Learning for Whole Slide Gastric Image Classification10.1016/j.media.2019.101549 ↗
3. Geirhos, R., Rubisch, P., Michaelis, C., Bethge, M., Wichmann, F.A., and Brendel, W. (2018). ImageNet-trained CNNs are Biased Towards Texture; Increasing Shape Bias Improves Accuracy and Robustness. arXiv.
4. Machine Learning Approaches for Pathologic Diagnosis10.1007/s00428-019-02594-w ↗
5. Pre-Trained Convolutional Neural Networks as Feature Extractors for Diagnosis of Breast Cancer Using Histopathology10.1002/ima.22399 ↗
6. Analysis of Histopathological Images for Prediction of Breast Cancer Using Traditional Classifiers with Pre-Trained CNN10.1016/j.procs.2020.03.427 ↗
7. A Brief Introduction to Weakly Supervised Learning10.1093/nsr/nwx106 ↗
8. Multiple Instance Classification: Review, Taxonomy and Comparative Study10.1016/j.artint.2013.06.003 ↗
9. Conjeti, S., Paschali, M., Katouzian, A., and Navab, N. (2017, January 10–14). Deep Multiple Instance Hashing for Scalable Medical Image Retrieval. Proceedings of the Medical Image Computing and Computer Assisted Intervention (MICCAI), Quebec City, QC, Canada.10.1007/978-3-319-66179-7_63 ↗
10. Das, K., Conjeti, S., Roy, A.G., Chatterjee, J., and Sheet, D. (2018, January 4–7). Multiple Instance Learning of Deep Convolutional Neural Networks for Breast Histopathology whole Slide Classification. Proceedings of the IEEE 15th International Symposium on Biomedical Imaging (ISBI), Washington, DC, USA.10.1109/ISBI.2018.8363642 ↗
11. Ilse, M., Tomczak, J.M., and Welling, M. (2018). Attention-based Deep Multiple Instance Learning. arXiv.
12. Whole Slide Images Based Cancer Survival Prediction Using Attention Guided Deep Multiple Instance Learning Networks10.1016/j.media.2020.101789 ↗
13. Data-Efficient and Weakly Supervised Computational Pathology on Whole-Slide Images10.1038/s41551-020-00682-w ↗
14. Multiple Instance Learning: A Survey of Problem Characteristics and Applications10.1016/j.patcog.2017.10.009 ↗
15. Kipf, T.N., and Welling, M. (2017). Semi-Supervised Classification with Graph Convolutional Networks. arXiv.
16. Ying, R., You, J., Morris, C., Ren, X., Hamilton, W.L., and Leskovec, J. (2018, January 3–8). Hierarchical Graph Representation Learning with Differentiable Pooling. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Montreal, MT, Canada.
17. Cangea, C., Velickovic, P., Jovanovic, N., Kipf, T., and Lio, P. (2018). Towards Sparse Hierarchical Graph Classifiers. arXiv.
18. Diehl, F. (2019). Edge Contraction Pooling for Graph Neural Networks. arXiv.
19. Hamilton, W.L., Ying, R., and Leskovec, J. (2017, January 4–9). Inductive Representation Learning on Large Graphs. Proceedings of the in Neural Information Processing Systems (NIPS), Long Beach, CA, USA.
20. Xu, B., Wang, N., Chen, T., and Li, M. (2015). Empirical Evaluation of Rectified Activations in Convolutional Network. arXiv.
21. Ioffe, S., and Szegedy, C. (2015, January 6). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on International Conference on Machine Learning, Lille, France.
22. Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
23. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
24. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
25. Tan, M., and Le, Q.V. (2019, January 9–15). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. Proceedings of the International Conference on Machine Learning (ICML), Long Beach, CA, USA.