journal article·2022-12-28Open access

Multi-Granularity Dilated Transformer for Lung Nodule Classification via Local Focus Scheme

Kunlun Wu, Bo Peng, Donghai Zhai

Applied Sciences· Volume 13· Issue 1

Abstract

Intelligent lung nodules classification is a meaningful and challenging research topic for early precaution of lung cancers, which aims to diagnose the malignancy of candidate nodules from the pulmonary computed tomography images. Nowadays, deep learning methods have made significant achievements in the medical field and promoted developments of lung nodules classification. Nevertheless, mainstream CNNs-based networks typically excel in learning coarse-grained local feature representations via stacked local-aware and weight-shared convolutions, and cannot practically model the long-range context interaction and the spatial dependencies. To tackle the above difficulties, we innovatively propose an effective Multi-Granularity Dilated Transformer to learn the long-range context relations, and explore fine-grained local details via the proposed Local Focus Scheme. Specifically, we delicately design a novel Deformable Dilated Transformer to incorporate diverse contextual information with self-attention for learning long-range global spatial dependencies. Moreover, numerous investigations indicate that local details are extremely crucial to classify indistinguishable lung nodules. Thus, we propose the Local Focus Scheme to focus on the more discriminative local features by modeling channel-wise grouped topology. Consequently, the Multi-Granularity Dilated Transformer is constructed by leveraging the Local Focus Scheme to guide the Deformable Dilated Transformer for learning fine-grained local cues. Experimental results on the mainstream benchmark LIDC-IDRI demonstrate the superiority of our model compared with the state-of-the-art methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Lung Cancer Diagnosis and Treatment · COVID-19 diagnosis using AI · Radiomics and Machine Learning in Medical Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611756, China

Funding

Key Research and Development Program of Sichuan Province

References (43)

Show source-provided references
1. Lung nodule classification with multilevel patch-based context analysis10.1109/TBME.2013.2295593 ↗
2. Comparing two classes of end-to-end machine-learning models in lung nodule detection and classification: MTANNs vs. CNNs10.1016/j.patcog.2016.09.029 ↗
3. Deep learning for image-based cancer detection and diagnosis—A survey10.1016/j.patcog.2018.05.014 ↗
4. Automated pulmonary nodule detection in CT images using deep convolutional neural networks10.1016/j.patcog.2018.07.031 ↗
5. Gated-dilated networks for lung nodule classification in CT scans10.1109/ACCESS.2019.2958663 ↗
6. MSCS-DeepLN: Evaluating lung nodule malignancy using multi-scale cost-sensitive neural networks10.1016/j.media.2020.101772 ↗
7. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
8. Automatic segmentation of lung nodules with growing neural gas and support vector machine10.1016/j.compbiomed.2012.09.003 ↗
9. Pulmonary nodule classification with deep residual networks10.1007/s11548-017-1605-6 ↗
10. Hussein, S., Cao, K., Song, Q., and Bagci, U. (2017, January 25–30). Risk stratification of lung nodules using 3D CNN-based multi-task learning. Proceedings of the International Conference on Information Processing in Medical Imaging, Boon, NC, USA.10.1007/978-3-319-59050-9_20 ↗
11. Zhu, W., Liu, C., Fan, W., and Xie, X. (2018, January 12–15). Deeplung: Deep 3d dual path nets for automated pulmonary nodule detection and classification. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.10.1109/WACV.2018.00079 ↗
12. Attentive and ensemble 3D dual path networks for pulmonary nodules classification10.1016/j.neucom.2019.03.103 ↗
13. Lung nodules diagnosis based on evolutionary convolutional neural network10.1007/s11042-017-4480-9 ↗
14. Learning efficient, explainable and discriminative representations for pulmonary nodules classification10.1016/j.patcog.2021.107825 ↗
15. ProCAN: Progressive growing channel attentive non-local network for lung nodule classification10.1016/j.patcog.2021.108309 ↗
16. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23–28). End-to-end object detection with transformers. Proceedings of the European Conference on Computer Vision, Glasgow, UK.10.1007/978-3-030-58452-8_13 ↗
17. Zhu, X., Su, W., Lu, L., Li, B., Wang, X., and Dai, J. (2020, January 26–30). Deformable DETR: Deformable Transformers for End-to-End Object Detection. Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia.
18. Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., and Tang, X. (2017, January 21–26). Residual attention network for image classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.683 ↗
19. Bello, I., Zoph, B., Vaswani, A., Shlens, J., and Le, Q.V. (November, January 27). Attention augmented convolutional networks. Proceedings of the PIEEE/CVF International Conference on Computer Vision, Seoul, Korea.
20. Ramachandran, P., Parmar, N., Vaswani, A., Bello, I., Levskaya, A., and Shlens, J. (2019). Stand-alone self-attention in vision models. Adv. Neural Inf. Process. Syst., 32.
21. Zhu, X., Hu, H., Lin, S., and Dai, J. (2019, January 16–17). Deformable convnets v2: More deformable, better results. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00953 ↗
22. Yang, Z., He, X., Gao, J., Deng, L., and Smola, A. (2016, January 27–30). Stacked attention networks for image question answering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.10 ↗
23. Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., Liu, W., and Chua, T.S. (2017, January 21–26). Sca-cnn: Spatial and channel-wise attention in convolutional networks for image captioning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.667 ↗
24. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
25. Jaderberg, M., Simonyan, K., and Zisserman, A. (2015). Spatial transformer networks. Adv. Neural Inf. Process. Syst., 28.
26. Mnih, V., Heess, N., and Graves, A. (2014). Recurrent models of visual attention. Adv. Neural Inf. Process. Syst., 27.
27. Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhudinov, R., Zemel, R., and Bengio, Y. (2015, January 7–9). Show, attend and tell: Neural image caption generation with visual attention. Proceedings of the International Conference on Machine Learning, PMLR, Lille, France.
28. Qin, Z., Zhang, P., Wu, F., and Li, X. (2021, January 11–17). Fcanet: Frequency channel attention networks. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00082 ↗
29. Choi, M., Kim, H., Han, B., Xu, N., and Lee, K.M. (2020, January 7–12). Channel attention is all you need for video frame interpolation. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6693 ↗
30. Bastidas, A.A., and Tang, H. (2019, January 16–17). Channel attention networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.10.1109/CVPRW.2019.00117 ↗
31. Automatic COVID-19 CT segmentation using U-Net integrated spatial and channel attention mechanism10.1002/ima.22527 ↗
32. Fang, W., and Han, X.h. (2020, January 30). Spatial and channel attention modulated network for medical image segmentation. Proceedings of the Proceedings of the Asian Conference on Computer Vision, Kyoto, Japan.10.1007/978-3-030-69756-3_1 ↗
33. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
34. Wu, Y., and He, K. (2018, January 8–14). Group normalization. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01261-8_1 ↗
35. Yu, F., and Koltun, V. (2015). Multi-scale context aggregation by dilated convolutions. arXiv.
36. The lung image database consortium (LIDC) and image database resource initiative (IDRI): A completed reference database of lung nodules on CT scans10.1118/1.3528204 ↗
37. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
38. An interpretable deep hierarchical semantic convolutional neural network for lung nodule malignancy classification10.1016/j.eswa.2019.01.048 ↗
39. Multi-crop convolutional neural networks for lung nodule malignancy suspiciousness classification10.1016/j.patcog.2016.05.029 ↗
40. Lung nodule classification using deep local–global networks10.1007/s11548-019-01981-7 ↗
41. Detection and classification of pulmonary nodules using deep learning and swarm intelligence10.1007/s11042-019-7473-z ↗
42. Knowledge-based collaborative deep learning for benign-malignant lung nodule classification on chest CT10.1109/TMI.2018.2876510 ↗
43. Semi-supervised adversarial model for benign–malignant lung nodule classification on chest CT10.1016/j.media.2019.07.004 ↗