A Computer-Aided Detection System for the Detection of Lung Nodules Based on 3D-ResNet
Source abstract
Abstract
In recent years, the research into automatic aided detection systems for pulmonary nodules has been extremely active. Most of the existing studies are based on 2D convolution neural networks, which cannot make full use of computed tomography’s (CT) 3D spatial information. To address this problem, a computer-aided detection (CAD) system for lung nodules based on a 3D residual network (3D-ResNet) inspired by cognitive science is proposed in this paper. In this system, we feed the slice information extracted from three different axis planes into the U-NET network set, and make the joint decision to generate a candidate nodule set, which is the input of the proposed 3D residual network after extraction. We extracted 3D samples with 40, 44, 48, 52, and 56 mm sides from each candidate nodule in the candidate set and feed them into the trained residual network to get the probability of positive nodule after re-sampling the 3D sample to 48 × 48 × 48 mm 3 . Finally, a joint judgment is made based on the probabilities of five 3D samples of different sizes to obtain the final result. Random rotation and translation and data amplification technology are used to prevent overfitting during network training. The detection intensity on the largest public data set (i.e., the Lung Image Database Consortium and Image Database Resource Initiative—LIDC-IDRI) reached 86.5% and 92.3% at 1 frame per second (FPs) and 4 FPs respectively using our algorithm, which is better than most CAD systems using 2D convolutional neural networks. In addition, a 3D residual network and a multi-section 2D convolution neural network were tested on the unrelated Tianchi dataset. The results indicate that 3D-ResNet has better feature extraction ability than multi-section 2D-ConvNet and is more suitable for reduction of false positive nodules.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Lung Cancer Diagnosis and Treatment · COVID-19 diagnosis using AI · Radiomics and Machine Learning in Medical Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Science and Engineering, Shenyang Ligong University, Shenyang 110159, China
College of Computer Science & Engineering, Northeastern University, Shenyang 110819, China
Fidelity Investments Inc., Boston, MA 02210, USA
Department of Computer Science, IOWA State University, Ames, IA 50010, USA
Wal-mart Inc., Bentonville, AR 72712, USA
Funding
National Natural Science Foundation of China
References (37)
Show source-provided references
1. Colorectal cancer statistics, 201710.3322/caac.21395 ↗
2. National Lung Screening Trial Research Team, Aberle, D.R., Adams, A.M., Berg, C.D., Black, W.C., Clapp, J.D., Fagerstrom, R.M., Gareen, I.F., Gatsonis, C., and Marcus, P.M. (2011). Reduced lung-cancer mortality with low-dose computed tomographic screening. N. Engl. J. Med., 365, 395–409.10.1056/NEJMoa1102873 ↗
3. Bergtholdt, M., Wiemker, R., and Klinder, T. (March, January 28). Pulmonary nodule detection using a cascaded SVM classifier. Proceedings of the Medical Imaging 2016: Computer-Aided Diagnosis: International Society for Optics and Photonics, San Diego, CA, USA.10.1117/12.2216747 ↗
4. Toward clinically usable CAD for lung cancer screening with computed tomography10.1007/s00330-014-3329-0 ↗
5. Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images10.1016/j.media.2013.12.001 ↗
6. Automated pulmonary nodule detection system in computed tomography images: A hierarchical block classification approach10.3390/e15020507 ↗
7. Pehrson, L.M., Nielsen, M.B., and Ammitzbøl Lauridsen, C. (2019). Automatic pulmonary nodule detection applying deep learning or machine learning algorithms to the LIDC-IDRI database: A systematic review. Diagnostics, 9.10.3390/diagnostics9010029 ↗
8. Ongoing Evolution of Visual SLAM from Geometry to Deep Learning: Challenges and Opportunities10.1007/s12559-018-9591-8 ↗
9. Surface material recognition using active multi-modal extreme learning machine10.1007/s12559-018-9571-z ↗
10. Automated detection and classification for early stage lung cancer on CT images using deep learning
11. Zhu, W., Liu, C., Fan, W., and Xie, X. (2018, January 12–15). Deeplung: Deep 3d dual path nets for automated pulmonary nodule detection and classification. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.10.1109/WACV.2018.00079 ↗
12. Pulmonary nodule detection in CT images: False positive reduction using multi-view convolutional networks10.1109/TMI.2016.2536809 ↗
13. Van Ginneken, B., Setio, A.A., Jacobs, C., and Ciompi, F. (2015, January 16–19). Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans. Proceedings of the 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI), Brooklyn, NY, USA.10.1109/ISBI.2015.7163869 ↗
14. Roth, H.R., Lu, L., Seff, A., Cherry, K.M., Hoffman, J., Wang, S., Liu, J., Turkbey, E., and Summers, R.M. (2014, January 14–18). A new 2.5 D representation for lymph node detection using random sets of deep convolutional neural network observations. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Boston, MA, USA.10.1007/978-3-319-10404-1_65 ↗
15. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical image computing and computer-assisted intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
16. The lung image database consortium (LIDC) and image database resource initiative (IDRI): A completed reference database of lung nodules on CT scans10.1118/1.3528204 ↗
17. (2019, February 01). Tianchi Medical AI Competition. Available online: https://tianchi.aliyun.com/competition/entrance/231601/information.
18. ACR–STR practice parameter for the performance and reporting of lung cancer screening thoracic computed tomography (CT): 2014 (Resolution 4)10.1097/RTI.0000000000000097 ↗
19. Moira, B., Robbert van der, G., Michael de, K., Jeroen, M., and Guido, Z. (2018, November 01). ZNET-Lung Nodule Detection. Available online: https://www.github.com/gzuidhof/LUNA16/.
20. Dropout: A simple way to prevent neural networks from overfitting
21. Cogswell, M., Ahmed, F., Girshick, R., Zitnick, L., and Batra, D. (2015). Reducing overfitting in deep networks by decorrelating representations. arXiv.
22. Glorot, X., Bordes, A., and Bengio, Y. (2011, January 11–13). Deep sparse rectifier neural networks. Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Ft. Lauderdale, FL, USA.
23. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
24. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
25. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
26. Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv.
27. Glorot, X., and Bengio, Y. (2010, January 13–15). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Sardinia, Italy.
28. On combining computer-aided detection systems10.1109/TMI.2010.2072789 ↗
29. A large-scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification10.1016/j.media.2009.07.001 ↗
30. Automatic detection of large pulmonary solid nodules in thoracic CT images10.1118/1.4929562 ↗
31. Multilevel contextual 3-D CNNs for false positive reduction in pulmonary nodule detection10.1109/TBME.2016.2613502 ↗
32. Large scale validation of the M5L lung CAD on heterogeneous CT datasets10.1118/1.4907970 ↗
33. Phased searching with NEAT in a time-scaled framework: Experiments on a computer-aided detection system for lung nodules10.1016/j.artmed.2013.07.002 ↗
34. Fast lung nodule detection in chest CT images using cylindrical nodule-enhancement filter10.1007/s11548-012-0767-5 ↗
35. Automatic detection of lung nodules in CT datasets based on stable 3D mass–spring models10.1016/j.compbiomed.2012.09.002 ↗
36. High performance lung nodule detection schemes in CT using local and global information10.1118/1.4737109 ↗
37. False-positive reduction on lung nodules detection in chest radiographs by ensemble of convolutional neural networks10.1109/ACCESS.2018.2817023 ↗