journal article·2020-11-28Open access

PICCOLO White-Light and Narrow-Band Imaging Colonoscopic Dataset: A Performance Comparative of Models and Datasets

Luisa F. Sánchez-Peralta, J. Blas Pagador, Artzai Picón, Ángel José Calderón, Francisco Polo, Nagore Andraka, Roberto Bilbao, Ben Glover, Cristina L. Saratxaga, Francisco M. Sánchez-Margallo

Applied Sciences· Volume 10· Issue 23

Abstract

Colorectal cancer is one of the world leading death causes. Fortunately, an early diagnosis allows for effective treatment, increasing the survival rate. Deep learning techniques have shown their utility for increasing the adenoma detection rate at colonoscopy, but a dataset is usually required so the model can automatically learn features that characterize the polyps. In this work, we present the PICCOLO dataset, that comprises 3433 manually annotated images (2131 white-light images 1302 narrow-band images), originated from 76 lesions from 40 patients, which are distributed into training (2203), validation (897) and test (333) sets assuring patient independence between sets. Furthermore, clinical metadata are also provided for each lesion. Four different models, obtained by combining two backbones and two encoder–decoder architectures, are trained with the PICCOLO dataset and other two publicly available datasets for comparison. Results are provided for the test set of each dataset. Models trained with the PICCOLO dataset have a better generalization capacity, as they perform more uniformly along test sets of all datasets, rather than obtaining the best results for its own test set. This dataset is available at the website of the Basque Biobank, so it is expected that it will contribute to the further development of deep learning methods for polyp detection, localisation and classification, which would eventually result in a better and earlier diagnosis of colorectal cancer, hence improving patient outcomes.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Colorectal Cancer Screening and Detection · AI in cancer detection · Radiomics and Machine Learning in Medical Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Jesús Usón Minimally Invasive Surgery Centre, N-521, km 41.7, E-10071 Cáceres, Spain

TECNALIA, Basque Research and Technology Alliance (BRTA), Parque Tecnológico de Bizkaia, C/Geldo. Edificio 700, E-48160 Derio-Bizkaia, Spain

Gastroenterology Department, Hospital Universitario Basurto, Avenida Montevideo, 18. E-48013 Bilbao, Spain

Basque Biobank, Basque Foundation for Health Innovation and Research-BIOEF, Ronda de Azkue 1, E-48902 Barakaldo, Spain

Imperial College London, Exhibition Road, South Kensington, London SW7 2BU, UK

Funding

Horizon 2020 Framework Programme

References (46)

Show source-provided references
1. International Agency for Research on Cancer (2018). Colorectal Cancer Factsheet, International Agency for Research on Cancer.
2. Stewart, B.W., and Wild, C.P. (2014). World Cancer Report 2014, International Agency for Research on Cancer.
3. Cancer statistics, 2015
4. Cancer statistics, 202010.3322/caac.21590 ↗
5. Improved survival of patients with colon cancer detected by screening colonoscopy10.1007/s00384-015-2501-6 ↗
6. Performance measures for lower gastrointestinal endoscopy: A European Society of Gastrointestinal Endoscopy (ESGE) quality improvement initiative10.1177/2050640617700014 ↗
7. Lund, M., Trads, M., Njor, S.H., Erichsen, R., and Andersen, B. (2019). Quality indicators for screening colonoscopy and colonoscopist performance and the subsequent risk of interval colorectal cancer: A systematic review. JBI Database Syst. Rev. Implement. Reports.10.11124/JBISRIR-2017-003927 ↗
8. Il Miss rate of colorectal neoplastic polyps and risk factors for missed polyps in consecutive colonoscopies10.5217/ir.2017.15.3.411 ↗
9. Automated polyp detection in the colorectum: A prospective study (with videos)10.1016/j.gie.2018.09.042 ↗
10. Technological advances for improving adenoma detection rates: The changing face of colonoscopy10.1016/j.dld.2017.03.030 ↗
11. Will Computer-Aided Detection and Diagnosis Revolutionize Colonoscopy?10.1053/j.gastro.2017.10.026 ↗
12. Deep learning10.1038/nature14539 ↗
13. Prospects of deep learning for medical imaging10.23838/pfm.2018.00030 ↗
14. Deep Learning in Medical Image Analysis10.1146/annurev-bioeng-071516-044442 ↗
15. Lee, G., and Fujita, H. (2020). Deep Learning in Medical Image Analysis. Deep Learning in Medical Image Analysis, Springer.10.1007/978-3-030-33128-3 ↗
16. Aziz, M., Fatima, R., Dong, C., Lee-Smith, W., and Nawras, A. (2020). The impact of deep convolutional neural network-based artificial intelligence on colonoscopy outcomes: A systematic review with meta-analysis. J. Gastroenterol. Hepatol., 1–8.10.1111/jgh.15070 ↗
17. Sánchez-Peralta, L.F., Bote-Curiel, L., Picón, A., Sánchez-Margallo, F.M., and Pagador, J.B. (2020). Deep learning to find colorectal polyps in colonoscopy: A systematic literature review. Artif. Intell. Med., 108.10.1016/j.artmed.2020.101923 ↗
18. Nogueira-Rodríguez, A., Domínguez-Carbajales, R., López-Fernández, H., Iglesias, Á., Cubiella, J., Fdez-Riverola, F., Reboiro-Jato, M., and Glez-Peña, D. (2020). Deep Neural Networks approaches for detecting and classifying colorectal polyps. Neurocomputing.10.1016/j.neucom.2020.02.123 ↗
19. Overview of deep learning in gastrointestinal endoscopy10.5009/gnl18384 ↗
20. Borgli, H., Thambawita, V., Smedsrud, P., Hicks, S., Jha, D., Eskeland, S., Randel, K.R., Pogorelov, K., Lux, M., and Dang-Nguyen, D.-T. (2020). HyperKvasir: A Comprehensive Multi-Class Image and Video Dataset for Gastrointestinal Endoscopy. Sci. Data, 7.10.1038/s41597-020-00622-y ↗
21. GTCreator: A flexible annotation tool for image-based datasets10.1007/s11548-018-1864-x ↗
22. Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation10.1016/j.media.2020.101693 ↗
23. Vázquez, D., Bernal, J., Sánchez, F.J., Fernández-Esparrach, G., López, A.M., Romero, A., Drozdzal, M., and Courville, A. (2017). A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images. J. Healthc. Eng.10.1155/2017/4037190 ↗
24. Jha, D., Smedsrud, P.H., Riegler, M.A., Halvorsen, P., de Lange, T., Johansen, D., and Johansen, H.D. (2020). Kvasir-SEG: A Segmented Polyp Dataset. Proceedings of the International Conference on Multimedia Modeling (MMM), Springer.10.1007/978-3-030-37734-2_37 ↗
25. Angermann, Q., Bernal, J., Sánchez-Montes, C., Hammami, M., Fernández-Esparrach, G., Dray, X., Romain, O., Sánchez, F.J., and Histace, A. (2017). Towards Real-Time Polyp Detection in Colonoscopy Videos: Adapting Still Frame-Based Methodologies for Video Sequences Analysis. Computer Assisted and Robotic Endoscopy and Clinical Image-Based Procedures, Springer.10.1007/978-3-319-67543-5_3 ↗
26. (2003). Participants in the Paris Workshop The Paris endoscopic classification of superficial neoplastic lesions: Esophagus, stomach, and colon. Gastrointest. Endosc., 58, S3–S43.10.1016/S0016-5107(03)02159-X ↗
27. (2005). Endoscopic Classification Review Group Update on the Paris Classification of Superficial Neoplastic Lesions in the Digestive Tract. Endoscopy, 37, 570–578.10.1055/s-2005-861352 ↗
28. Computer-Aided Classification of Gastrointestinal Lesions in Regular Colonoscopy10.1109/TMI.2016.2547947 ↗
29. Narrow-band imaging observation of colorectal lesions using NICE classification to avoid discarding significant lesions10.4253/wjge.v6.i12.600 ↗
30. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
31. Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2018). Densely Connected Convolutional Networks. arXiv.10.1109/CVPR.2017.243 ↗
32. U-Net: Convolutional Networks for Biomedical Image Segmentation
33. Chaurasia, A., and Culurciello, E. (2018). LinkNet: Exploiting encoder representations for efficient semantic segmentation. 2017 IEEE Vis. Commun. Image Process. VCIP, 1–4.10.1109/VCIP.2017.8305148 ↗
34. Sánchez-Peralta, L.F., Picón, A., Antequera-Barroso, J.A., Ortega-Morán, J.F., Sánchez-Margallo, F.M., and Pagador, J.B. (2020). Eigenloss: Combined PCA-Based Loss Function for Polyp Segmentation. Mathematics, 8.10.3390/math8081316 ↗
35. Yakubovskiy, P. Segmentation Models. Available online: https://github.com/qubvel/segmentation_models.
36. Chollet, F. (2020, November 24). Keras. Available online: https://github.com/keras-team/keras.
37. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2015). TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. CoRR.
38. Abaza, A., Harrison, M.A., and Bourlai, T. (2012, January 11–15). Quality metrics for practical face recognition. Proceedings of the Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), Tsukuba, Japan.
39. Tripathi, A.K., Mukhopadhyay, S., and Dhara, A.K. (2011, January 3–5). Performance metrics for image contrast. Proceedings of the 2011 International Conference on Image Information Processing, Shimla, India.10.1109/ICIIP.2011.6108900 ↗
40. An Extensive Study on Cross-Dataset Bias and Evaluation Metrics Interpretation for Machine Learning Applied to Gastrointestinal Tract Abnormality Classification10.1145/3386295 ↗
41. Real-time detection of colon polyps during colonoscopy using deep learning: Systematic validation with four independent datasets
42. Is it necessary to improve the colorectal polyps databases for detection CAD systems based on deep learning?
43. Inter-observer variability of manual contour delineation of structures in CT10.1007/s00330-018-5695-5 ↗
44. Chlebus, G., Meine, H., Thoduka, S., Abolmaali, N., Van Ginneken, B., Hahn, H.K., and Schenk, A. (2019). Reducing inter-observer variability and interaction time of MR liver volumetry by combining automatic CNN-based liver segmentation and manual corrections. PLoS ONE, 14.10.1371/journal.pone.0217228 ↗
45. Wickstrøm, K., Kampffmeyer, M., and Jenssen, R. (2020). Uncertainty and Interpretability in Convolutional Neural Networks for Semantic Segmentation of Colorectal Polyps. Med. Image Anal., 60.10.1016/j.media.2019.101619 ↗
46. Artificial intelligence versus clinicians: Systematic review of design, reporting standards, and claims of deep learning studies in medical imaging