journal article·2025-11Open access

CRCFound: A Colorectal Cancer CT Image Foundation Model Based on Self‐Supervised Learning

Jing Yang, Du Cai, Junwei Liu, Zhenfeng Zhuang, Yibin Zhao, Feng‐ao Wang, Chenghang Li, Chuling Hu, Baowen Gai, Yiping Chen, Yixue Li, Liansheng Wang, Feng Gao, Xiaojian Wu

Advanced Science· Volume 12· Issue 41

Abstract

Abstract Accurate risk stratification is crucial for determining the optimal treatment plan for patients with colorectal cancer (CRC). However, existing deep learning models perform poorly in the preoperative diagnosis of CRC and exhibit limited generalizability, primarily due to insufficient annotated data. To address these issues, CRCFound, a self‐supervised learning‐based CT image foundation model for CRC is proposed. After pretraining on 5137 unlabeled CRC CT images, CRCFound can learn universal feature representations and provide efficient and reliable adaptability for various clinical applications. Comprehensive benchmark tests are conducted on six different diagnostic tasks and two prognosis tasks to validate the performance of the pretrained model. Experimental results demonstrate that CRCFound can easily transfer to most CRC tasks and exhibit outstanding performance and generalization ability. Overall, CRCFound can solve the problem of insufficient annotated data and perform well in a wide range of downstream tasks of CRC, making it a promising solution for accurate diagnosis and personalized treatment of CRC patients.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Radiomics and Machine Learning in Medical Imaging · AI in cancer detection · Colorectal Cancer Screening and Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

National Institute for Data Science in Health and Medicine Xiamen University Xiamen 361005 China

Department of General Surgery (Department of Colorectal Surgery) The Sixth Affiliated Hospital Sun Yat‐sen University Guangzhou 510655 China

Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases The Sixth Affiliated Hospital Sun Yat‐sen University Guangzhou 510655 China

Biomedical Innovation Center The Sixth Affiliated Hospital Sun Yat‐sen University Guangzhou 510655 China

Guangzhou National Laboratory Guangzhou 510655 China

Department of Computer Science at the School of Informatics Xiamen University Xiamen 361005 China

Department of Colorectal Surgery Ningbo Medical Center Lihuili Hospital (Affiliated Lihuili Hospital of Ningbo University) Ningbo 315000 China

Key Laboratory of Systems Health Science of Zhejiang Province School of Life Science Hangzhou Institute for Advanced Study University of Chinese Academy of Sciences Hangzhou 310024 China

Artificial Intelligence Thrust The Hong Kong University of Science and Technology Guangzhou 510655 China

School of Geospatial Engineering and Science Sun Yat‐sen University Zhuhai 510655 China

Shanghai Institute of Nutrition and Health Chinese Academy of Sciences Shanghai 200030 China

GZMU‐GIBH Joint School of Life Sciences The Guangdong‐Hong Kong‐Macau Joint Laboratory for Cell Fate Regulation and Diseases Guangzhou Medical University Guangzhou 511436 China

School of Life Sciences and Biotechnology Shanghai Jiao Tong University Shanghai 200240 China

Shanghai Artificial Intelligence Laboratory Shanghai 200433 China

Funding

Ministry of Science and Technology of the People's Republic of China · National Natural Science Foundation of China · Basic and Applied Basic Research Foundation of Guangdong Province

References (45)

Show source-provided references
1. 10.3322/caac.2177210.3322/caac.21772 ↗
2. 10.1038/s41392-020-0116-z10.1038/s41392-020-0116-z ↗
3. 10.1038/nm.396710.1038/nm.3967 ↗
4. 10.1200/JCO.22.0258210.1200/JCO.22.02582 ↗
5. 10.1056/NEJMoa220144510.1056/NEJMoa2201445 ↗
6. 10.1016/j.bios.2017.06.05110.1016/j.bios.2017.06.051 ↗
7. 10.1038/s41467-020-18162-910.1038/s41467-020-18162-9 ↗
8. 10.1148/radiol.21198610.1148/radiol.211986 ↗
9. 10.1200/JCO.2015.65.912810.1200/JCO.2015.65.9128 ↗
10. Cui Y. · Int J Surg · 2024 · 10 · 1097
11. Chen T. · Int. Conf. Mach. Learn. (ICML) · 2020 · 1597
12. M.Oquab T.Darcet T.Moutakanni H.Vo M.Szafranies V.Khalidov P.Fernandez D.Haziza F.Massa A.El‐Nouby arXiv2023 07193.
13. H.Zhang F.Li S.Liu L.Zhang H.Su J.Zhu L. M.Ni H.‐Y.Shum arXiv2022 03605.
14. M.Singh Q.Duval K. V.Alwala H.Fan V.Aggarwal A.Adcock A.Joulin P.Dollár C.Feichtenhofer R.Girshick inProc. of the IEEE/CVF Int. Conf. on Computer Vision IEEE Paris France2023 pp.5484–5493.
15. 10.1038/s41551-022-00914-110.1038/s41551-022-00914-1 ↗
16. 10.1038/s41586-023-05881-410.1038/s41586-023-05881-4 ↗
17. 10.1109/TPAMI.2020.299239310.1109/TPAMI.2020.2992393 ↗
18. Xu H. · Nature · 2024 · 181 · 630
19. 10.1016/j.media.2022.10255910.1016/j.media.2022.102559 ↗
20. 10.1038/s41591-024-03141-010.1038/s41591-024-03141-0 ↗
21. 10.1016/j.media.2022.10264510.1016/j.media.2022.102645 ↗
22. 10.1038/s41586-024-07894-z10.1038/s41586-024-07894-z ↗
23. 10.1038/s41586-024-08378-w10.1038/s41586-024-08378-w ↗
24. X.Wang Y.Jiang S.Yang F.Wang X.Zhang W.Wang Y.Chen X.Wu J.Xiang Y.Li X.Jiang W.Yuan J.Zhang K.Yu R.Ward N.Hawkins J.Jonnageddala G.Li R.Li J. Clin. Oncol2025 JCO.
25. L.Zhu X.Ling M.Ouyang X.Liu T.Guan M.Fu Z.Cheng F.Fu M.Zeng L.Liu S.Duan Q.Huang Y.Xiao J.Li S.Lu Z.Piao M.Zhu Y.Jin S.Xu Q.He Y.Wang J.Cheng X.Wang L.Xie H.Li S.Tian Y.He arXiv2025 21928.
26. R. R.Selvaraju M.Cogswell A.Das A.Das R.Vedantam D.Parikh D.Batra inProceedings of the IEEE international conference on computer visionIEEE Venice Italy2017 pp.618–626.10.1109/ICCV.2017.74 ↗
27. Cai T. T. · J. Mach. Learn. Res. · 2022 · 23 · 1
28. 10.3390/curroncol2806044710.3390/curroncol28060447 ↗
29. 10.1097/DCR.000000000000138710.1097/DCR.0000000000001387 ↗
30. 10.1007/s00261-020-02672-710.1007/s00261-020-02672-7 ↗
31. 10.1016/j.ejca.2023.11331410.1016/j.ejca.2023.113314 ↗
32. R.Zhang Z.Bai R.Yu W.Pang L.Wang L.Zhu X.Zhang H.Zhang W.Hu arXiv2023 04677.
33. 10.1007/s00261-023-03904-210.1007/s00261-023-03904-2 ↗
34. 10.1016/j.ejca.2022.06.06010.1016/j.ejca.2022.06.060 ↗
35. 10.5505/aot.2021.3779010.5505/aot.2021.37790 ↗
36. 10.1038/s41598-022-07038-110.1038/s41598-022-07038-1 ↗
37. 10.1038/s41591-018-0177-510.1038/s41591-018-0177-5 ↗
38. 10.7150/thno.4986410.7150/thno.49864 ↗
39. 10.1038/s42256-024-00807-910.1038/s42256-024-00807-9 ↗
40. 10.1007/s10278-020-00327-z10.1007/s10278-020-00327-z ↗
41. S.Pathak J. V.Rossen O.Vijlbrief J.Geerdink M. V.Keulen in2018IEEE International Conference on Data Mining Workshops (ICDMW) IEEE Singapore2018.
42. K.He X.Chen S.Xie Y.Li P.Dollár R.Girshick inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition2022 IEEE New Orleans Louisiana USA pp.16000–16009.
43. A.Dosovitskiy L.Beyer A.Kolesnikov D.Weissenborn X.Zhai T.Unterthiner M.Dehghani M.Minderer G.Heigold S.Gelly J.Uszkoreit N.Houlsby arXiv2020 11929.
44. Z.Du Y.Qian X.Liu M.Ding J.Qiu Z.Yang J.Tang arXiv2021 10360.
45. A.Zeng X.Liu Z.Du Z.Wang H.Lai M.Ding Z.Yang Y.Xu W.Zheng X.Xia W. L.Tam Z.Ma Y.Xue J.Zhai W.Chen P.Zhang Y.Dong J.Tang arXiv2022 02414.