Transferable Deep Reinforcement Learning With Edge‐Contour‐Depth Fusion for Autonomous Wireless Capsule Endoscopy Navigation
Source abstract
Abstract
ABSTRACT Wireless capsule endoscopy (WCE) enables painless, minimally invasive visualization of the gastrointestinal tract. Still, its diagnostic potential is limited by incomplete mucosal coverage and poor transferability of existing navigation methods across patient anatomies. We propose a transferable, anatomical landmark‐guided deep reinforcement learning framework for robust autonomous gastric navigation. Leveraging a lightweight edge‐contour‐depth fusion module, our policy operates on stable, low‐dimensional landmark coordinates rather than high‐dimensional video streams. This design effectively bridges the sim‐to‐real visual gap and ensures robustness across diverse anatomies, enabling low‐cost deployment by reducing computational overhead. In simulations across eight patient‐derived models, the method achieves >97% coverage within 50 s, significantly outperforming vanilla Proximal Policy Optimization, Soft Actor‐Critic, and Deep Q‐Network agents by enhancing coverage and minimizing variance. To ensure deployment reliability, a two‐stage sim‐to‐real pipeline supported by an adaptive dynamic programming controller actively mitigates physical disturbances, including actuator latency and peristalsis. Ex vivo experiments across five independent scans demonstrate high coverage stability, achieving a mean coverage of 87% and a 53% reduction in procedure time compared with expert manual control. This study establishes a scalable paradigm for autonomous, high‑coverage endoscopic navigation, advancing the clinical deployment of intelligent WCE systems for GI diagnostics.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Gastrointestinal Bleeding Diagnosis and Treatment · Colorectal Cancer Screening and Detection · Soft Robotics and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electronic Engineering The Chinese University of Hong Kong Hong Kong China
School of Computer Science and Engineering University of New South Wales Sydney New South Wales Australia
Department of Mechanical and Automation Engineering The Chinese University of Hong Kong Hong Kong China
Qilu Hospital of Shandong University Jinan Shandong China
References (51)
Show source-provided references
1. Wireless Capsule Endoscopy10.1136/gut.52.suppl_4.iv48 ↗
2. Diagnosing Small Bowel Crohn's Disease With Wireless Capsule Endoscopy10.1136/gut.52.3.390 ↗
3. Small‐Bowel Tumors Detected by Wireless Capsule Endoscopy10.1007/s10620-006-9483-8 ↗
4. 10.1038/s41467‐024‐49019‐010.1038/s41467‐024‐49019‐0 ↗
5. Orlowska J. · 1995 · 90
6. Gastric Polyps and Protruding Type Gastric Cancer10.5946/ce.2013.46.3.243 ↗
7. Malignant Transformation of Hyperplastic Gastric Polyps: An Immunohistochemical and Pathological Study of the Changes of Neoplastic Phenotype10.3892/ol.2014.1932 ↗
8. Management of Gastric Polyps: an Endoscopy‐Based Approach10.1016/j.cgh.2013.03.019 ↗
9. Gastric Polyps: A Retrospective Analysis of 26,000 Digestive Endoscopies10.1590/S0004-28032007000100004 ↗
10. Capsule Endoscopy: Progress Update and Challenges Ahead10.1038/nrgastro.2009.69 ↗
11. Magnetically Controlled Capsule Endoscopy Versus Conventional Gastroscopy10.1097/MCG.0000000000001540 ↗
12. Standardized Examination Procedure of Magnetically Controlled Capsule Endoscopy10.1016/j.vgie.2019.03.003 ↗
13. Magnetically Guided Capsule Endoscopy10.1002/mp.12299 ↗
14. Capsule Endoscopy of the Future: What's on the Horizon?10.3748/wjg.v21.i37.10528 ↗
15. Magnetic Maneuvering of Endoscopic Capsules by Means of a Robotic Navigation System10.1109/TBME.2009.2013336 ↗
16. Frontiers of Robotic Endoscopic Capsules: A Review10.1007/s12213-016-0087-x ↗
17. Magnetically Driven Capsules With Multimodal Response and Multifunctionality for Biomedical Applications10.1038/s41467-024-46046-9 ↗
18. Independent Electromagnetic Field Control for Practical Approach to Actively Locomotive Wireless Capsule Endoscope10.1109/TSMC.2019.2917298 ↗
19. Five‐Degree‐Of‐Freedom Manipulation of an Untethered Magnetic Device in Fluid Using a Single Permanent Magnet With Application in Stomach Capsule Endoscopy10.1177/0278364914558006 ↗
20. Miniature Gastrointestinal Endoscopy: Now and the Future10.3748/wjg.v25.i30.4051 ↗
21. Motor‐Free Telerobotic Endomicroscopy for Steerable and Programmable Imaging in Complex Curved and Localized Areas10.1038/s41467-024-51633-x ↗
22. Magnetic Steering Continuum Robot for Transluminal Procedures With Programmable Shape and Functionalities10.1038/s41467-024-48058-x ↗
23. Three‐Degrees‐Of‐Freedom Orientation Manipulation of Small Untethered Robots With a Single Anisotropic Soft Magnet10.1038/s41467-023-42783-5 ↗
24. Localization of Wireless Capsule Endoscope: A Systematic Review10.1109/JSEN.2016.2645945 ↗
25. Capsule Endoscopy: From Current Achievements to Open Challenges10.1109/RBME.2011.2171182 ↗
26. Toward Automatic Stomach Screening Using a Wireless Magnetically Actuated Capsule Endoscope10.1109/TMRB.2024.3387040 ↗
27. A Deep CNN Model for Anomaly Detection and Localization in Wireless Capsule Endoscopy Images10.1016/j.compbiomed.2021.104789 ↗
28. A Deep Learning Based Fusion of RGB Camera Information and Magnetic Localization Information for Endoscopic Capsule Robots10.1007/s41315-017-0039-1 ↗
29. 10.1016/j.birob.2025.10023210.1016/j.birob.2025.100232 ↗
30. Learning to Navigate Endoscopic Capsule Robots10.1109/LRA.2019.2924846 ↗
31. Endoscopic Capsule Robot‐Based Diagnosis, Navigation and Localization in the Gastrointestinal Tract10.3389/frobt.2022.896028 ↗
32. Y.Zhang L.Bai L.Liu H.Ren andM. Q. H.Meng “Deep Reinforcement Learning‐Based Control for Stomach Coverage Scanning of Wireless Capsule Endoscopy ” in2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)(IEEE 2022) 01–06.10.1109/ROBIO55434.2022.10012018 ↗
33. VR‐Caps: a Virtual Environment for Capsule Endoscopy10.1016/j.media.2021.101990 ↗
34. 10.1111/nmo.1456010.1111/nmo.14560 ↗
35. Advances in Deep Learning Models for Resolving Medical Image Segmentation Data Scarcity Problem: a Topical Review10.1007/s11831-023-10028-9 ↗
36. A Systematic Review on Data Scarcity Problem in Deep Learning: Solution and Applications10.1145/3502287 ↗
37. 10.1109/TII.2022.323367510.1109/TII.2022.3233675 ↗
38. Y.Wang H.He andX.Tan “Truly Proximal Policy Optimization ” inProceedings of The 35th Uncertainty in Artificial Intelligence Conference(PMLR 2020) 113–122.
39. J.Fan Z.Wang Y.Xie andZ.Yang “A Theoretical Analysis of Deep Q‐Learning ” inProceedings of the 2nd Conference on Learning for Dynamics and Control(PMLR 2020) 486–489.
40. T.Haarnoja A.Zhou P.Abbeel andS.Levine “Soft Actor‐Critic: Off‐Policy Maximum Entropy Deep Reinforcement Learning With a Stochastic Actor ” inProceedings of the 35th International Conference on Machine Learning(PMLR 2018) 1861–1870.
41. Proximal Policy Optimization Via Enhanced Exploration Efficiency10.1016/j.ins.2022.07.111 ↗
42. 10.1016/j.birob.2025.10023110.1016/j.birob.2025.100231 ↗
43. Quality Indicators Common to All GI Endoscopic Procedures10.1038/ajg.2014.383 ↗
44. Capsule Endoscopy: Role of Bowel Preparation in Successful Visualization10.1080/00365520410003209 ↗
45. Feasibility of Stomach Exploration With a Guided Capsule Endoscope10.1055/s-0030-1255521 ↗
46. Sim2real Learning With Domain Randomization for Autonomous Guidewire Navigation in Robotic‐Assisted Endovascular Procedures10.1109/TASE.2025.3555559 ↗
47. Model‐Free Adaptive Dynamic Programming Based Near‐Optimal Decentralized Tracking Control of Reconfigurable Manipulators10.1007/s12555-016-0711-5 ↗
48. L.Bai T.Chen Q.Tan et al. “EndoUIC: Promptable Diffusion Transformer for Unified Illumination Correction in Capsule Endoscopy ”International Conference on Medical Image Computing and Computer‐Assisted Intervention15007(2024):296–306.10.1007/978-3-031-72104-5_29 ↗
49. 10.1109/TII.2024.346177410.1109/TII.2024.3461774 ↗
50. 10.1016/j.cgh.2016.05.01310.1016/j.cgh.2016.05.013 ↗
51. Endoslam Dataset and an Unsupervised Monocular Visual Odometry and Depth Estimation Approach for Endoscopic Videos10.1016/j.media.2021.102058 ↗