journal article·2024-09-06Open access

Trackerless 3D Freehand Ultrasound Reconstruction: A Review

Chrissy A. Adriaans, Mark Wijkhuizen, Lennard M. van Karnenbeek, Freija Geldof, Behdad Dashtbozorg

Applied Sciences· Volume 14· Issue 17

Abstract

Two-dimensional ultrasound (2D US) is commonly used in clinical settings for its cost-effectiveness and non-invasiveness, but it is limited by spatial orientation and operator dependency. Three-dimensional ultrasound (3D US) overcomes these limitations by adding a third dimension and enhancing integration with other imaging modalities. Advances in deep learning (DL) have further propelled the viability of freehand image-based 3D reconstruction, broadening clinical applications in intraoperative and point-of-care (POC) settings. This review evaluates state-of-the-art freehand 3D US reconstruction methods that eliminate the need for external tracking devices, focusing on experimental setups, data acquisition strategies, and reconstruction methodologies. PubMed, Scopus, and IEEE Xplore were searched for studies since 2014 following the PRISMA guidelines, excluding those using additional imaging or tracking systems other than inertial measurement units (IMUs). Fourteen eligible studies were analyzed, showing a shift from traditional speckle decorrelation towards DL-based methods, particularly convolutional neural networks (CNNs). Variability in datasets and evaluation methods hindered a comprehensive quantitative comparison, but notable accuracy improvements were observed with IMUs and integration of contextual and temporal information within CNNs. These advancements enhance freehand 3D US reconstruction feasibility, though variability limits definitive conclusions about the most effective methods. Future research should focus on improving precision in complex trajectories and adaptability across clinical scenarios.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Surgical Simulation and Training · Photoacoustic and Ultrasonic Imaging · Ultrasound Imaging and Elastography

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Image-Guided Surgery, Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands

Technical Medicine, Faculty of Mechanical, Maritime, and Materials Engineering, Delft University of Technology, Mekelweg 2, 2628 CD Delft, The Netherlands

Funding

Dutch Cancer Society and of the Dutch Ministry of Health, Welfare and Sport

References (27)

Show source-provided references
1. Three-Dimensional Ultrasound Imaging10.1146/annurev.bioeng.2.1.457 ↗
2. Freehand 3-D Ultrasound Imaging: A Systematic Review10.1016/j.ultrasmedbio.2017.06.009 ↗
3. Lang, A., Parthasarathy, V., and Jain, A.K. (2012). Calibration of EM Sensors for Spatial Tracking of 3 D Ultrasound Probes. Data Acquisition Applications, IntechOpen. chapter 0.10.5772/50695 ↗
4. Huang, Q., and Zeng, Z. (2017). A Review on Real-Time 3D Ultrasound Imaging Technology. BioMed Res. Int., 2017.10.1155/2017/6027029 ↗
5. (2024, July 01). Clarius Website. Available online: http://www.clarius.me.
6. Determination of scan-plane motion using speckle decorrelation: Theoretical considerations and initial test10.1002/(SICI)1098-1098(1997)8:1<38::AID-IMA5>3.0.CO;2-U ↗
7. 3-D US frame positioning using speckle decorrelation and image registration10.1016/S0301-5629(03)00036-X ↗
8. Sensorless freehand 3D ultrasound in real tissue: Speckle decorrelation without fully developed speckle10.1016/j.media.2005.08.001 ↗
9. On Feature Motion Decorrelation in Ultrasound Speckle Tracking10.1109/TMI.2012.2230016 ↗
10. Nonlocal means filter-based speckle tracking10.1109/TUFFC.2015.007134 ↗
11. Deep learning10.1038/nature14539 ↗
12. Page, M.J., McKenzie, J.E., Bossuyt, P.M., Boutron, I., Hoffmann, T.C., Mulrow, C.D., Shamseer, L., Tetzlaff, J.M., Akl, E.A., and Brennan, S.E. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, n71.10.1136/bmj.n71 ↗
13. Deep Learning in Medical Image Analysis10.1146/annurev-bioeng-071516-044442 ↗
14. Tetrel, L., Chebrek, H., and Laporte, C. (2016, January 17). Learning for graph-based sensorless freehand 3D ultrasound. Proceedings of the Machine Learning in Medical Imaging (MLMI) 2016, Athens, Greece.10.1007/978-3-319-47157-0_25 ↗
15. Balakrishnan, S., Patel, R., Illanes, A., and Friebe, M. (2019, January 23–27). Novel Similarity Metric for Image-Based Out-Of-Plane Motion Estimation in 3D Ultrasound. Proceedings of the 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS), Berlin, Germany.10.1109/EMBC.2019.8857148 ↗
16. Guo, H., Xu, S., Wood, B., and Yan, P. (2020, January 4–8). Sensorless Freehand 3D Ultrasound Reconstruction via Deep Contextual Learning. Proceedings of the Medical Image Computing and Computer Assisted Intervention—MICCAI 2020, Lima, Peru.10.1007/978-3-030-59716-0_44 ↗
17. Miura, K., Ito, K., Aoki, T., Ohmiya, J., and Kondo, S. (2020, January 4–8). Localizing 2D Ultrasound Probe from Ultrasound Image Sequences Using Deep Learning for Volume Reconstruction. Proceedings of the Medical Ultrasound, and Preterm, Perinatal and Paediatric Image Analysis, ASMUS PIPPI 2020, Lima, Peru.10.1007/978-3-030-60334-2_10 ↗
18. Guo, H., Xu, S., Wood, B.J., and Yan, P. (2021, January 13–16). Transducer adaptive ultrasound volume reconstruction. Proceedings of the IEEE 18th International Symposium on Biomedical Imaging (ISBI), Nice, France.10.1109/ISBI48211.2021.9433756 ↗
19. Luo, M., Yang, X., Wang, H., Du, L., and Ni, D. (2022, January 18–22). Deep Motion Network for Freehand 3D Ultrasound Reconstruction. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Singapore.10.1007/978-3-031-16440-8_28 ↗
20. RecON: Online learning for sensorless freehand 3D ultrasound reconstruction10.1016/j.media.2023.102810 ↗
21. Luo, M., Yang, X., Yan, Z., Li, J., Zhang, Y., Chen, J., Hu, X., Qian, J., Cheng, J., and Ni, D. (2023, January 8–12). Multi-IMU with online self-consistency for freehand 3D ultrasound reconstruction. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Vancouver, BC, Canada.10.1007/978-3-031-43907-0_33 ↗
22. Long-Term Dependency for 3D Reconstruction of Freehand Ultrasound Without External Tracker10.1109/TBME.2023.3325551 ↗
23. 3D freehand ultrasound without external tracking using deep learning10.1016/j.media.2018.06.003 ↗
24. Stretched reconstruction based on 2D freehand ultrasound for peripheral artery imaging10.1007/s11548-022-02636-w ↗
25. Wein, W., Lupetti, M., Zettinig, O., Jagoda, S., Salehi, M., Markova, V., Zonoobi, D., and Prevost, R. (2020, January 4–8). Three-Dimensional Thyroid Assessment from Untracked 2D Ultrasound Clips. Proceedings of the Medical Image Computing and Computer Assisted Intervention—MICCAI 2020, Lima, Peru.10.1007/978-3-030-59716-0_49 ↗
26. Ultrasound Volume Reconstruction From Freehand Scans Without Tracking10.1109/TBME.2022.3206596 ↗
27. Martin, M., Sciolla, B., Sdika, M., Wang, X., Quetin, P., and Delachartre, P. (2018, January 22–25). Automatic Segmentation of the Cerebral Ventricle in Neonates Using Deep Learning with 3D Reconstructed Freehand Ultrasound Imaging. Proceedings of the 2018 IEEE International Ultrasonics Symposium (IUS), Kobe, Japan.10.1109/ULTSYM.2018.8580214 ↗