journal article·2022-12-30Open access

Automatic Hepatic Vessels Segmentation Using RORPO Vessel Enhancement Filter and 3D V-Net with Variant Dice Loss Function

Petra Svobodova, Khyati Sethia, Petr Strakos, Alice Varysova

Applied Sciences· Volume 13· Issue 1

Abstract

The segmentation of hepatic vessels is crucial for liver surgical planning. It is also a challenging task because of its small diameter. Hepatic vessels are often captured in images of low contrast and resolution. Our research uses filter enhancement to improve their contrast, which helps with their detection and final segmentation. We have designed a specific fusion of the Ranking Orientation Responses of Path Operators (RORPO) enhancement filter with a raw image, and we have compared it with the fusion of different enhancement filters based on Hessian eigenvectors. Additionally, we have evaluated the 3D U-Net and 3D V-Net neural networks as segmentation architectures, and have selected 3D V-Net as a better segmentation architecture in combination with the vessel enhancement technique. Furthermore, to tackle the pixel imbalance between the liver (background) and vessels (foreground), we have examined several variants of the Dice Loss functions, and have selected the Weighted Dice Loss for its performance. We have used public 3D Image Reconstruction for Comparison of Algorithm Database (3D-IRCADb) dataset, in which we have manually improved upon the annotations of vessels, since the dataset has poor-quality annotations for certain patients. The experiments demonstrate that our method achieves a mean dice score of 76.2%, which outperforms other state-of-the-art techniques.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Medical Image Segmentation Techniques · Advanced Neural Network Applications · Retinal Imaging and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

IT4Innovations, VSB—Technical University of Ostrava, 70800 Ostrava-Poruba, Czech Republic

Funding

doctoral grant competition VSB—Technical University of Ostrava · Development of a tool for scientific data processing and visualization in VR

References (40)

Show source-provided references
1. Curvilinear structure analysis by ranking the orientation responses of path operators10.1109/TPAMI.2017.2672972 ↗
2. (2022, October 17). 3D-IRCADb. Available online: https://www.ircad.fr/research/data-sets/liver-segmentation-3d-ircadb-01/.
3. 3D Slicer as an image computing platform for the Quantitative Imaging Network10.1016/j.mri.2012.05.001 ↗
4. An Improved Fuzzy Connectedness Method for Automatic Three-Dimensional Liver Vessel Segmentation in CT Images10.1155/2018/2376317 ↗
5. A novel method to model hepatic vascular network using vessel segmentation, thinning, and completion10.1007/s11517-020-02128-6 ↗
6. Ciecholewski, M., and Kassjański, M. (2021). Computational methods for liver vessel segmentation in medical imaging: A Review. Sensors, 21.10.3390/s21062027 ↗
7. Yu, W., Fang, B., Liu, Y., Gao, M., Zheng, S., and Wang, Y. (2019, January 22–25). Liver vessels segmentation based on 3D residual U-NET. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.10.1109/ICIP.2019.8802951 ↗
8. Robust liver vessel extraction using 3D U-net with variant dice loss function10.1016/j.compbiomed.2018.08.018 ↗
9. Affane, A., Kucharski, A., Chapuis, P., Freydier, S., Lebre, M., Vacavant, A., and Fabijańska, A. (2021). Segmentation of liver anatomy by combining 3D U-net approaches. Appl. Sci., 11.10.3390/app11114895 ↗
10. Convolutional Neural Network Ensemble segmentation with ratio-based sampling for the arteries and veins in abdominal CT scans10.1109/TBME.2020.3042640 ↗
11. Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., and Ronneberger, O. (2016). 3D U-Net: Learning dense volumetric segmentation from sparse annotation. Medical Image Computing and Computer-Assisted Intervention, Proceedings of the MICCAI 2016, Athens, Greece, 17–21 October 2016, Springer.10.1007/978-3-319-46723-8_49 ↗
12. (2022, October 17). Segmentation of the Liver Competition 2007 (SLIVER07). Available online: https://sliver07.grand-challenge.org/.
13. Milletari, F., Navab, N., and Ahmadi, S. (2016, January 25–28). V-net: Fully convolutional neural networks for volumetric medical image segmentation. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA.10.1109/3DV.2016.79 ↗
14. DV-net: Accurate liver vessel segmentation via dense connection model with D-BCE loss function10.1016/j.knosys.2021.107471 ↗
15. Liver vessel segmentation based on inter-scale V-net10.3934/mbe.2021217 ↗
16. Altini, N., Prencipe, B., Brunetti, A., Brunetti, G., Triggiani, V., Carnimeo, L., and Cascarano, G.D. (2020). A tversky loss-based convolutional neural network for liver vessels segmentation. Intelligent Computing Theories and Application, Springer.10.1007/978-3-030-60799-9_30 ↗
17. Meng, X., Wang, G., Zhang, Y., Shi, X., Dai, H., Wang, Z., and Wang, X. (2022). Exploiting full Resolution Feature Context for Liver Tumor and Vessel Segmentation via Integrate Framework: Application to Liver Tumor and Vessel 3D Reconstruction under embedded microprocessor. arXiv.
18. Xu, M., Wang, Y., Chi, Y., and Hua, X. (2020, January 3–7). Training liver vessel segmentation deep neural networks on noisy labels from contrast CT Imaging. Proceedings of the 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), Iowa City, IA, USA.10.1109/ISBI45749.2020.9098509 ↗
19. (2022, October 17). Liver Tumor Segmentation Challenge (LiTS) Dataset. Available online: https://competitions.codalab.org/competitions/17094.
20. Robust retinal vessel segmentation using vessel’s location map and frangi enhancement filter10.1049/iet-ipr.2017.0457 ↗
21. Impact of image enhancement technique on CNN model for retinal blood vessels segmentation10.1109/ACCESS.2019.2950228 ↗
22. Blaiech, A.G., Mansour, A., Kerkeni, A., Bedoui, M.H., and Ben Abdallah, A. (2019). Impact of enhancement for coronary artery segmentation based on deep learning neural network. Iberian Conference on Pattern Recognition and Image Analysis, Springer.10.1007/978-3-030-31321-0_23 ↗
23. Lamy, J., Merveille, O., Kerautret, B., Passat, N., and Vacavant, A. (2021, January 10–15). Vesselness filters: A survey with benchmarks applied to liver imaging. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.10.1109/ICPR48806.2021.9412362 ↗
24. VascuSynth: Simulating vascular trees for generating volumetric image data with ground-truth segmentation and tree analysis10.1016/j.compmedimag.2010.06.002 ↗
25. Survarachakan, S., Pelanis, E., Khan, Z.A., Kumar, R.P., Edwin, B., and Lindseth, F. (2021). Effects of enhancement on Deep Learning based hepatic vessel segmentation. Electronics, 10.10.3390/electronics10101165 ↗
26. (2021, December 28). 3D Slicer. Available online: https://www.slicer.org/.
27. (2021, December 28). NVIDIA Clara Imaging. Available online: https://developer.nvidia.com/clara-medical-imaging.
28. (2021, December 28). Project MONAI. Available online: https://monai.io/.
29. (2021, December 28). Ai-Assisted-Annotation-Client. Available online: https://github.com/NVIDIA/ai-assisted-annotation-client/tree/master/slicer-plugin.
30. Simpson, A.L., Antonelli, M., Bakas, S., Bilello, M., Farahani, K., van Ginneken, B., Kopp-Schneider, A., Landman, B.A., Litjens, G., and Menze, B. (2019). A large annotated medical image dataset for the development and evaluation of segmentation algorithms. arXiv.
31. Attention-guided deep neural network with multi-scale feature fusion for liver vessel segmentation10.1109/JBHI.2020.3042069 ↗
32. Ng, C., Yap, M.H., Costen, N., and Li, B. (2015). Automatic wrinkle detection using Hybrid Hessian filter. Computer Vision— Proceedings of the ACCV 2014, Singapore, 1–5 November 2014, Springer.10.1007/978-3-319-16811-1_40 ↗
33. Frangi, A.F., Niessen, W.J., Vincken, K.L., and Viergever, M.A. (1998). Multiscale vessel enhancement filtering. Medical Image Computing and Computer-Assisted Intervention—Proceedings of the MICCAI’98, Cambridge, MA, USA, 11–13 October 1998, Springer.10.1007/BFb0056195 ↗
34. Design and validation of a tool for neurite tracing and analysis in fluorescence microscopy images10.1002/cyto.a.20022 ↗
35. Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images10.1016/S1361-8415(98)80009-1 ↗
36. (2021, December 28). RORPO GIT. Available online: https://github.com/path-openings/RORPO.
37. Scikit-image: Image processing in python10.7717/peerj.453 ↗
38. Wu, M., Qian, Y., Liao, X., Wang, Q., and Heng, P.A. (2021). Hepatic vessel segmentation based on 3Dswin-transformer with inductive biased multi-head self-attention. arXiv.
39. Sudre, C.H., Li, W., Vercauteren, T., Ourselin, S., and Jorge Cardoso, M. (2017). Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Springer.10.1007/978-3-319-67558-9_28 ↗
40. Jadon, S. (2020, January 27–29). A survey of loss functions for semantic segmentation. Proceedings of the 2020 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB), Viña del Mar, Chile.10.1109/CIBCB48159.2020.9277638 ↗