journal article·2025-09-02Open access

A simulation study towards sparse-view spectral X-ray CT segmentation using spectrum-aware deep neural networks

Siqi Wang, Tatsuya Yatagawa, Yutaka Ohtake

Abstract

Spectral X-ray computed tomography (SXCT) is able to provide richer spectral information than conventional X-ray CT, thereby improving the capability of discriminating materials in segmentation tasks. However, segmentation algorithms for conventional CT images often lose their performance in material segmentation with SXCT images due to the spectrum-dependent attenuation properties of X-rays. Recently, deep neural networks (DNNs) have demonstrated their effectiveness in segmentation tasks. However, processing SXCT with DNNs requires significant memory resources and may take significant computation time. To address these issues, this paper introduces a simulation study towards realising deep-learning-based SXCT image segmentation. The proposed method employs a convolutional neural network (CNN) that selectively utilises the significant spectrum channels for accurate material segmentation. The proposed method builds upon a prior study on adaptive CT reconstruction, but to further enhance the performance, we introduce a self-attention-based spectrum-selection module. During training, the selection module assigns importance weights to spectrum channels based on the attention scores. Once the network has been trained, the proposed method can obtain satisfactory segmentation results from projection images at one or a combination of several spectrum channels recommended by the selection module. The experimental results demonstrate that the proposed method achieves a significant reduction in computation time while maintaining the segmentation quality.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced X-ray and CT Imaging · Medical Imaging Techniques and Applications · Digital Radiography and Breast Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

The University of Tokyo

Hitotsubashi University

Funding

Japan Society for the Promotion of Science

References (43)

Show source-provided references
1. 10.1016/j.cad.2018.09.00210.1016/j.cad.2018.09.002 ↗
2. 10.1016/j.mri.2012.05.00110.1016/j.mri.2012.05.001 ↗
3. 10.1109/EMBC.2016.759144310.1109/EMBC.2016.7591443 ↗
4. 10.1016/j.procs.2019.04.14810.1016/j.procs.2019.04.148 ↗
5. 10.1016/j.procs.2023.01.43910.1016/j.procs.2023.01.439 ↗
6. 10.1016/j.proeng.2011.08.96010.1016/j.proeng.2011.08.960 ↗
7. 10.1002/jmri.2465510.1002/jmri.24655 ↗
8. 10.1109/IVCNZ.2013.672701410.1109/IVCNZ.2013.6727014 ↗
9. 10.5201/ipol.2021.29810.5201/ipol.2021.298 ↗
10. 10.1109/mysurucon55714.2022.997256210.1109/mysurucon55714.2022.9972562 ↗
11. 10.1186/s12859-023-05462-210.1186/s12859-023-05462-2 ↗
12. 10.1038/s41598-021-93227-310.1038/s41598-021-93227-3 ↗
13. 10.1186/s12880-020-00529-510.1186/s12880-020-00529-5 ↗
14. 10.1016/j.procs.2018.01.10410.1016/j.procs.2018.01.104 ↗
15. 10.1109/PuneCon50868.2020.936246310.1109/PuneCon50868.2020.9362463 ↗
16. 10.1002/mp.1345810.1002/mp.13458 ↗
17. 10.1016/j.bspc.2021.10290110.1016/j.bspc.2021.102901 ↗
18. 10.1016/j.compmedimag.2020.10181710.1016/j.compmedimag.2020.101817 ↗
19. 10.1155/2021/995698310.1155/2021/9956983 ↗
20. 10.1371/journal.pone.024735510.1371/journal.pone.0247355 ↗
21. 10.3389/fradi.2022.89910010.3389/fradi.2022.899100 ↗
22. 10.1007/978-3-030-32245-8_8510.1007/978-3-030-32245-8_85 ↗
23. 10.1002/mp.1531010.1002/mp.15310 ↗
24. 10.1117/12.265416110.1117/12.2654161 ↗
25. 10.1117/12.230966310.1117/12.2309663 ↗
26. 10.1118/1.352584010.1118/1.3525840 ↗
27. 10.1118/1.352583510.1118/1.3525835 ↗
28. 10.1088/1361-6560/ab2b0e10.1088/1361-6560/ab2b0e ↗
29. 10.1002/mp.1395010.1002/mp.13950 ↗
30. 10.1016/j.ejmp.2019.12.01410.1016/j.ejmp.2019.12.014 ↗
31. Chen S Roth H Innmann S et al. Towards automatic abdominal multi-organ segmentation in dual energy CT using cascaded 3D fully convolutional network. arXiv preprint arXiv:1710.05379. 2017.
32. 10.1109/iccvw60793.2023.0027110.1109/iccvw60793.2023.00271 ↗
33. 10.1080/10589759.2023.219564610.1080/10589759.2023.2195646 ↗
34. Vaswani A, Shazeer N, Parmar N et al. Attention is all you need. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, and Garnett R, editors. Advances in neural information processing systems. Vol. 30 (Long Beach, CL). 2017.
35. Selvaraju RR Das A Vedantam R et al. Grad-cam: why did you say that? Visual explanations from deep networks via gradient-based localization. CoRR abs/1610.02391. 2016. arXiv: 1610.02391.
36. 10.3233/bme-15143710.3233/bme-151437 ↗
37. Blalock D, Gonzalez Ortiz JJ, Frankle J et al. What is the state of neural network pruning? Proceedings of machine learning and systems Austin, TX; 2020. Vol. 2. p. 129–146.
38. 10.1364/josaa.1.00061210.1364/josaa.1.000612 ↗
39. Bellon C Jaenisch G-R. aRtist — analytical RT inspection simulation tool. 2007.
40. 10.1118/1.273472510.1118/1.2734725 ↗
41. 10.1118/1.273472610.1118/1.2734726 ↗
42. 10.1088/0031-9155/54/19/n0110.1088/0031-9155/54/19/n01 ↗
43. 10.1145/37402.3742210.1145/37402.37422 ↗