NeMCoF: Neural Material Composition Fields for Material Decomposition in Sparse-View Spectral X-ray CT
Source abstract
Abstract
Abstract Spectral X-ray computed tomography enables material decomposition by leveraging energy-dependent X-ray attenuation properties. However, material decomposition with spectral CT requires a longer acquisition time to obtain sufficient numbers of photons in each energy bin. Sparse-view offers a practical solution to reduce acquisition time, but it introduces ill-posedness, degrading decomposition accuracy. This study introduces a material decomposition framework based on Neural Radiance Fields where material maps are represented using a multilayer perceptron (MLP). The material maps are then optimized through a spectral forward projection process based on the Lambert–Beer’s law, while a partition of unity (PoU) loss ensures the physical constraint on material maps. Our method was evaluated using simulated and real spectral CT datasets and compared with a traditional statistical approach. The results demonstrated that our method performs well in material decomposition under sparse-view conditions. The results suggest that our “neural material composition fields” framework offers accurate material decomposition robust to sparse-view conditions without requiring labeled training data.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced X-ray and CT Imaging · Medical Imaging Techniques and Applications · Radiation Dose and Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (39)
Show source-provided references
1. Long, Y., Fessler, J.A.: Multi-material decomposition using statistical image reconstruction for spectral CT. IEEE Trans. Med. Imaging 33(8), 1614–1626 (2014). https://doi.org/10.1109/tmi.2014.232028410.1109/tmi.2014.2320284 ↗
2. Richtsmeier, D., Guliyev, E., Iniewski, K., Bazalova-Carter, M.: Contaminant detection in non-destructive testing using a CZT photon-counting detector. J. Instrum. 16(01), 01011–01011 (2021). https://doi.org/10.1088/1748-0221/16/01/p0101110.1088/1748-0221/16/01/p01011 ↗
3. Greffier, J., Villani, N., Defez, D., Dabli, D., Si-Mohamed, S.: Spectral ct imaging: Technical principles of dual-energy ct and multi-energy photon-counting ct. Diagn. Interv. Imaging 104(4), 167–177 (2023). https://doi.org/10.1016/j.diii.2022.11.00310.1016/j.diii.2022.11.003 ↗
4. Anderson, N.G., Butler, A.P., Scott, N.J.A., Cook, N.J., Butzer, J.S., Schleich, N., Firsching, M., Grasset, R., Ruiter, N., Campbell, M., Butler, P.H.: Spectroscopic (multi-energy) CT distinguishes iodine and barium contrast material in mice. Eur. Radiol. 20(9), 2126–2134 (2010). https://doi.org/10.1007/s00330-010-1768-910.1007/s00330-010-1768-9 ↗
5. Baturin, P., Alivov, Y., Molloi, S.: Spectral CT imaging of vulnerable plaque with two independent biomarkers. Phys. Med. Biol. 57(13), 4117–4138 (2012). https://doi.org/10.1088/0031-9155/57/13/411710.1088/0031-9155/57/13/4117 ↗
6. Wang, X., Meier, D., Mikkelsen, S., Maehlum, G.E., Wagenaar, D.J., Tsui, B.M.W., Patt, B.E., Frey, E.C.: MicroCT with energy-resolved photon-counting detectors. Phys. Med. Biol. 56(9), 2791–2816 (2011). https://doi.org/10.1088/0031-9155/56/9/01110.1088/0031-9155/56/9/011 ↗
7. Barber, W.C., Wessel, J.C., Nygard, E., Iwanczyk, J.S.: Energy dispersive CdTe and CdZnTe detectors for spectral clinical CT and NDT applications. Nuclear Instrum. Methods Phys. Res. Section A Accelerators Spectrometers Detectors Assoc. Equipment 784, 531–537 (2015). https://doi.org/10.1016/j.nima.2014.10.07910.1016/j.nima.2014.10.079 ↗
8. Wielopolski, L., Gardner, R.P.: Prediction of the pulse-height spectral distortion caused by the peak pile-up effect. Nucl. Inst. Methods 133(2), 303–309 (1976). https://doi.org/10.1016/0029-554x(76)90623-610.1016/0029-554x(76)90623-6 ↗
9. Mildenhall, B., Srinivasan, P.P., Tancik, M., Barron, J.T., Ramamoorthi, R., Ng, R.: NeRF: representing scenes as neural radiance fields for view synthesis. In: European Conference on Computer Vision (ECCV), pp. 405–421 (2020). https://doi.org/10.1007/978-3-030-58452-8_2410.1007/978-3-030-58452-8_24 ↗
10. Rückert, D., Wang, Y., Li, R., Idoughi, R., Heidrich, W.: NeAT: neural adaptive tomography. ACM Trans. Graph. 41(4), 1–13 (2022). https://doi.org/10.1145/3528223.353012110.1145/3528223.3530121 ↗
11. Zha, R., Zhang, Y., Li, H.: NAF: Neural attenuation fields for sparse-view CBCT reconstruction. In: Medical Image Computing and Computer Assisted Intervention (MICCAI), pp. 442–452 (2022). https://doi.org/10.1007/978-3-031-16446-0_4210.1007/978-3-031-16446-0_42 ↗
12. Cai, Y., Wang, J., Yuille, A., Zhou, Z., Wang, A.: Structure-aware sparse-view x-ray 3D reconstruction. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11174–11183 (2024). https://doi.org/10.1109/cvpr52733.2024.0106210.1109/cvpr52733.2024.01062 ↗
13. Zhao, T., Ding, G., Liu, Z., Hu, P., Wei, H., Tan, M., Ding, J.: DE-NAF: decoupled neural attenuation fields for sparse-view CBCT reconstruction. Pattern. Anal. Applic. 28(1) (2025). https://doi.org/10.1007/s10044-025-01416-x10.1007/s10044-025-01416-x ↗
14. Shi, L., Liu, C., Yang, P., Qiu, J., Zhao, X.: Ray-driven spectral ct reconstruction based on neural base-material fields. arXiv preprint arXiv:2404.06991 (2024)
15. Weidinger, T., Buzug, T.M., Flohr, T., Kappler, S., Stierstorfer, K.: Polychromatic iterative statistical material image reconstruction for photon-counting computed tomography. Int. J. Biomed. Imaging 2016(1), 5871604 (2016). https://doi.org/10.1155/2016/587160410.1155/2016/5871604 ↗
16. Johnson, T.R.C., Krauß, B., Sedlmair, M., Grasruck, M., Bruder, H., Morhard, D., Fink, C., Weckbach, S., Lenhard, M., Schmidt, B., Flohr, T., Reiser, M.F., Becker, C.R.: Material differentiation by dual energy CT: initial experience. Eur. Radiol. 17(6), 1510–1517 (2006). https://doi.org/10.1007/s00330-006-0517-610.1007/s00330-006-0517-6 ↗
17. McCollough, C.H., Leng, S., Yu, L., Fletcher, J.G.: Dual- and multi-energy CT: Principles, technical approaches, and clinical applications. Radiology 276(3), 637–653 (2015). https://doi.org/10.1148/radiol.201514263110.1148/radiol.2015142631 ↗
18. Grasruck, M., Kappler, S., Reinwand, M., Stierstorfer, K.: Dual energy with dual source CT and kVp switching with single source CT: a comparison of dual energy performance. In: Medical Imaging 2009: Physics of Medical Imaging, vol. 7258, pp. 1179–1188 (2009). https://doi.org/10.1117/12.811534 . SPIE10.1117/12.811534 ↗
19. Niu, T., Dong, X., Petrongolo, M., Zhu, L.: Iterative image-domain decomposition for dual-energy CT. Med. Phys. 41(4), 041901 (2014). https://doi.org/10.1118/1.486638610.1118/1.4866386 ↗
20. Zhao, W., Niu, T., Xing, L., Xie, Y., Xiong, G., Elmore, K., Zhu, J., Wang, L., Min, J.K.: Using edge-preserving algorithm with non-local mean for significantly improved image-domain material decomposition in dual-energy CT. Phys. Med. Biol. 61(3), 1332 (2016). https://doi.org/10.1088/0031-9155/61/3/133210.1088/0031-9155/61/3/1332 ↗
21. Zhao, Y., Zhao, X., Zhang, P.: An extended algebraic reconstruction technique (e-art) for dual spectral ct. IEEE Trans. Med. Imaging 34(3), 761–768 (2014)10.1109/TMI.2014.2373396 ↗
22. Cai, C., Rodet, T., Legoupil, S., Mohammad-Djafari, A.: A full-spectral bayesian reconstruction approach based on the material decomposition model applied in dual-energy computed tomography. Med. Phys. 40(11), 111916 (2013). https://doi.org/10.1118/1.482047810.1118/1.4820478 ↗
23. Jenkins, P.J., Schmidt, T.G.: Experimental study of photon-counting ct neural network material decomposition under conditions of pulse pileup. J. Med. Imaging 8(1), 013502–013502 (2021)10.1117/1.JMI.8.1.013502 ↗
24. Gong, H., Tao, S., Rajendran, K., Zhou, W., McCollough, C.H., Leng, S.: Deep-learning-based direct inversion for material decomposition. Med. Phys. 47(12), 6294–6309 (2020)10.1002/mp.14523 ↗
25. Guo, X., He, P., Lv, X., Ren, X., Li, Y., Liu, Y., Lei, X., Feng, P., Shan, H.: Material decomposition of spectral ct images via attention-based global convolutional generative adversarial network. Nucl. Sci. Tech. 34(3), 45 (2023)10.1007/s41365-023-01184-5 ↗
26. Lyu, T., Zhao, W., Zhu, Y., Wu, Z., Zhang, Y., Chen, Y., Luo, L., Li, S., Xing, L.: Estimating dual-energy ct imaging from single-energy ct data with material decomposition convolutional neural network. Med. Image Anal. 70, 102001 (2021)10.1016/j.media.2021.102001 ↗
27. Liu, L., Gu, J., Lin, K.Z., Chua, T.-S., Theobalt, C.: Neural sparse voxel fields. In: Neural Image Processing Systems (2020)
28. Reiser, C., Peng, S., Liao, Y., Geiger, A.: KiloNeRF: Speeding up neural radiance fields with thousands of tiny MLPs. In: IEEE/CVF International Conference on Computer Vision (ICCV) (2021). https://doi.org/10.1109/iccv48922.2021.0140710.1109/iccv48922.2021.01407 ↗
29. Fridovich-Keil, S., Yu, A., Tancik, M., Chen, Q., Recht, B., Kanazawa, A.: Plenoxels: Radiance fields without neural networks. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5491–5500 (2022). https://doi.org/10.1109/cvpr52688.2022.0054210.1109/cvpr52688.2022.00542 ↗
30. Müller, T., Evans, A., Schied, C., Keller, A.: Instant neural graphics primitives with a multiresolution hash encoding. ACM Trans. Graph. 41(4), 1–15 (2022). https://doi.org/10.1145/3528223.353012710.1145/3528223.3530127 ↗
31. Barron, J.T., Mildenhall, B., Verbin, D., Srinivasan, P.P., Hedman, P.: Mip-nerf 360: Unbounded anti-aliased neural radiance fields. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2022). https://doi.org/10.1109/cvpr52688.2022.0053910.1109/cvpr52688.2022.00539 ↗
32. Chen, A., Xu, Z., Geiger, A., Yu, J., Su, H.: Tensorf: Tensorial radiance fields. In: European Conference on Computer Vision (ECCV), pp. 333–350 (2022). https://doi.org/10.1007/978-3-031-19824-3_2010.1007/978-3-031-19824-3_20 ↗
33. Fang, Y., Mei, L., Li, C., Liu, Y., Wang, W., Cui, Z., Shen, D.: SNAF: Sparse-view CBCT reconstruction with neural attenuation fields (2022). https://doi.org/10.48550/arxiv.2211.1704810.48550/arxiv.2211.17048 ↗
34. National Institute of Standards and Technologies: X-Ray Mass Attenuation Coefficients. https://www.nist.gov/pml/x-ray-mass-attenuation-coefficients. Accessed 15 Apr 2025 (2025)
35. Bellon, C.: aRTist – Analytical RT Inspection Simulation Tool. https://www.artist.bam.de/. Accessed 15 Apr 2025 (2025)
36. Schlomka, J., Roessl, E., Dorscheid, R., Dill, S., Martens, G., Istel, T., Bäumer, C., Herrmann, C., Steadman, R., Zeitler, G., et al.: Experimental feasibility of multi-energy photon-counting k-edge imaging in pre-clinical computed tomography. Phys. Med. Biol. 53(15), 4031 (2008)10.1088/0031-9155/53/15/002 ↗
37. Mory, C., Sixou, B., Si-Mohamed, S., Boussel, L., Rit, S.: Comparison of five one-step reconstruction algorithms for spectral CT. Phys. Med. Biol. 63(23), 235001 (2018). https://doi.org/10.1088/1361-6560/aaeaf210.1088/1361-6560/aaeaf2 ↗
38. Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint (2014). https://doi.org/10.48550/arxiv.1412.698010.48550/arxiv.1412.6980 ↗
39. Smith, L.N.: Cyclical learning rates for training neural networks. In: 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 464–472 (2017). IEEE10.1109/WACV.2017.58 ↗