On-the-Fly Machine Learning for Improving Image Resolution in Tomography
Source abstract
Abstract
In tomography, the resolution of the reconstructed 3D volume is inherently limited by the pixel resolution of the detector and optical phenomena. Machine learning has demonstrated powerful capabilities for super-resolution in several imaging applications. Such methods typically rely on the availability of high-quality training data for a series of similar objects. In many applications of tomography, existing machine learning methods cannot be used because scanning such a series of similar objects is either impossible or infeasible. In this paper, we propose a novel technique for improving the resolution of tomographic volumes that is based on the assumption that the local structure is similar throughout the object. Therefore, our approach does not require a training set of similar objects. The technique combines a specially designed scanning procedure with a machine learning method for super-resolution imaging. We demonstrate the effectiveness of our approach using both simulated and experimental data. The results show that the proposed method is able to significantly improve resolution of tomographic reconstructions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Medical Imaging Techniques and Applications · Advanced X-ray and CT Imaging · Advanced X-ray Imaging Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Centrum Wiskunde & Informatica, Science Park 123, 1098 XG Amsterdam, The Netherlands
Funding
Nederlandse Organisatie voor Wetenschappelijk Onderzoek
References (44)
Show source-provided references
1. High-resolution X-ray computed tomography in geosciences: A review of the current technology and applications10.1016/j.earscirev.2013.04.003 ↗
2. Electron tomography and holography in materials science10.1038/nmat2406 ↗
3. Neutron imaging in materials science10.1016/S1369-7021(11)70139-0 ↗
4. Optical tomography in medical imaging10.1088/0266-5611/15/2/022 ↗
5. Imaging of metallic foams using X-ray micro-CT10.1016/j.colsurfa.2009.01.008 ↗
6. High Resolution X-ray detector for synchrotron-based microtomography10.1016/S0168-9002(02)01167-1 ↗
7. Buzug, T.M. (2008). Computed Tomography: From Photon Statistics to Modern Cone–Beam CT, Springer.
8. Mueller, K. (1998). Fast and Accurate Three–Dimensional Reconstruction from Cone–Beam Projection Data Using Algebraic Methods. [Ph.D. Thesis, The Ohio State University].
9. Computed tomography using algebraic reconstruction techniques (ARTs) with different projection access schemes: A comparison study under practical situations10.1088/0031-9155/41/9/012 ↗
10. Acquisition, optimization and interpretation of X-ray computed tomographic imagery: Applications to the geosciences10.1016/S0098-3004(00)00116-3 ↗
11. Bayesian multiresolution method for local tomography in dental X-ray imaging10.1088/0031-9155/52/22/008 ↗
12. Tomosaic: Efficient acquisition and reconstruction of teravoxel tomography data using limited-size synchrotron X-ray beams10.1107/S1600577518010093 ↗
13. An accurate iterative reconstruction algorithm for sparse objects: Application to 3D blood vessel reconstruction from a limited number of projections10.1088/0031-9155/47/15/303 ↗
14. Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization10.1088/0031-9155/53/17/021 ↗
15. Evaluation of sparse-view reconstruction from flat-panel-detector cone-beam CT10.1088/0031-9155/55/22/001 ↗
16. DART: A practical reconstruction algorithm for discrete tomography10.1109/TIP.2011.2131661 ↗
17. Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21–26). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.19 ↗
18. RAISR: Rapid and accurate image super resolution10.1109/TCI.2016.2629284 ↗
19. Multiscale modeling of lithium-ion battery electrodes based on nano-scale X-ray computed tomography10.1016/j.jpowsour.2015.12.134 ↗
20. Practical cone-beam algorithm10.1364/JOSAA.1.000612 ↗
21. Brokish, J., and Bresler, Y. (November, January 29). Sampling requirements for circular cone beam tomography. Proceedings of the 2006 IEEE Nuclear Science Symposium Conference Record, San Diego, CA, USA.10.1109/NSSMIC.2006.356478 ↗
22. Space-filling X-ray source trajectories for efficient scanning in large-angle cone-beam computed tomography10.1109/TCI.2018.2841202 ↗
23. Possin, G.E., and Wei, C.Y. (1995). CT Array with Improved Photosensor Linearity and Reduced Crosstalk. (5,430,298), US Patent.
24. Kopp, F.K., Nasirudin, R.A., Mei, K., Fehringer, A., Pfeiffer, F., Rummeny, E.J., and Noël, P.B. (2015). Region of interest processing for iterative reconstruction in X-ray computed tomography. Medical Imaging 2015: Physics of Medical Imaging, SPIE.
25. Tisson, G., Scheunders, P., and Van Dyck, D. (2004, January 15–18). 3D region of interest X-ray CT for geometric magnification from multiresolution acquisitions. Proceedings of the 2nd IEEE International Symposium on Biomedical Imaging: Macro to Nano, Arlington, VA, USA.
26. A multiresolution approach to iterative reconstruction algorithms in X-ray computed tomography10.1109/TIP.2010.2046960 ↗
27. Varga, L., and Mokso, R. (2018). Iterative high resolution tomography from combined high-low resolution sinogram pairs. International Workshop on Combinatorial Image Analysis, Springer.10.1007/978-3-030-05288-1_12 ↗
28. New approaches to region of interest computed tomography10.1118/1.3583696 ↗
29. Approximate Truncation Robust Computed Tomography-ATRACT10.1088/0031-9155/58/17/6133 ↗
30. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. Medical Image Computing and Computer–Assisted Intervention - MICCAI 2015, Springer.10.1007/978-3-319-24574-4_28 ↗
31. Fully convolutional networks for semantic segmentation10.1109/TPAMI.2016.2572683 ↗
32. Deep convolutional neural network for inverse problems in imaging10.1109/TIP.2017.2713099 ↗
33. A mixed-scale dense convolutional neural network for image analysis10.1073/pnas.1715832114 ↗
34. Pelt, D.M., Batenburg, K.J., and Sethian, J.A. (2018). Improving tomographic reconstruction from limited data using mixed-scale dense convolutional neural networks. J. Imaging, 4.10.3390/jimaging4110128 ↗
35. The ASTRA Toolbox: A platform for advanced algorithm development in electron tomography10.1016/j.ultramic.2015.05.002 ↗
36. Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., and Lerer, A. (2017, January 4–9). Automatic differentiation in PyTorch. Proceedings of the NIPS-W, Long Beach, CA, USA.
37. Kingma, D.P., and Ba, J. (2014, January 2–4). ADAM: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations, Scottsdale, AZ, USA.
38. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
39. Hendriksen, A.A. Cone balls: A phantom generation package for cone beam CT geometries (v0.2.2). Zenodo.
40. Coban, S.B., Palenstijn, W.J., Buurlage, J.W., Kostenko, A., and Batenburg, K.J. FleX-ray Laboratory: A Highly Flexible Scanner for Explorative Imaging, In preparation.
41. Coban, S.B., Hendriksen, A.A., Pelt, D.M., Palenstijn, W.J., and Batenburg, K.J. (2019). Oatmeal Data: Experimental cone-beam tomographic data for techniques to improve image resolution. Zenodo.
42. Hendriksen, A.A. (2019). On_the_fly: Code accompanying the manuscript “On-the-Fly Machine Learning for Improving Image Resolution in Tomography”. Zenodo.
43. Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., and Ronneberger, O. (2016). 3D U-Net: Learning dense volumetric segmentation from sparse annotation. Lecture Notes in Computer Science, Springer.10.1007/978-3-319-46723-8_49 ↗
44. Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21–26). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗