journal article·2021-08-18Open access

Improving a Rapid Alignment Method of Tomography Projections by a Parallel Approach

Francesco Guzzi, George Kourousias, Alessandra Gianoncelli, Lorella Pascolo, Andrea Sorrentino, Fulvio Billè, Sergio Carrato

Applied Sciences· Volume 11· Issue 16

Abstract

The high resolution of synchrotron cryo-nano tomography can be easily undermined by setup instabilities and sample stage deficiencies such as runout or backlash. At the cost of limiting the sample visibility, especially in the case of bio-specimens, high contrast nano-beads are often added to the solution to provide a set of landmarks for a manual alignment. However, the spatial distribution of these reference points within the sample is difficult to control, resulting in many datasets without a sufficient amount of such critical features for tracking. Fast automatic methods based on tomography consistency are thus desirable, especially for biological samples, where regular, high contrast features can be scarce. Current off-the-shelf implementations of such classes of algorithms are slow if used on a real-world high-resolution dataset. In this paper, we present a fast implementation of a consistency-based alignment algorithm especially tailored to a multi-GPU system. Our implementation is released as open-source.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Electron Microscopy Techniques and Applications · Advanced X-ray Imaging Techniques · Electron and X-Ray Spectroscopy Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Elettra—Sincrotrone Trieste, Strada Statale 14, km 163.5 in Area Science Park I-34149 Basovizza, 34149 Trieste, Italy

Image Processing Laboratory (IPL), Engineering and Architecture Department, University of Trieste, Via A.Valerio 10, 34127 Trieste, Italy

Institute for Maternal and Child Health, IRCCS Burlo Garofolo, Via dell’Istria 65/1, 34137 Trieste, Italy

ALBA Synchrotron Light Source, Carrer de la Llum 2-26, 08290 Cerdanyola del Vallès, Spain

References (56)

Show source-provided references
1. A soft X-ray beamline for transmission X-ray microscopy at ALBA10.1107/S0909049509019396 ↗
2. MISTRAL: A transmission soft X-ray microscopy beamline for cryo nano-tomography of biological samples and magnetic domains imaging10.1107/S1600577515008632 ↗
3. Cryo-X-ray tomography of vaccinia virus membranes and inner compartments10.1016/j.jsb.2009.07.009 ↗
4. Arhatari, B.D., Stevenson, A.W., Abbey, B., Nesterets, Y.I., Maksimenko, A., Hall, C.J., Thompson, D., Mayo, S.C., Fiala, T., and Quiney, H.M. (2021). X-ray phase-contrast computed tomography for soft tissue imaging at the imaging and medical beamline (IMBL) of the australian synchrotron. Appl. Sci., 11.10.3390/app11094120 ↗
5. Iterative image reconstruction: A point of view
6. Techniques for calibrating spindles with nanometer error motion10.1016/j.precisioneng.2004.05.003 ↗
7. TomoPy: A framework for the analysis of synchrotron tomographic data10.1107/S1600577514013939 ↗
8. A convolutional neural network approach to calibrating the rotation axis for X-ray computed tomography10.1107/S1600577516020117 ↗
9. Advancements towards the implementation of clinical phase-contrast breast computed tomography at Elettra10.1107/S1600577519005502 ↗
10. Automatic projection image registration for nanoscale X-ray tomographic reconstruction10.1107/S1600577518013929 ↗
11. Spiral scanning X-ray fluorescence computed tomography10.1364/OE.25.023424 ↗
12. Rapid alignment of nanotomography data using joint iterative reconstruction and reprojection10.1038/s41598-017-12141-9 ↗
13. Fast and flexible X-ray tomography using the ASTRA toolbox10.1364/OE.24.025129 ↗
14. AuTom: A novel automatic platform for electron tomography reconstruction10.1016/j.jsb.2017.07.008 ↗
15. Dehaeze, T., Collette, C., and Magnin-Mattenet, M. (2018, January 25–29). Sample Stabilization for Tomography Experiments in Presence of Large Plant Uncertainty. Proceedings of the 10th Mechanical Engineering Design of Synchrotron Radiation Equipment and Instrumentation, Paris, France.
16. Alignment methods for nanotomography with deep subpixel accuracy10.1364/OE.27.036637 ↗
17. Fast X-ray Nanotomography with Sub-10 nm Resolution as a Powerful Imaging Tool for Nanotechnology and Energy Storage Applications10.1002/adma.202008653 ↗
18. Computer Visualization of Three-Dimensional Image Data Using IMOD10.1006/jsbi.1996.0013 ↗
19. Automated tilt series alignment and tomographic reconstruction in IMOD10.1016/j.jsb.2016.07.011 ↗
20. Dual-Axis Tomography: An Approach with Alignment Methods That Preserve Resolution10.1006/jsbi.1997.3919 ↗
21. Enhanced and Flexible Software Tools for X-ray Computed Tomography at the Italian Synchrotron Radiation Facility Elettra10.3233/FI-2015-1273 ↗
22. SYRMEP Tomo Project: A graphical user interface for customizing CT reconstruction workflows10.1186/s40679-016-0036-8 ↗
23. TOM software toolbox: Acquisition and analysis for electron tomography10.1016/j.jsb.2004.10.006 ↗
24. Bsoft: Image processing and molecular modeling for electron microscopy10.1016/j.jsb.2006.06.006 ↗
25. Accurate marker-free alignment with simultaneous geometry determination and reconstruction of tilt series in electron tomography10.1016/j.ultramic.2005.07.007 ↗
26. UCSF tomography: An integrated software suite for real-time electron microscopic tomographic data collection, alignment, and reconstruction10.1016/j.jsb.2006.06.005 ↗
27. Current data processing strategies for cryo-electron tomography and subtomogram averaging10.1042/BCJ20200715 ↗
28. Perspective registration and multi-frame super-resolution of license plates in surveillance videos
29. Cop, M., and Dengler, J. (1990, January 16–21). A multi-resolution approach to the 3D reconstruction of a 50S ribosome from an EM-tilt series solving the alignment problem without gold particles. Proceedings of the International Conference on Pattern Recognition, Atlantic City, NJ, USA.
30. Multi-resolution radiograph alignment for motion correction in x-ray micro-tomography10.1117/12.2238259 ↗
31. Automatic 3D image registration for nano-resolution chemical mapping using synchrotron spectro-tomography10.1107/S1600577520014691 ↗
32. Guzzi, F., Kourousias, G., Gianoncelli, A., Pascolo, L., Sorrentino, A., Billè, F., and Carrato, S. (2021, July 19). Material Concerning a Publication on an Autograd-Based Method for Ptychography, Implemented within the SciComPty Suite. Available online: https://doi.org/10.5281/zenodo.5113938.
33. A joint method for marker-free alignment of tilt series in electron tomography10.1093/bioinformatics/btz323 ↗
34. Guzzi, F., Kourousias, G., Billè, F., Pugliese, R., Gianoncelli, A., and Carrato, S. (2021). A parameter refinement method for Ptychography based on Deep Learning concepts. arXiv.10.3390/condmat6040036 ↗
35. Donoho, D.L. (2000, January 7–12). The Curses and Blessings of Dimensionality. Proceedings of the American Math, Society Lecture-Math Challenges of the 21st Century, Los Angeles, CA, USA.
36. Phase retrieval with transverse translation diversity: A nonlinear optimization approach10.1364/OE.16.007264 ↗
37. Efficient subpixel image registration algorithms10.1364/OL.33.000156 ↗
39. The GPU Computing Era10.1109/MM.2010.41 ↗
40. GPU computing in medical physics: A review10.1118/1.3578605 ↗
41. A distributed ASTRA toolbox10.1186/s40679-016-0032-z ↗
42. The ASTRA Toolbox: A platform for advanced algorithm development in electron tomography10.1016/j.ultramic.2015.05.002 ↗
43. GPU-accelerated regularized iterative reconstruction for few-view cone beam CT10.1118/1.4914143 ↗
44. Vogelgesang, M., Chilingaryan, S., Rolo, T.d., and Kopmann, A. (2012, January 25–27). UFO: A Scalable GPU-based Image Processing Framework for On-line Monitoring. Proceedings of the 2012 IEEE 14th International Conference on High Performance Computing and Communication 2012 IEEE 9th International Conference on Embedded Software and Systems, Liverpool, UK.10.1109/HPCC.2012.116 ↗
45. Arbitrarily large tomography with iterative algorithms on multiple GPUs using the TIGRE toolbox10.1016/j.jpdc.2020.07.004 ↗
46. Performance improvements for iterative electron tomography reconstruction using graphics processing units (GPUs)10.1016/j.jsb.2011.07.017 ↗
47. Integration of TomoPy and the ASTRA toolbox for advanced processing and reconstruction of tomographic synchrotron data10.1107/S1600577516005658 ↗
48. Chghaf, M., and Gac, N. (2020, January 19–21). Student Session: Data distribution on a multi-GPU node for TomoBayes CT reconstruction. Proceedings of the 2020 IEEE 26th International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA), Gangnueng, Korea.10.1109/RTCSA50079.2020.9203709 ↗
49. Palenstijn, W.J., Bédorf, J., and Batenburg, J. (June, January 31). A distributed SIRT implementation for the ASTRA Toolbox. Proceedings of the 13th International Meeting on Fully Three-Dimensional Image Reconstruction in Radiology and Nuclear Medicine 2015 (Fully3D 1), Newport, RI, USA.
50. Gürsoy, D., De Carlo, F., Xiao, X., and Jacobsen, C. (2021, July 09). Tomopgy GPU Notes. Available online: https://tomopy.readthedocs.io/en/latest/faq.html#do-tomopy-astra-and-ufo-support-all-gpus.
51. Computational Analysis and Improvement of SIRT10.1109/TMI.2008.923696 ↗
52. Fresnel coherent diffractive imaging tomography of whole cells in capillaries10.1088/1367-2630/16/9/093012 ↗
53. Parametric Image Alignment Using Enhanced Correlation Coefficient Maximization10.1109/TPAMI.2008.113 ↗
54. scikit-image: Image processing in Python10.7717/peerj.453 ↗
55. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8–14). PyTorch: An Imperative Style, High-Performance Deep Learning Library. Proceedings of the Advances in Neural Information Processing Systems 32: NeurIPS 2019, Vancouver, BC, Canada.
56. Jaderberg, M., Simonyan, K., Zisserman, A., and Kavukcuoglu, K. (2015, January 7–12). Spatial Transformer Networks. Proceedings of the Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, Montreal, QC, Canada.