journal article·2022-01-27Open access

Imaging atomic-scale chemistry from fused multi-modal electron microscopy

Jonathan Schwartz, Zichao Wendy Di, Yi Jiang, Alyssa J. Fielitz, Don-Hyung Ha, Sanjaya D. Perera, Ismail El Baggari, Richard D. Robinson, Jeffrey A. Fessler, Colin Ophus, Steve Rozeveld, Robert Hovden

npj Computational Materials· Volume 8· Issue 1

Abstract

Abstract Efforts to map atomic-scale chemistry at low doses with minimal noise using electron microscopes are fundamentally limited by inelastic interactions. Here, fused multi-modal electron microscopy offers high signal-to-noise ratio (SNR) recovery of material chemistry at nano- and atomic-resolution by coupling correlated information encoded within both elastic scattering (high-angle annular dark-field (HAADF)) and inelastic spectroscopic signals (electron energy loss (EELS) or energy-dispersive x-ray (EDX)). By linking these simultaneously acquired signals, or modalities, the chemical distribution within nanomaterials can be imaged at significantly lower doses with existing detector hardware. In many cases, the dose requirements can be reduced by over one order of magnitude. This high SNR recovery of chemistry is tested against simulated and experimental atomic resolution data of heterogeneous nanomaterials.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Electron Microscopy Techniques and Applications · Electron and X-Ray Spectroscopy Techniques · Force Microscopy Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (52)

Show source-provided references
1. D’Alfonso, A., Freitag, B., Klenov, D. & Allen, L. Atomic-resolution chemical mapping using energy-dispersive x-ray spectroscopy. Phys. Rev. B 81, 100101 (2010).10.1103/PhysRevB.81.100101 ↗
2. Kothleitner, G. et al. Quantitative elemental mapping at atomic resolution using x-ray spectroscopy. Phys. Rev. Lett. 112, 085501 (2014).10.1103/PhysRevLett.112.085501 ↗
3. Spence, J. & Lynch, J. Stem microanalysis by transmission electron energy loss spectroscopy in crystals. Ultramicroscopy 9, 267–276 (1982).10.1016/0304-3991(82)90211-X ↗
4. Muller, D. et al. Atomic-scale chemical imaging of composition and bonding by aberration-corrected microscopy. Science 319, 1073–1076 (2008).10.1126/science.1148820 ↗
5. Hart, J. L. et al. Direct detection electron energy-loss spectroscopy: a method to push the limits of resolution and sensitivity. Sci. Rep. 7, 1–14 (2017).10.1038/s41598-017-07709-4 ↗
6. Cueva, P., Hovden, R., Mundy, J., Xin, H. & Muller, D. Data processing for atomic resolution electron energy loss spectroscopy. Microsc. Microanal. 18, 667–675 (2012).10.1017/S1431927612000244 ↗
7. McMullan, G., Faruqi, A., Clare, D. & Henderson, R. Comparison of optimal performance at 300kev of three direct electron detectors for use in low dose electron microscopy. Ultramicroscopy 147, 156–163 (2014).10.1016/j.ultramic.2014.08.002 ↗
8. Kotula, P., Klenov, D. & Harrach, S. Challenges to quantitative multivariate statistical analysis of atomic-resolution x-ray spectral. Microsc. Microanal. 18, 691–698 (2012).10.1017/S1431927612001201 ↗
9. LeBeau, J. M., Findlay, S. D., Allen, L. J. & Stemmer, S. Quantitative atomic resolution scanning transmission electron microscopy. Phys. Rev. Lett. 100, 206101 (2008).10.1103/PhysRevLett.100.206101 ↗
10. Su, Y. et al. Multi-dimensional correlative imaging of subcellular events: combining the strengths of light and electron microscopy. Biophys. Rev. 2, 121–135 (2010).10.1007/s12551-010-0035-2 ↗
11. Hall, D. L. & Llinas, J. An introduction to multisensor data fusion. Proc. IEEE 85, 6–23 (1997).10.1109/5.554205 ↗
12. Lahat, D., Adali, T. & Jutten, C. Multimodal data fusion: an overview of methods, challenges, and prospects. Proc. IEEE 103, 1449–1477 (2015).10.1109/JPROC.2015.2460697 ↗
13. Di, Z. W., Leyffer, S. & Wild, S. Optimization-based approach for joint x-ray fluorescence and transmission tomographic inversion. SIAM J. Imaging Sci. 9, 1–23 (2016).10.1137/15M1021404 ↗
14. Calhoun, V. & Sui, J. Multimodal fusion of brain imaging data: a key to finding the missing link(s) in complex mental illness. Biol. Psychiatry 1, 230–244 (2016).
15. Hartel, P., Rose, H. & Dinges, C. Conditions and reasons for incoherent imaging in stem. Ultramicroscopy 63, 93–114 (1996).10.1016/0304-3991(96)00020-4 ↗
16. Krivanek, O. L. et al. Atom-by-atom structural and chemical analysis by annular dark-field electron microscopy. Nature 464, 571–574 (2010).10.1038/nature08879 ↗
17. Hovden, R. & Muller, D. A. Efficient elastic imaging of single atoms on ultrathin supports in a scanning transmission electron microscope. Ultramicroscopy 123, 59–65 (2012).10.1016/j.ultramic.2012.04.014 ↗
18. Crewe, A., Wall, J. & Langmore, J. Visibility of single atoms. Science 168, 1338–1340 (1970).10.1126/science.168.3937.1338 ↗
19. Wall, J., Isaacson, M. & Langmore, J. The collection of scattered electrons in dark field electron microscopy. Optik 39, 359–374 (1974).
20. Di, Z. W. et al. Joint reconstruction of x-ray fluorescence and transmission tomography. Opt. Express 25, 13107–13124 (2017).10.1364/OE.25.013107 ↗
21. Odstrčil, M., Menzel, A. & Guizar-Sicairos, M. Iterative least-squares solver for generalized maximum-likelihood ptychography. Opt. Express 26, 3108–3123 (2018).10.1364/OE.26.003108 ↗
22. Rudin, L., Osher, S. & Fatemi, E. Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992).10.1016/0167-2789(92)90242-F ↗
23. Donoho, D. Compressed sensing. IEEE Trans. Inf. Theory 52, 1289–1306 (2006).10.1109/TIT.2006.871582 ↗
24. Candès, E., Romberg, J. & Tao, T. Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory 52, 489–509 (2006).10.1109/TIT.2005.862083 ↗
25. Rozeveld, S., Lee, W.-S. & Longo, P. Characterization of cobalt sulfide catalysts. Microsc. Microanal. 26, 1248–1250 (2020).10.1017/S143192762001747X ↗
26. Schlossmacher, P., Klenov, D., Freitag, B. & von Harrach, H. Enhanced detection sensitivity with a new windowless XEDS system for AEM based on silicon drift detector technology. Microsc. Today 18, 14–20 (2010).10.1017/S1551929510000404 ↗
27. Perera, S. et al. Enhanced supercapacitor performance for equal co-mn stoichiometry in colloidal Co3−xMnxO4 nanoparticles, in additive-free electrodes. Chem. Mater. 27, 7861–7873 (2015).10.1021/acs.chemmater.5b02106 ↗
28. Bhargava, A. et al. Mn cations control electronic transport in spinel CoxMn3−xO4 nanoparticles. Chem. Mater. 31, 4228–4233 (2019).10.1021/acs.chemmater.9b01198 ↗
29. Ha, D.-H. et al. Solid-solid phase transformations induced through cation exchange and strain in 2d heterostructured copper sulfide nanocrystals. Nano Lett. 14, 7090–7099 (2014).10.1021/nl5035607 ↗
30. Horé, A. & Ziou, D. Image quality metrics: PSNR and SSIM. In 2010 20th International Conference on Pattern Recognition, (ed. Erçil, A.) 2366–2369 (IEEE, 2010).10.1109/ICPR.2010.579 ↗
31. Dwyer, C. The role of symmetry in the theory of inelastic high-energy electron scattering and its application to atomic-resolution core-loss imaging. Ultramicroscopy 151, 68–77 (2015).10.1016/j.ultramic.2014.11.007 ↗
32. Allen, L. J. et al. Modelling the inelastic scattering of fast electrons. Ultramicroscopy 151, 11–22 (2015).10.1016/j.ultramic.2014.10.011 ↗
33. Brown, H., Ciston, J. & Ophus, C. Linear-scaling algorithm for rapid computation of inelastic transition of multiple electron scattering. Phys. Rev. Res. 1, 033186 (2019).10.1103/PhysRevResearch.1.033186 ↗
34. Zhang, Z., De Backer, A., Lobato, I., Van Aert, S. & Nellist, P. Combining ADF-EDX scattering cross-sections for elemental quantification of nanostructures. Microsc. Microanal. 27, 600–602 (2021).10.1017/S1431927621002567 ↗
35. Anstis, G., Cai, D. & Cockayne, D. Limitations on the s-state approach to the interpretation of sub-angstrom resolution electron microscope images and microanalysis. Ultramicroscopy 94, 309–327 (2003).10.1016/S0304-3991(02)00341-8 ↗
36. Hovden, R., Xin, H. L. & Muller, D. A. Channeling of a subangstrom electron beam in a crystal mapped to two-dimensional molecular orbitals. Phys. Rev. B 86, 195415 (2012).10.1103/PhysRevB.86.195415 ↗
37. Egerton, R. & Cheng, S. Characterization of an analytical electron microscope with a NiO test specimen. Ultramicroscopy 55, 43–54 (1994).10.1016/0304-3991(94)90079-5 ↗
38. Rez, P. Cross-sections for energy loss spectroscopy. Ultramicroscopy 9, 283–288 (1982).10.1016/0304-3991(82)90213-3 ↗
39. Egerton, R. Formulae for light-element microanalysis by electron energy-loss spectrometry. Ultramicroscopy 3, 243–251 (1978).10.1016/S0304-3991(78)80031-X ↗
40. Findlay, S. et al. Dynamics of annular bright field imaging in scanning transmission electron microscopy. Ultramicroscopy 110, 903–923 (2010).10.1016/j.ultramic.2010.04.004 ↗
41. Savitzky, B. et al. Bending and breaking of stripes in charge ordered manganite. Nat. Commun. 8, 1883 (2017).10.1038/s41467-017-02156-1 ↗
42. Beck, D. & Teboulle, M. Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Trans. Image Proc. 18, 2419–2434 (2009).10.1109/TIP.2009.2028250 ↗
43. Dupé, F.-X., Fadili, J. & Starck, J.-L. A proximal iteration for deconvolving Poisson noisy images using sparse representations. IEEE Trans. Image Proc. 18, 310–321 (2009).10.1109/TIP.2008.2008223 ↗
44. Vogel, C. Computational Methods for Inverse Problems, chap 7, 97–127 (SIAM, 2002).10.1137/1.9780898717570 ↗
45. Wei, X., Urbach, H. P. & Coene, W. Cramér–Rao lower bound and maximum-likelihood estimation in ptychography with Poisson noise. Phys. Rev. A 102, P043516 (2020).10.1103/PhysRevA.102.043516 ↗
46. Madsen, J. & Susi, T. The abTEM code: transmission electron microscopy from first principles. Open Res. Eur. 1, 1–24 (2021).10.12688/openreseurope.13008.1 ↗
47. Ophus, C. A fast image simulation algorithm for scanning transmission electron microscopy. Adv. Struct. Chem. Imag. 3, 13 (2017).10.1186/s40679-017-0046-1 ↗
48. Saldin, D. & Rez, P. The theory of the excitation of atomic inner-shells in crystals by fast electrons. Philos. Mag. B 55, 481–489 (1987).10.1080/13642818708217957 ↗
49. Dwyer, C., Findlay, S. & Allen, L. Multiple elastic scattering of core-loss electrons in atomic resolution imaging. Phys. Rev. B 100, 206101 (2008).
50. Enkovaara, J. et al. Electronic structure calculations with GPAW: a real-space implementation of the projector augmented-wave method. J. Phys.: Condens. Matter 22, 253202 (2010).
51. Yang, Y. et al. Deciphering chemical order/disorder and material properties at the single-atom level. Nature 542, 75–79 (2017).10.1038/nature21042 ↗
52. Kirkland, E. Advanced Computing in Electron Microscopy (Springer Nature, 2010).10.1007/978-1-4419-6533-2 ↗