Gaussian process analysis of electron energy loss spectroscopy data: multivariate reconstruction and kernel control
Source abstract
Abstract
Abstract Advances in hyperspectral imaging including electron energy loss spectroscopy bring forth the challenges of exploratory and physics-based analysis of multidimensional data sets. The multivariate linear unmixing methods generally explore similarities in the energy dimension, but ignore correlations in the spatial domain. At the same time, Gaussian process (GP) explicitly incorporate spatial correlations in the form of kernel functions but is computationally intensive. Here, we implement a GP method operating on the full spatial domain and reduced representations in the energy domain. In this multivariate GP, the information between the components is shared via a common spatial kernel structure, while allowing for variability in the relative noise magnitude or image morphology. We explore the role of kernel constraints on the quality of the reconstruction, and suggest an approach for estimating them from the experimental data. We further show that spatial information contained in higher-order components can be reconstructed and spatially localized.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Gaussian Processes and Bayesian Inference · Machine Learning in Materials Science · Advanced Fluorescence Microscopy Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (54)
Show source-provided references
1. Pennycook, S. J. & Nellist, P. D. Scanning Transmission Electron Microscopy: Imaging and Analysis. (Springer, 2011).10.1007/978-1-4419-7200-2 ↗
2. Muller, D. A., Nakagawa, N., Ohtomo, A., Grazul, J. L. & Hwang, H. Y. Atomic-scale imaging of nanoengineered oxygen vacancy profiles in SrTiO3. Nature 430, 657–661 (2004).10.1038/nature02756 ↗
3. Yankovich, A. B., et al. Picometre-precision analysis of scanning transmission electron microscopy images of platinum nanocatalysts. Nat. Commun. 5, 1–7 (2014).10.1038/ncomms5155 ↗
4. Kumar, A. et al. Spatially resolved mapping of oxygen reduction/evolution reaction on solid-oxide fuel cell cathodes with sub-10 nm resolution. ACS Nano 7, 3808–3814 (2013).10.1021/nn303239e ↗
5. Chisholm, M. F., Luo, W. D., Oxley, M. P., Pantelides, S. T. & Lee, H. N. Atomic-scale compensation phenomena at polar interfaces. Phys. Rev. Lett. 105, 197602 (2010).10.1103/PhysRevLett.105.197602 ↗
6. Das, S. et al. Observation of room-temperature polar skyrmions. Nature 568, 368-+ (2019).10.1038/s41586-019-1092-8 ↗
7. Nelson, C. T. et al. Domain dynamics during ferroelectric switching. Science 334, 968–971 (2011).10.1126/science.1206980 ↗
8. Nelson, C. T. et al. Spontaneous vortex nanodomain arrays at ferroelectric heterointerfaces. Nano Lett. 11, 828–834 (2011).10.1021/nl1041808 ↗
9. Jia, C. L. et al. Atomic-scale study of electric dipoles near charged and uncharged domain walls in ferroelectric films. Nat. Mater. 7, 57–61 (2008).10.1038/nmat2080 ↗
10. Jia, C. L. et al. Unit-cell scale mapping of ferroelectricity and tetragonality in epitaxial ultrathin ferroelectric films. Nat. Mater. 6, 64–69 (2007).10.1038/nmat1808 ↗
11. Jia, C. L. et al. Oxygen octahedron reconstruction in the SrTiO(3)/LaAlO(3) heterointerfaces investigated using aberration-corrected ultrahigh-resolution transmission electron microscopy. Phys. Rev. B 79, 081405 (2009).10.1103/PhysRevB.79.081405 ↗
12. He, Q. et al. Towards 3D mapping of BO6 octahedron rotations at perovskite heterointerfaces, unit cell by unit cell. ACS Nano 9, 8412–8419 (2015).10.1021/acsnano.5b03232 ↗
13. Borisevich, A. et al. Mapping octahedral tilts and polarization across a domain wall in BiFeO(3) from Z-contrast scanning transmission electron microscopy image atomic column shape analysis. ACS Nano 4, 6071–6079 (2010).10.1021/nn1011539 ↗
14. Kim, Y. M. et al. Interplay of octahedral tilts and polar order in BiFeO3 films. Adv. Mater. 25, 2497–2504 (2013).10.1002/adma.201204584 ↗
15. Borisevich, A. Y. et al. Exploring mesoscopic physics of vacancy-ordered systems through atomic scale observations of topological defects. Phys. Rev. Lett. 109, 065702 (2012).10.1103/PhysRevLett.109.065702 ↗
16. Borisevich, A. Y. et al. Interface dipole between two metallic oxides caused by localized oxygen vacancies. Phys. Rev. B 86, 140102 (2012).10.1103/PhysRevB.86.140102 ↗
17. Borisevich, A. Y. et al. Atomic-scale evolution of modulated phases at the ferroelectric-antiferroelectric morphotropic phase boundary controlled by flexoelectric interaction. Nat. Commun. 3, 1–8 (2012).10.1038/ncomms1778 ↗
18. Varela, M. et al. Spectroscopic imaging of single atoms within a bulk solid. Phys. Rev. Lett. 92, 095502 (2004).10.1103/PhysRevLett.92.095502 ↗
19. Roldan, M. A. et al. Atomic scale studies of La/Sr ordering in colossal magnetoresistant La2-2xSr1 +2xMn2O7 single crystals. Microsc. Microanal. 20, 1791–1797 (2014).10.1017/S1431927614013075 ↗
20. Pailloux, F. et al. Nanoscale analysis of a SrTiO3/La2/3Sr1/3MnO3 interface. Phys. Rev. B 66, 014417 (2002).10.1103/PhysRevB.66.014417 ↗
21. Samet, L. et al. EELS study of interfaces in magnetoresistive LSMO/STO/LSMO tunnel junctions. Eur. Phys. J. B 34, 179–192 (2003).10.1140/epjb/e2003-00210-8 ↗
22. Wong, F. J., Zhu, S. B., Iwata-Harms, J. M. & Suzuki, Y. Electronic tuning of La2/3Sr1/3MnO3 thin films via heteroepitaxy. J. Appl. Phys. 111, 063920 (2012).10.1063/1.3699047 ↗
23. Idrobo, J. C. et al. Temperature measurement by a nanoscale electron probe using energy gain and loss spectroscopy. Phys. Rev. Lett. 120, 095901 (2018).10.1103/PhysRevLett.120.095901 ↗
24. Kapetanakis, M. D. et al. Low-loss electron energy loss spectroscopy: an atomic-resolution complement to optical spectroscopies and application to graphene. Phys. Rev. B 92, 125147 (2015).10.1103/PhysRevB.92.125147 ↗
25. Krivanek, O. L. et al. Vibrational spectroscopy in the electron microscope. Nature 514, 209–212 (2014).10.1038/nature13870 ↗
26. Li, X., Dyck, O., Kalinin, S. V. & Jesse, S. Compressed sensing of scanning transmission electron microscopy (STEM) with nonrectangular scans. Microsc. Microanal. 24, 623–633 (2018).10.1017/S143192761801543X ↗
27. Ziatdinov, M. et al. Building and exploring libraries of atomic defects in graphene: scanning transmission electron and scanning tunneling microscopy study. Sci. Adv. 5, 9 (2019).10.1126/sciadv.aaw8989 ↗
28. Bonnet, N. In Advances in Imaging and Electron Physics, vol. 114 (ed. Hawkes, P. W.) (Elsevier Academic Press Inc, 2000).
29. Bonnet, N. Multivariate statistical methods for the analysis of microscope image series: applications in materials science. J. Microsc. 190, 2–18 (1998).10.1046/j.1365-2818.1998.3250876.x ↗
30. Kotula, P. G. & Keenan, M. R. Application of multivariate statistical analysis to STEM X-ray spectral images: interfacial analysis in microelectronics. Microsc. Microanal. 12, 538–544 (2006).10.1017/S1431927606060636 ↗
31. Kotula, P. G., Keenan, M. R. & Michael, J. R. Tomographic spectral imaging with focused ion beam/scanning electron microscopy/energy-dispersive spectroscopy and multivariate statistical analysis: comprehensive 3D microanalysis. Microsc. Microanal. 12, 36–48 (2006).10.1017/S1431927606060193 ↗
32. Bosman, M., Watanabe, M., Alexander, D. T. L. & Keast, V. J. Mapping chemical and bonding information using multivariate analysis of electron energy-loss spectrum images. Ultramicroscopy 106, 1024–1032 (2006).10.1016/j.ultramic.2006.04.016 ↗
33. Jesse, S. & Kalinin, S. V. Principal component and spatial correlation analysis of spectroscopic-imaging data in scanning probe microscopy. Nanotechnology 20, 085714 (2009).10.1088/0957-4484/20/8/085714 ↗
34. Vasudevan, R. K., Tselev, A., Baddorf, A. P. & Kalinin, S. V. Big-data reflection high energy electron diffraction analysis for understanding epitaxial film growth processes. ACS Nano 8, 10899–10908 (2014).10.1021/nn504730n ↗
35. Halimi, A., Dobigeon, N. & Tourneret, J. Y. Unsupervised unmixing of hyperspectral images accounting for endmember variability. IEEE Trans. Image Process. 24, 4904–4917 (2015).10.1109/TIP.2015.2471182 ↗
36. Wei, Q., Bioucas-Dias, J., Dobigeon, N. & Tourneret, J. Y. Hyperspectral and multispectral image fusion based on a sparse representation. IEEE Trans. Geosci. Remote Sens. 53, 3658–3668 (2015).10.1109/TGRS.2014.2381272 ↗
37. Wei, Q., Dobigeon, N. & Tourneret, J. Y. Bayesian fusion of multi-band images. IEEE J. Sel. Top. Signal Process. 9, 1117–1127 (2015).10.1109/JSTSP.2015.2407855 ↗
38. Wei, Q., Dobigeon, N. & Tourneret, J. Y. Fast fusion of multi-band images based on solving a Sylvester equation. IEEE Trans. Image Process. 24, 4109–4121 (2015).10.1109/TIP.2015.2458572 ↗
39. Eches, O., Benediktsson, J. A., Dobigeon, N. & Tourneret, J. Y. Adaptive Markov random fields for joint unmixing and segmentation of hyperspectral images. IEEE Trans. Image Process. 22, 5–16 (2013).10.1109/TIP.2012.2204270 ↗
40. Altmann, Y., Dobigeon, N., McLaughlin, S. & Tourneret, J. Y. Nonlinear spectral unmixing of hyperspectral images using Gaussian processes. IEEE Trans. Signal Process. 61, 2442–2453 (2013).10.1109/TSP.2013.2245127 ↗
41. Dobigeon, N. & Brun, N. Spectral mixture analysis of EELS spectrum-images. Ultramicroscopy 120, 25–34 (2012).10.1016/j.ultramic.2012.05.006 ↗
42. Zortea, M. & Plaza, A. Improved spectral unmixing of hyperspectral images using spatially homogeneous endmembers. In: 2008 IEEE International Symposium on Signal Processing and Information Technology) (IEEE, 2008).10.1109/ISSPIT.2008.4775716 ↗
43. Nishii, R. & Ozaki, T. Contextual unmixing of geospatial data based on Markov random fields and conditional random fields. In: 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing) (IEEE, 2009).10.1109/WHISPERS.2009.5289004 ↗
44. Rivard, B., Rogge, D. M., Feng, J. & Zhang, J. Spatial constraints on endmember extraction and optimization of per-pixel endmember sets for spectral unmixing. In: 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing) (IEEE, 2009).10.1109/WHISPERS.2009.5289088 ↗
45. Canham, K., Schlamm, A., Ziemann, A., Basener, B. & Messinger, D. Spatially adaptive hyperspectral unmixing. IEEE Trans. Geosci. Remote Sens. 49, 4248–4262 (2011).10.1109/TGRS.2011.2169680 ↗
46. Zare A., Gader, P. Piece-wise convex spatial-spectral unmixing of hyperspectral imagery using possibilistic and fuzzy clustering. In 2011 IEEE International Conference on Fuzzy Systems 741-746 (FUZZ-IEEE, 2011).10.1109/FUZZY.2011.6007622 ↗
47. Iordache, M., Bioucas-Dias, J. M. & Plaza, A. Total variation spatial regularization for sparse hyperspectral unmixing. IEEE Trans. Geosci. Remote Sens. 50, 4484–4502 (2012).10.1109/TGRS.2012.2191590 ↗
48. Du, X., Zare, A., Gader, P. & Dranishnikov, D. Spatial and spectral unmixing using the beta compositional model. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 7, 1994–2003 (2014).10.1109/JSTARS.2014.2330347 ↗
49. Altmann, Y., Pereyra, M. & Bioucas-Dias, J. Collaborative sparse regression using spatially correlated supports—application to hyperspectral unmixing. IEEE Trans. Image Process. 24, 5800–5811 (2015).10.1109/TIP.2015.2487862 ↗
50. Borsoi, R. A., Imbiriba, T., Bermudez, J. C. M. & Richard, C. A blind multiscale spatial regularization framework for Kernel-based spectral unmixing. IEEE Trans. Image Process. 29, 4965–4979 (2020).10.1109/TIP.2020.2978342 ↗
51. Monier, E. et al. Fast reconstruction of atomic-scale STEM-EELS images from sparse sampling. Ultramicroscopy 215, 112993 (2020).10.1016/j.ultramic.2020.112993 ↗
52. Bonilla, E. V., Chai, K. M. A. & Williams, C. K. I. Multi-task Gaussian Process prediction. In: Proceedings of the 20th International Conference on Neural Information Processing Systems (Curran Associates Inc., 2007).
53. Quiñonero-Candela, J. & Rasmussen, C. E. A unifying view of sparse approximate Gaussian process regression. J. Mach. Learn. Res. 6, 1939–1959 (2005).
54. Gardner, J., Pleiss, G., Weinberger, K. Q., Bindel, D. & Wilson, A. G. Gpytorch: Blackbox matrix-matrix gaussian process inference with GPU acceleration. In: Advances in Neural Information Processing Systems (Cornell University, 2018).