journal article·2026-05-12

Unsupervised Segmentation and Clustering Workflow for Efficient Processing of 4D-STEM and 5D-STEM Data

Serin Lee, Stephanie M Ribet, Arthur R C McCray, Andrew Barnum, Jennifer A Dionne, Colin Ophus

Microscopy and Microanalysis· Volume 32· Issue 3
Publisher page

Abstract

Abstract Four-dimensional scanning transmission electron microscopy (4D-STEM) enables mapping of diffraction information with nanometer-scale spatial resolution, offering detailed insight into local structure, orientation, and strain. However, as data dimensionality and sampling density increase, particularly for in situ scanning diffraction experiments (5D-STEM), robust segmentation of structurally consistent behavior across sequential measurements becomes essential for efficient and physically meaningful analysis. Here, we introduce a clustering framework that identifies crystallographically distinct domains from 4D-STEM datasets. By using local diffraction-pattern similarity as a metric, the method extracts closed contours delineating spatially contiguous regions. This approach produces cluster-averaged diffraction patterns that improve signal quality while reducing data volume by orders of magnitude, enabling rapid and accurate orientation, phase, and strain mapping. We demonstrate the applicability of this approach to in situ liquid-cell 4D-STEM data of gold nanoparticle growth. Our method provides a scalable and generalizable route for spatially coherent segmentation, data compression, and quantitative structure–strain mapping across diverse 4D-STEM modalities. The full analysis code and example workflows are publicly available to support reproducibility and reuse.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Electron Microscopy Techniques and Applications · Block Copolymer Self-Assembly · Machine Learning in Materials Science

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Materials Science and Engineering, Stanford University , Stanford, CA 94305

National Center for Electron Microscopy, Molecular Foundry, Lawrence Berkeley National Laboratory , Berkeley, CA 94720 ,

Stanford Nano Shared Facilities, Stanford University , Stanford, CA 94305 ,

References (50)

Show source-provided references
1. Fast grain mapping with sub-nanometer resolution using 4D-STEM with grain classification by principal component analysis and non-negative matrix factorization10.1017/S1431927621011946 ↗
2. Free, flexible and fast: Orientation mapping using the multi-core and GPU-accelerated template matching capabilities in the python-based open source 4D-STEM analysis toolbox pyxem10.1016/j.ultramic.2022.113517 ↗
3. Bilateral filter based orientation smoothing of ebsd data10.1016/j.ultramic.2010.06.003 ↗
4. In situ 4D-STEM imaging of the orientation of lamellar clusters in polymer crystallization10.1002/marc.202500450 ↗
5. Direct visualization and quantitative insights into the formation and phase evolution of cu nanoparticles via in situ liquid phase 4D-STEM10.1002/advs.202500706 ↗
6. Assessment of active dopants and p–n junction abruptness using in situ biased 4D-STEM10.1021/acs.nanolett.2c03684 ↗
7. Template matching approach for automated determination of crystal phase and orientation of grains in 4D-STEM precession electron diffraction data for hafnium zirconium oxide ferroelectric thin films10.1093/mam/ozaf019 ↗
8. Scanning transmission electron diffraction methods10.1107/S2052520619006723 ↗
9. Scanning precession electron tomography for three-dimensional nanoscale orientation imaging and crystallographic analysis10.1038/ncomms8267 ↗
10. The influence of ionizing radiation on quantification for in situ and operando liquid-phase electron microscopy10.1002/adma.202415728 ↗
11. Picosecond quantum transients in halide perovskite nanodomain superlattices10.1038/s41565-025-02036-6 ↗
12. Density-based clustering of crystal (mis) orientations and the orix python library10.1107/S1600576720011103 ↗
13. On the use of clustering workflows for automated microstructure segmentation of analytical stem datasets10.1063/5.0246329 ↗
14. Operando heating and cooling electrochemical 4D-STEM probing nanoscale dynamics at solid–liquid interfaces10.1021/jacs.5c05005 ↗
15. Unsupervised machine learning combined with 4d scanning transmission electron microscopy for bimodal nanostructural analysis10.1038/s41598-024-53289-5 ↗
16. Nonnegative matrix factorization incorporating domain specific constraints for four dimensional scanning transmission electron microscopy10.1038/s41598-025-23541-7 ↗
17. Lee · 2026
18. Temperature dependent nanochemistry and growth kinetics using liquid cell transmission electron microscopy10.1021/acsnano.2c11477 ↗
19. Temperature dependent growth kinetics of pd nanocrystals: Insights from liquid cell transmission electron microscopy10.1002/smll.202403969 ↗
20. 4D-STEM mapping of nanocrystal reaction dynamics and heterogeneity in a graphene liquid cell10.1021/acs.nanolett.3c05015 ↗
21. End-to-end automated segmentation framework for four-dimensional scanning transmission electron microscopy data10.1093/mam/ozaf094 ↗
22. Accurate measurement of strain at interfaces in 4D-STEM: A comparison of various methods10.1016/j.ultramic.2020.113196 ↗
23. Unsupervised machine learning applied to scanning precession electron diffraction data10.1186/s40679-019-0063-3 ↗
24. Precession electron diffraction—A topical review10.1107/S2052252514022283 ↗
25. Real-time in-situ insights: Dynamic mapping with 4D STEM10.1093/mam/ozaf048.899 ↗
26. Miller · 2023
27. Miller · 2024
28. In-situ 4D stem: Capturing 5D insights into material dynamics in liquid10.1093/mam/ozaf048.085 ↗
29. Four-dimensional scanning transmission electron microscopy (4D-STEM): From scanning nanodiffraction to ptychography and beyond10.1017/S1431927619000497 ↗
30. Automated crystal orientation mapping in py4dstem using sparse correlation matching10.1017/S1431927622000101 ↗
31. In situ grain growth experiments: Tem imaging & automated segmentation with correlative 4D-STEM orientation mapping10.1093/mam/ozaf048.909 ↗
32. Direct measurement of nanostructural change during in situ deformation of a bulk metallic glass10.1038/s41467-019-10416-5 ↗
33. Automated nanocrystal orientation and phase mapping in the transmission electron microscope on the basis of precession electron diffraction10.1524/zkri.2010.1205 ↗
34. Multi-angle precession electron diffraction (maped): A versatile approach to 4D-STEM precession10.1093/mam/ozaf103 ↗
35. Automated experiment in 4D-STEM: Exploring emergent physics and structural behaviors10.1021/acsnano.1c11118 ↗
36. Atomic force microscopy investigation of the kinetic growth mechanisms of sputtered nanostructured au film on mica: Towards a nanoscale morphology control10.1186/1556-276X-6-112 ↗
37. Reuniting crystallography with real space: Ab initio structure elucidation with 4D-STEM10.1073/pnas.2508185122 ↗
38. py4dstem: A software package for four-dimensional scanning transmission electron microscopy data analysis10.1017/S1431927621000477 ↗
39. Electron–water interactions and implications for liquid cell electron microscopy10.1021/jp507400n ↗
40. Grain size effects on stress-assisted grain boundary migration in polycrystalline Au thin films under tension10.1016/j.actamat.2025.121330 ↗
41. From STEM to 4D STEM: Ultrafast diffraction mapping with a hybrid-pixel detector10.1093/mictod/qaad005 ↗
42. Sun · 2024
43. Non-negative matrix factorization for mining big data obtained using four-dimensional scanning transmission electron microscopy10.1016/j.ultramic.2020.113168 ↗
44. Scikit-image: Image processing in python10.7717/peerj.453 ↗
45. Double conical beam-rocking system for measurement of integrated electron diffraction intensities10.1016/0304-3991(94)90039-6 ↗
46. Film growth studies with intrinsic stress measurement: Polycrystalline and epitaxial Ag, Cu, and Au films on mica (001)10.1063/1.349313 ↗
47. Texture transfer in dielectric layers via nanocrystalline networks: Insights from in situ 4D-STEM10.1021/acs.nanolett.3c03941 ↗
48. Direct in situ determination of the mechanisms controlling nanoparticle nucleation and growth10.1021/nn303371y ↗
49. Electron-beam-driven chemical processes during liquid phase transmission electron microscopy10.1557/mrs.2020.227 ↗
50. Zuo · 2010 · 393