Deep Learning Approach for High-accuracy Electron Counting of Monolithic Active Pixel Sensor-type Direct Electron Detectors at Increased Electron Dose
Source abstract
Abstract
Abstract Electron counting can be performed algorithmically for monolithic active pixel sensor direct electron detectors to eliminate readout noise and Landau noise arising from the variability in the amount of deposited energy for each electron. Errors in existing counting algorithms include mistakenly counting a multielectron strike as a single electron event, and inaccurately locating the incident position of the electron due to lateral spread of deposited energy and dark noise. Here, we report a supervised deep learning (DL) approach based on Faster region-based convolutional neural network (R-CNN) to recognize single electron events at varying electron doses and voltages. The DL approach shows high accuracy according to the near-ideal modulation transfer function (MTF) and detector quantum efficiency for sparse images. It predicts, on average, 0.47 pixel deviation from the incident positions for 200 kV electrons versus 0.59 pixel using the conventional counting method. The DL approach also shows better robustness against coincidence loss as the electron dose increases, maintaining the MTF at half Nyquist frequency above 0.83 as the electron density increases to 0.06 e−/pixel. Thus, the DL model extends the advantages of counting analysis to higher dose rates than conventional methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: CCD and CMOS Imaging Sensors · Electron and X-Ray Spectroscopy Techniques · Analytical Chemistry and Sensors
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Materials Science and Engineering, University of Wisconsin-Madison , 1509 University Ave, Madison, WI 53706 , USA
Direct Electron L.P. , 13240 Evening Crk S Dr Ste. 311, San Diego, CA 92128 , USA
References (40)
Show source-provided references
1. Multi-color electron microscopy of cellular ultrastructure using 4D-STEM10.1017/S1431927619006032 ↗
2. Cluster imaging with a direct detection CMOS pixel sensor in transmission electron microscopy10.1016/j.nima.2009.07.017 ↗
3. Blaiszik · 2022
4. An ultrafast direct electron camera for 4D STEM10.1017/S1431927621003809 ↗
5. A data reduction and compression description for high throughput time-resolved electron microscopy10.1038/s41467-020-20694-z ↗
6. Imaging properties and applications of slow-scan charge-coupled device cameras suitable for electron microscopy10.1016/0968-4328(95)00054-8 ↗
7. A survey of deep learning techniques for autonomous driving10.1002/rob.21918 ↗
8. The connected-component labeling problem: A review of state-of-the-art algorithms10.1016/j.patcog.2017.04.018 ↗
9. Deep learning object detection in materials science: Current state and future directions10.1016/j.commatsci.2022.111527 ↗
10. Direct detectors and their applications in electron microscopy for materials science10.1088/2515-7639/ac0ff9 ↗
11. Electron counting and beam-induced motion correction enable near-atomic-resolution single-particle cryo-EM10.1038/nmeth.2472 ↗
12. Influence of electron dose rate on electron counting images recorded with the K2 camera10.1016/j.jsb.2013.08.005 ↗
13. A survey and performance evaluation of deep learning methods for small object detection10.1016/j.eswa.2021.114602 ↗
14. Theoretical study of precision and accuracy of strain analysis by nano-beam electron diffraction10.1016/j.ultramic.2015.06.011 ↗
15. Detective quantum efficiency of electron area detectors in electron microscopy10.1016/j.ultramic.2009.04.002 ↗
16. Enhanced imaging in low dose electron microscopy using electron counting10.1016/j.ultramic.2009.07.004 ↗
17. Comparison of optimal performance at 300 keV of three direct electron detectors for use in low dose electron microscopy10.1016/j.ultramic.2014.08.002 ↗
18. Throughput and resolution with a next-generation direct electron detector10.1107/S2052252519012661 ↗
19. Characterisation of the signal and noise transfer of CCD cameras for electron detection10.1002/(SICI)1097-0029(20000501)49:3<269::AID-JEMT5>3.0.CO;2-B ↗
20. Characterisation of the Medipix3 detector for 60 and 80 keV electrons10.1016/j.ultramic.2017.06.010 ↗
21. Single-particle cryo-EM at atomic resolution10.1038/s41586-020-2829-0 ↗
22. Neubeck · 2006 · 850
23. Quantifying the performance of a hybrid pixel detector with GaAs:Cr sensor for transmission electron microscopy10.1016/j.ultramic.2021.113298 ↗
24. Characterizing the resolution and throughput of the Apollo direct electron detector
25. Observation of formation and local structures of metal-organic layers via complementary electron microscopy techniques10.1038/s41467-022-32330-z ↗
26. Pennycook · 2022
27. Efficient phase contrast imaging in STEM using a pixelated detector. Part 1: Experimental demonstration at atomic resolution10.1016/j.ultramic.2014.09.013 ↗
28. Hybrid pixel direct detector for electron energy loss spectroscopy10.1016/j.ultramic.2020.113067 ↗
29. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
30. The theory of super-resolution electron microscopy via Wigner-distribution deconvolution
31. U-Net: Convolutional networks for biomedical image segmentation10.1007/978-3-319-24574-4_28 ↗
32. Quantitative characterization of electron detectors for transmission electron microscopy10.1016/j.jsb.2013.10.016 ↗
33. Salvat · 2006
34. Practical considerations for using K3 cameras in CDS mode for high-resolution and high-throughput single particle cryo-EM10.1016/j.jsb.2021.107745 ↗
35. High dynamic range pixel array detector for scanning transmission electron microscopy10.1017/S1431927615015664 ↗
36. 2016
37. Sub-pixel electron detection using a convolutional neural network10.1016/j.ultramic.2020.113091 ↗
38. A review of deep learning on medical image analysis10.1007/s11036-020-01672-7 ↗
39. Complexity and accuracy analysis of common artificial neural networks on pedestrian detection10.1051/matecconf/201823201003 ↗
40. Occlusion-aware R-CNN: Detecting pedestrians in a crowd10.1007/978-3-030-01219-9_39 ↗