O-Net: A Fast and Precise Deep-Learning Architecture for Computational Super-Resolved Phase-Modulated Optical Microscopy
Source abstract
Abstract
Abstract We present a fast and precise deep-learning architecture, which we term O-Net, for obtaining super-resolved images from conventional phase-modulated optical microscopical techniques, such as phase-contrast microscopy and differential interference contrast microscopy. O-Net represents a novel deep convolutional neural network that can be trained on both simulated and experimental data, the latter of which is being demonstrated in the present context. The present study demonstrates the ability of the proposed method to achieve super-resolved images even under poor signal-to-noise ratios and does not require prior information on the point spread function or optical character of the system. Moreover, unlike previous state-of-the-art deep neural networks (such as U-Nets), the O-Net architecture seemingly demonstrates an immunity to network hallucination, a commonly cited issue caused by network overfitting when U-Nets are employed. Models derived from the proposed O-Net architecture are validated through empirical comparison with a similar sample imaged via scanning electron microscopy (SEM) and are found to generate ultra-resolved images which came close to that of the actual SEM micrograph.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Fluorescence Microscopy Techniques · Digital Holography and Microscopy · Image Processing Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Devan Nair Institute for Employment and Employability Newcastle Research and Innovation Institute Pte Ltd, (NewRIIS), , Singapore 609607
Newcastle University Faculty of Science, Agriculture and Engineering, , Newcastle upon Tyne NE1 7RU, UK
Newcastle University in Singapore, SIT Building @ Nanyang Polytechnic , Singapore 567739
Northumbria University Computer and Information Sciences, , Newcastle upon Tyne NE1 8ST, UK
References (47)
Show source-provided references
1. Abramowitz · ..
2. Abramowitz · ..
3. AIVIA · ..
4. Akst · 2018
5. AMD Radeon™ RX Graphics Cards · ..
6. Artificial Intelligence for 3D Visualization and Analysis Software · ..
7. AWS Deep Learning AMIs · ..
8. Bagnell · 2012
9. Barone · ..
10. A deep neural network (DNN) based classification model in application to loan default prediction
11. Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction10.1038/s41592-019-0458-z ↗
12. Imaging intracellular fluorescent proteins at nanometer resolution10.1126/science.1127344 ↗
13. Brownlee · 2019
14. Chambers · ..
15. Chambers · ..
16. Cohn · 2015
17. GeForce RTX 30 Series · ..
18. Girshick · 2014
19. Godoy · 2018
20. He · 2016
21. Hendrycks · 2020
22. The promise and peril of deep learning in microscopy10.1038/s41592-020-01035-w ↗
23. IBM Watson products · ..
24. Introduction to Modulation Transfer Function · ..
25. Isola · 2017
26. Smart nanoscopy: A review of computational approaches to achieve super-resolved optical microscopy10.1109/ACCESS.2020.3040319 ↗
27. Kaderuppan · 2022
28. Kızrak · 2019
29. Krizhevsky · 2012
30. Backpropagation applied to handwritten zip code recognition10.1162/neco.1989.1.4.541 ↗
31. Murphy · ..
32. Murphy · 2012
33. Deep-STORM: Super-resolution single-molecule microscopy by deep learning10.1364/OPTICA.5.000458 ↗
34. Deep learning massively accelerates super-resolution localization microscopy10.1038/nbt.4106 ↗
35. pix2pix: Image-to-image translation with a conditional GAN · 2021
36. Ramachandran · 2017
37. Speckle noise removal in image-based detection of refractive index changes in porous silicon microarrays10.1038/s41598-019-51435-y ↗
38. Deep learning microscopy10.1364/OPTICA.4.001437 ↗
39. Robinson · ..
40. Ronneberger · 2015
41. Scientific Volume Imaging · ..
42. Efficient processing of deep neural networks: A tutorial and survey10.1109/JPROC.2017.2761740 ↗
43. Deep learning enables cross-modality super-resolution in fluorescence microscopy10.1038/s41592-018-0239-0 ↗
44. Welcome To Colaboratory · ..
45. Poisson-Gaussian noise reduction using the hidden Markov model in contourlet domain for fluorescence microscopy images10.1371/journal.pone.0136964 ↗
46. Systematic review of research on artificial intelligence applications in higher education – where are the educators?10.1186/s41239-019-0171-0 ↗
47. Breast cancer multi-classification from histopathological images with structured deep learning model10.1038/s41598-017-04075-z ↗