journal article·2025-01Open access

Full‐Color, Wide Field‐of‐View Metalens Imaging via Deep Learning

Yunxi Dong, Bowen Zheng, Fan Yang, Hong Tang, Huan Zhao, Yi Huang, Tian Gu, Juejun Hu, Hualiang Zhang

Advanced Optical Materials· Volume 13· Issue 3

Abstract

Abstract Chromatic aberration has been the main showstopper for metalenses when it comes to imaging applications with broadband sources such as ambient light. In wide field‐of‐view metalenses, this challenge becomes far more severe due to exacerbated lateral chromatic aberrations. In this paper, it is demonstrated, for the first time, full‐color wide field‐of‐view imaging using a fisheye metalens coupled with deep learning computational processing. This approach is capable of restoring panoramic images with enhanced signal‐to‐noise ratio while effectively correcting chromatic aberration, distortion, and vignetting. Furthermore, it is shown that the deep learning algorithm is robust against various lighting conditions and object distances, making it a versatile solution for practical imaging applications involving wide field‐of‐view metalenses.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Optical Coatings and Gratings · Advanced optical system design · Metamaterials and Metasurfaces Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical and Computer Engineering University of Massachusetts Lowell Lowell MA 01854 USA

Department of Materials Science and Engineering Massachusetts Institute of Technology Cambridge MA 02139 USA

Funding

Defense Sciences Office, DARPA

References (37)

Show source-provided references
1. 10.1038/s41467-019-08305-y10.1038/s41467-019-08305-y ↗
2. 10.1021/acs.nanolett.6b0513710.1021/acs.nanolett.6b05137 ↗
3. 10.1038/s41578-020-0203-310.1038/s41578-020-0203-3 ↗
4. 10.3390/app913272710.3390/app9132727 ↗
5. 10.1021/acs.nanolett.0c0278310.1021/acs.nanolett.0c02783 ↗
6. Yang F. · Adv. Photon. · 2023 · 5
7. 10.1364/JOSAB.49665310.1364/JOSAB.496653 ↗
8. 10.1515/nanoph-2021-077010.1515/nanoph-2021-0770 ↗
9. 10.1021/acs.nanolett.7b0188810.1021/acs.nanolett.7b01888 ↗
10. 10.1515/nanoph-2021-074810.1515/nanoph-2021-0748 ↗
11. 10.1038/ncomms1368210.1038/ncomms13682 ↗
12. 10.1364/OPTICA.6.00146110.1364/OPTICA.6.001461 ↗
13. 10.1038/s41377-018-0078-x10.1038/s41377-018-0078-x ↗
14. Wang S. · Nat. Nanotechnol. · 2018 · 13
15. 10.1038/s41565-017-0034-610.1038/s41565-017-0034-6 ↗
16. 10.1364/OPTICA.38940410.1364/OPTICA.389404 ↗
17. 10.1051/epjam/202201210.1051/epjam/2022012 ↗
18. 10.1364/OL.43939310.1364/OL.439393 ↗
19. 10.1364/OE.25.02163710.1364/OE.25.021637 ↗
20. 10.1364/OE.46632110.1364/OE.466321 ↗
21. 10.1021/acsphotonics.3c0045710.1021/acsphotonics.3c00457 ↗
22. 10.1021/acsphotonics.3c0187010.1021/acsphotonics.3c01870 ↗
23. 10.1021/acsphotonics.3c0134910.1021/acsphotonics.3c01349 ↗
24. 10.1117/1.AP.6.6.06600210.1117/1.AP.6.6.066002 ↗
25. Liu Y. · Adv. Photon. · 2024 · 6
26. 10.3788/COL202321.02360110.3788/COL202321.023601 ↗
27. 10.1007/978-3-030-00889-5_110.1007/978-3-030-00889-5_1 ↗
28. H.Huang L.Lin R.Tong H.Hu Q.Zhang Y.Iwamoto X.Han Y.Chen J.Wu ICASSP 2020 –2020 IEEE International Conference on Acoustics Speech and Signal Processing IEEE Piscataway NJ2020 1055.
29. 10.1109/TCI.2016.264486510.1109/TCI.2016.2644865 ↗
30. D.Hendrycks K.Gimpel arXiv2016 arxiv.org/abs/1606.08415.
31. 10.1007/978-3-031-20071-7_210.1007/978-3-031-20071-7_2 ↗
32. R.Rombach A.Blattmann D.Lorenz P.Esser B.Ommer in2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) IEEE New Orleans LA USA2022 pp.10674–10685.10.1109/CVPR52688.2022.01042 ↗
33. X.Wang L.Xie C.Dong Y.Shan in2021 IEEE/CVF Int. Conf. on Computer Vision Workshops (ICCVW) IEEE Montreal BC Canada2021 pp.1905–1914.10.1109/ICCVW54120.2021.00217 ↗
34. D.Kingma J.Ba arXiv2014 arxiv.org/abs/1412.6980.
35. 10.5201/ipol.2014.10710.5201/ipol.2014.107 ↗
36. R.‐Q.Wu Z.‐P.Duan C.‐L.Guo Z.Chai C.‐Y.Li in2023 IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR) IEEE Vancouver BC Canada2023 pp.22282–22291.
37. K.Simonyan A.Zisserman in3rd Int. Conf. on Learning Representations (ICLR 2015) Computational And Biological Learning Society2015 pp.1–14.