journal article·2023-11Open access

Snapshot Multispectral Light‐Field Imaging Based on Nematic Liquid‐Crystal Microlens Array via Deep Learning

Hui Li, Tian Li, Si Chen, Yuntao Wu

Advanced Engineering Materials· Volume 25· Issue 22

Abstract

In this study, a multispectral light‐field imaging system is developed using nematic liquid‐crystal microlens arrays (LC‐MLAs). The system solves the spectral under‐sampling and complex system issues in existing light‐field and spectral cameras. The LC‐MLA is the core optical element of the snapshot imaging system. No dispersion or customized scanning machinery is required to obtain multispectral light fields. Deep learning technology is utilized to reconstruct spectral information from raw data. In the experiments, it is demonstrated that the proposed method efficiently reconstructs multispectral data with 10 nm accuracy in the visible wavelength range of 400–700 nm. The system offers high precision, simple equipment, and relatively low cost without additional dispersion and filtering devices.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Optical Coherence Tomography Applications · Advanced Optical Imaging Technologies · Optical Polarization and Ellipsometry

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Engineering Wuhan Institute of Technology Wuhan 430205 China

Hubei Key Laboratory of Intelligent Robot Wuhan Institute of Technology Wuhan 430205 China

Funding

National Natural Science Foundation of China · Hubei Provincial Key Laboratory of Intelligent Robot · Hubei Provincial Department of Education · Wuhan Institute of Technology · Foundation for Innovative Research Groups of Hubei Province of China

References (48)

Show source-provided references
1. H.Du X.Tong X.Cao S.Lin inProc. of IEEE Int. Conf. on Computer Vision IEEE Piscataway NJ2009 pp.175–182.
2. 10.1038/srep3201210.1038/srep32012 ↗
3. 10.1007/s11434-009-0494-710.1007/s11434-009-0494-7 ↗
4. K.Hirakawa inProc. of Int. Workshop on Computational Color Imaging (CCIW) Springer Berlin German2017 pp.3–12.10.1007/978-3-319-56010-6_1 ↗
5. 10.1364/OPTICA.6.00080510.1364/OPTICA.6.000805 ↗
6. M.Hubold R.Berlich C.Gassner R.Brüning R.Brunner inProc. SPIE 10545 Vol.105450 Bellingham WA2018.
7. 10.1364/OL.33.00102310.1364/OL.33.001023 ↗
8. 10.1364/AO.53.000G2510.1364/AO.53.000G25 ↗
9. 10.1109/MSP.2016.258237810.1109/MSP.2016.2582378 ↗
10. 10.1364/AO.34.00481710.1364/AO.34.004817 ↗
11. S.Liu J. X.Zhang C.Ma H.Lin inProc. of IEEE Int. Conf. on Robotics and Biomimetics IEEE Piscataway NJ2019 pp.433–437.10.1109/ROBIO49542.2019.8961573 ↗
12. 10.1364/AO.54.00084810.1364/AO.54.000848 ↗
13. 10.1364/OL.39.00204410.1364/OL.39.002044 ↗
14. 10.1364/OL.40947610.1364/OL.409476 ↗
15. 10.1364/OPTICA.6.00092110.1364/OPTICA.6.000921 ↗
16. 10.1109/MSP.2017.276035810.1109/MSP.2017.2760358 ↗
17. 10.1364/OPTICA.4.00143710.1364/OPTICA.4.001437 ↗
18. X.Miao X.Yuan Y. C.Pu V.Athitsos inProc. of IEEE Int. Conf. on Computer Vision IEEE Piscataway NJ2019 pp.4058–4068.10.1109/ICCV.2019.00416 ↗
19. Y. H.Cai J.Lin Z. D.Lin H. Q.Wang Y. L.Zhang H.Pfister R.Timofte L. V.Gool inProc. of IEEE Conf. on Computer Vision and Pattern Recognition Workshops IEEE Piscataway NJ2022 pp.744–754.
20. 10.1038/s41377-021-00545-210.1038/s41377-021-00545-2 ↗
21. 10.1145/2661229.266126210.1145/2661229.2661262 ↗
22. Y. Z.Zhao L. ‐M.Po Q.Yan W.Liu T. Y.Lin inProc. of IEEE Conf. on Computer Vision and Pattern Recognition Workshops IEEE Piscataway NJ2020 pp.1695–1704.10.1109/CVPRW50498.2020.00219 ↗
23. J. J.Li C. X.Wu R.Song Y. S.Li F.Liu inProc. of IEEE Conf. on Computer Vision and Pattern Recognition Workshops IEEE Piscataway NJ2020 pp.1894–1903.
24. 10.1038/s41467-022-28702-010.1038/s41467-022-28702-0 ↗
25. 10.3390/s2015414210.3390/s20154142 ↗
26. 10.1016/j.optlastec.2022.10826010.1016/j.optlastec.2022.108260 ↗
27. 10.4313/TEEM.2011.12.6.23410.4313/TEEM.2011.12.6.234 ↗
28. 10.1364/JOSAA.25.00264410.1364/JOSAA.25.002644 ↗
29. 10.1063/1.492119410.1063/1.4921194 ↗
30. 10.1109/LPT.2016.257225810.1109/LPT.2016.2572258 ↗
31. 10.1109/JDT.2014.231314310.1109/JDT.2014.2313143 ↗
32. 10.1364/OE.26.00403510.1364/OE.26.004035 ↗
33. 10.1364/AO.55.00333310.1364/AO.55.003333 ↗
34. 10.1364/OE.25.01479510.1364/OE.25.014795 ↗
35. 10.1364/OL.43.00506210.1364/OL.43.005062 ↗
36. 10.1364/OE.26.02522610.1364/OE.26.025226 ↗
37. 10.1364/OE.23.02874210.1364/OE.23.028742 ↗
38. 10.1364/AO.53.00563210.1364/AO.53.005632 ↗
39. 10.1038/s41598-020-63662-910.1038/s41598-020-63662-9 ↗
40. G. C.Qian Y. H.Wang C.Dong J. S.Ren W.Heidrich B.Ghanem J. J.Gu(Preprint) arXiv:1905.02538 2019.
41. Li H. · Sensors · 2020 · 20 · 5557-1
42. M.Levoy P.Hanrahan inProc. of Conf. on Computer Graphics and Interactive Techniques ACM New York NY1996 pp.31–42.10.1145/237170.237199 ↗
43. 10.1364/OE.25.01400810.1364/OE.25.014008 ↗
44. M.Harker P.O’Leary inProc. of IEEE Conf. on Computer Vision and Pattern Recognition IEEE Piscataway NJ2011 pp.2529–2536.
45. Boyd S. · 2004 · 47510.1017/CBO9780511804441 ↗
46. B.Arad O.Ben-Shahar inEuropean Conf. Computer Vision (ECCV) Springer Berlin German2016 19–34.10.1007/978-3-319-46478-7_2 ↗
47. 10.1364/OE.22.01982410.1364/OE.22.019824 ↗
48. 10.3390/photonics904024410.3390/photonics9040244 ↗