journal article·2024-07Open access

Generating Multi‐Depth 3D Holograms Using a Fully Convolutional Neural Network

Xingpeng Yan, Xinlei Liu, Jiaqi Li, Yanan Zhang, Hebin Chang, Tao Jing, Hairong Hu, Qiang Qu, Xi Wang, Xiaoyu Jiang

Advanced Science· Volume 11· Issue 28

Abstract

Abstract Efficiently generating 3D holograms is one of the most challenging research topics in the field of holography. This work introduces a method for generating multi‐depth phase‐only holograms using a fully convolutional neural network (FCN). The method primarily involves a forward–backward‐diffraction framework to compute multi‐depth diffraction fields, along with a layer‐by‐layer replacement method (L2RM) to handle occlusion relationships. The diffraction fields computed by the former are fed into the carefully designed FCN, which leverages its powerful non‐linear fitting capability to generate multi‐depth holograms of 3D scenes. The latter can smooth the boundaries of different layers in scene reconstruction by complementing information of occluded objects, thus enhancing the reconstruction quality of holograms. The proposed method can generate a multi‐depth 3D hologram with a PSNR of 31.8 dB in just 90 ms for a resolution of 2160 × 3840 on the NVIDIA Tesla A100 40G tensor core GPU. Additionally, numerical and experimental results indicate that the generated holograms accurately reconstruct clear 3D scenes with correct occlusion relationships and provide excellent depth focusing.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Optical Imaging Technologies · Digital Holography and Microscopy · Advanced Vision and Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Information Communication Army Academy of Armored Forces Beijing 100072 China

National Digital Switching System Engineering and Technological Research Center Zhengzhou 450001 China

Information Engineering University Zhengzhou 450001 China

Funding

National Natural Science Foundation of China

References (76)

Show source-provided references
1. 10.1038/s41377-023-01254-810.1038/s41377-023-01254-8 ↗
2. 10.1038/ncomms145610.1038/ncomms1456 ↗
3. 10.1038/s41586-019-1739-510.1038/s41586-019-1739-5 ↗
4. 10.1038/161777a010.1038/161777a0 ↗
5. 10.1038/s41586-020-03152-010.1038/s41586-020-03152-0 ↗
6. 10.1364/AOP.5.00045610.1364/AOP.5.000456 ↗
7. 10.1145/3072959.307362410.1145/3072959.3073624 ↗
8. 10.1016/j.optlaseng.2019.10589510.1016/j.optlaseng.2019.105895 ↗
9. Blinder D. · LAM · 2022 · 3 · 572
10. 10.37188/lam.2021.02810.37188/lam.2021.028 ↗
11. 10.1038/s41928-018-0057-510.1038/s41928-018-0057-5 ↗
12. 10.1364/OE.23.02544010.1364/OE.23.025440 ↗
13. 10.1364/OPTICA.4.00130610.1364/OPTICA.4.001306 ↗
14. 10.1364/OE.21.02057710.1364/OE.21.020577 ↗
15. 10.1364/OL.46946310.1364/OL.469463 ↗
16. 10.1145/3355089.335653910.1145/3355089.3356539 ↗
17. 10.1364/AO.17.00387410.1364/AO.17.003874 ↗
18. 10.1364/AO.32.00252610.1364/AO.32.002526 ↗
19. W.Frees T.Kämpf E. B.Kley A.Tünnermann Proc. SPIE7927 SPIE San Francisco CA USA 2011.
20. Tay S. · Nature · 2008 · 2008 · 451
21. 10.1038/nature0952110.1038/nature09521 ↗
22. 10.1038/nnano.2015.210.1038/nnano.2015.2 ↗
23. 10.1038/ncomms380810.1038/ncomms3808 ↗
24. 10.1038/nature1221710.1038/nature12217 ↗
25. 10.1038/nphoton.2009.1810.1038/nphoton.2009.18 ↗
26. 10.1038/s41377-023-01202-610.1038/s41377-023-01202-6 ↗
27. 10.1038/s41566-022-01086-910.1038/s41566-022-01086-9 ↗
28. 10.1364/OL.41.00430110.1364/OL.41.004301 ↗
29. 10.1016/j.optlaseng.2017.11.01310.1016/j.optlaseng.2017.11.013 ↗
30. 10.1364/OE.40058710.1364/OE.400587 ↗
31. 10.1038/ncomms328910.1038/ncomms3289 ↗
32. 10.1126/science.aat808410.1126/science.aat8084 ↗
33. 10.1038/s41566-021-00796-w10.1038/s41566-021-00796-w ↗
34. 10.1126/sciadv.abf971810.1126/sciadv.abf9718 ↗
35. 10.1364/PRJ.44306310.1364/PRJ.443063 ↗
36. 10.1038/s41377-023-01125-210.1038/s41377-023-01125-2 ↗
37. 10.1038/s41467-023-37594-710.1038/s41467-023-37594-7 ↗
38. PWM T. · Light‐Sci. Appl. · 2018 · 6 · 10
39. 10.1109/TIP.2021.312549510.1109/TIP.2021.3125495 ↗
40. 10.1364/OE.42123010.1364/OE.421230 ↗
41. 10.1364/OE.26.01920610.1364/OE.26.019206 ↗
42. 10.1364/OE.45354110.1364/OE.453541 ↗
43. 10.1364/OE.41031410.1364/OE.410314 ↗
44. 10.1117/12.40921310.1117/12.409213 ↗
45. 10.1364/AO.47.000D5510.1364/AO.47.000D55 ↗
46. 10.1364/AO.47.000D4410.1364/AO.47.000D44 ↗
47. 10.1364/OE.25.03041810.1364/OE.25.030418 ↗
48. 10.1364/OE.25.00007710.1364/OE.25.000077 ↗
49. 10.1016/j.cpc.2011.12.02710.1016/j.cpc.2011.12.027 ↗
50. Pang H. · IEEE Photonics J · 2017 · 9 · 1
51. RW G. · Optik · 1972 · 35 · 237
52. 10.1364/OE.41372310.1364/OE.413723 ↗
53. 10.1364/OPTICA.6.00092110.1364/OPTICA.6.000921 ↗
54. 10.1038/s41377-019-0196-010.1038/s41377-019-0196-0 ↗
55. 10.1038/s41566-020-0685-y10.1038/s41566-020-0685-y ↗
56. 10.1038/s41377-022-00894-610.1038/s41377-022-00894-6 ↗
57. 10.37188/lam.2022.01310.37188/lam.2022.013 ↗
58. 10.1145/3478513.348054210.1145/3478513.3480542 ↗
59. 10.1364/OE.39962410.1364/OE.399624 ↗
60. 10.1364/OE.40231710.1364/OE.402317 ↗
61. 10.1038/s41467-022-33728-510.1038/s41467-022-33728-5 ↗
62. 10.1364/JOSAA.21.00073710.1364/JOSAA.21.000737 ↗
63. 10.1121/1.140438110.1121/1.1404381 ↗
64. 10.1364/OE.42507710.1364/OE.425077 ↗
65. Zhou P. · Appl. Opt. · 2014 · 53 · G206
66. 10.1016/j.optlaseng.2023.10775810.1016/j.optlaseng.2023.107758 ↗
67. 10.3807/JOSK.2012.16.4.38110.3807/JOSK.2012.16.4.381 ↗
68. 10.1364/OE.25.00266610.1364/OE.25.002666 ↗
69. 10.1364/OL.42400010.1364/OL.424000 ↗
70. 10.1364/OE.17.01966210.1364/OE.17.019662 ↗
71. 10.1364/OE.47320510.1364/OE.473205 ↗
72. Goodman W. J. S. · 2007
73. 10.1364/OE.24.03036810.1364/OE.24.030368 ↗
74. 10.1364/AO.41.00343610.1364/AO.41.003436 ↗
75. 10.1145/306538610.1145/3065386 ↗
76. Ronneberger O. · Arxiv abs/1505.04597 · 2015