Low-threshold all-optical nonlinear activation function based on a Ge/Si hybrid structure in a microring resonator
Source abstract
Abstract
Optical nonlinear activation function is an indispensable part of the optical neural network. While linear matrix computation has thrived in an integrated optical neural network, there are many challenges for nonlinear activation function on a chip such as large latency, high power consumption and high threshold. Here, we demonstrate that Ge/Si hybrid structure would be a qualified candidate owing to its property of CMOS-compatibility, low nonlinear threshold and compact footprint. Thanks to the strong thermal-optic effect of germanium in conjunction with micro-ring resonator, we experimentally demonstrate three different types of nonlinear function (Radial basis, Relu and ELU functions) with a lowest threshold of 0.74 mW among our measured nonlinear functions and they can work well with a repetition rate below 100 kHz. Simultaneous size shrinkage of germanium and resonance constraint inside germanium is proposed to speed up response time. Furthermore, we apply our measured nonlinear activation function to the task of classification of MNIST handwritten digit image dataset and improve the test accuracy from 91.8% to 94.8% with feedforward full-connected neural network containing three hidden layers. It proves that our scheme has potential in the future optical neural network.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Neural Networks and Reservoir Computing · Photonic and Optical Devices · Advanced Fiber Laser Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Huazhong University of Science and Technology
Funding
National Key Research and Development Program of China · National Natural Science Foundation of China
References (34)
Show source-provided references
1. Shastri · Nat. Photonics · 2021 · 15 · 10210.1038/s41566-020-00754-y ↗
2. Lin · Science · 2018 · 361 · 100410.1126/science.aat8084 ↗
3. Dejonckheere · Opt. Express · 2014 · 22 · 1086810.1364/OE.22.010868 ↗
4. Bueno · Optica · 2018 · 5 · 75610.1364/OPTICA.5.000756 ↗
5. Shen · Nat. Photonics · 2017 · 11 · 44110.1038/nphoton.2017.93 ↗
6. Zhang · Nat. Commun. · 2021 · 12 · 45710.1038/s41467-020-20719-7 ↗
7. Nakajima · Commun. Phys. · 2021 · 4 · 110.1038/s42005-021-00519-1 ↗
8. Hughes · Optica · 2018 · 5 · 86410.1364/OPTICA.5.000864 ↗
9. Tait · Phys. Rev. Appl. · 2019 · 11 · 06404310.1103/PhysRevApplied.11.064043 ↗
10. Tait · Opt. Express · 2018 · 26 · 2642210.1364/OE.26.026422 ↗
11. Tait · IEEE J. Sel. Top. Quantum Electron. · 2016 · 22 · 59021410.1109/JSTQE.2016.2573583 ↗
12. Tait · IEEE Photonics Technol. Lett. · 2016 · 28 · 88710.1109/LPT.2016.2516440 ↗
13. Feldmann · Nature · 2019 · 569 · 20810.1038/s41586-019-1157-8 ↗
14. Wu · Nat. Commun. · 2021 · 12 · 9610.1038/s41467-020-20365-z ↗
15. Feldmann · Nature · 2021 · 589 · 5210.1038/s41586-020-03070-1 ↗
16. Zuo · Optica · 2019 · 6 · 113210.1364/OPTICA.6.001132 ↗
17. Miscuglio · Opt. Mater. Express · 2018 · 8 · 385110.1364/OME.8.003851 ↗
18. Shi · IEEE J. Sel. Top. Quantum Electron. · 2020 · 26 · 7701110.1109/JSTQE.2019.2945548 ↗
19. Mourgias-Alexandris · Opt. Express · 2019 · 27 · 962010.1364/OE.27.009620 ↗
20. Crnjanski · Opt. Lett. · 2021 · 46 · 200310.1364/OL.422930 ↗
21. Duport · Opt. Express · 2012 · 20 · 2278310.1364/OE.20.022783 ↗
22. Xiang · IEEE J. Sel. Top. Quantum Electron. · 2019 · 25 · 17001910.1109/JSTQE.2019.2911565 ↗
23. George · Opt. Express · 2019 · 27 · 518110.1364/OE.27.005181 ↗
24. Amin · APL Mater. · 2019 · 7 · 08111210.1063/1.5109039 ↗
25. Williamson · IEEE J. Sel. Top. Quantum Electron. · 2020 · 26 · 110.1109/JSTQE.2019.2930455 ↗
26. Jha · Opt. Lett. · 2020 · 45 · 481910.1364/OL.398234 ↗
27. Cheng · Sci. Adv. · 2017 · 3 · e170016010.1126/sciadv.1700160 ↗
28. Chen · Opt. Express · 2016 · 24 · 462210.1364/OE.24.004622 ↗
29. Tsoulos · Nanophotonics · 2020 · 9 · 384910.1515/nanoph-2019-0534 ↗
30. Sorianello · Appl. Phys. Lett. · 2008 · 93 · 11111510.1063/1.2987999 ↗
31. Peng · Proc. SPIE · 2011 · 8199 · 81990Y10.1117/12.904774 ↗
32. Duh · Nat. Commun. · 2020 · 11 · 410110.1038/s41467-020-17846-6 ↗
33. Li · Appl. Opt. · 2011 · 50 · 23110.1364/AO.50.000231 ↗
34. Ishikawa · Appl. Phys. Lett. · 2003 · 82 · 204410.1063/1.1564868 ↗