Multi-layer optical Fourier neural network based on the convolution theorem
Source abstract
Abstract
To take full advantage of the application of neural networks to optical systems, we design an optical neural network based on the principle of free-space optical convolution. In this article, considering the need for a high-power light source to excite the nonlinearity of an optical material, we describe how to reduce the power consumption of the system by quantifying the output of each layer after the softmax operation as an 8-bit value and loading these values into amplitude-only spatial light modulators (SLMs). In addition, we describe how to load the matrix with positive and negative values in the amplitude-only SLM by utilizing Fourier properties of the odd-order square matrix. We apply our six-layer optical network to the classification of Mixed National Institute of Standards and Technology database (MNIST) and Fashion-MNIST and find that the accuracy reaches 92.51% and 80.67%, respectively. Finally, we consider the error analysis, power consumption, and response time of our framework.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Neural Networks and Reservoir Computing · Optical Network Technologies · Photonic and Optical Devices
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronic and Optical Engineering, Nanjing University of Science and Technology , Nanjing 210094, China
Funding
National Natural Science Foundation of China · Fundamental Research Funds for the Central Universities
References (21)
Show source-provided references
1. Photonic tensor cores for machine learning10.1063/5.0001942 ↗
2. In-memory computing on a photonic platform10.1126/sciadv.aau5759 ↗
3. A review of optical neural networks10.1109/access.2020.2987333 ↗
4. Broadcast and weight: An integrated network for scalable photonic spike processing10.1109/jlt.2014.2345652 ↗
5. Neuromorphic photonic networks using silicon photonic weight banks10.1038/s41598-017-07754-z ↗
6. A high performance photonic pulse processing device10.1364/oe.17.022767 ↗
7. High-contrast all optical bistable switching in coupled nonlinear photonic crystal microcavities10.1063/1.3378812 ↗
8. Holography in artificial neural networks10.1038/343325a0 ↗
9. Deep learning with coherent nanophotonic circuits10.1038/nphoton.2017.93 ↗
10. All-optical spiking neurosynaptic networks with self-learning capabilities10.1038/s41586-019-1157-8 ↗
11. All-optical machine learning using diffractive deep neural networks10.1126/science.aat8084 ↗
12. Vector diffraction theory for electromagnetic waves10.1364/josaa.18.002585 ↗
13. Miniaturized diffraction grating design and processing for deep neural network10.1109/lpt.2019.2948626 ↗
14. Reinforcement learning in a large-scale photonic recurrent neural network10.1364/optica.5.000756 ↗
15. All-optical neural network with nonlinear activation functions10.1364/optica.6.001132 ↗
16. Fourier-space diffractive deep neural network10.1103/physrevlett.123.023901 ↗
17. Application of the convolution theorem to Rayleigh’s integral formulas10.1364/josa.57.000546 ↗
18. Nanophotonic media for artificial neural inference10.1364/prj.7.000823 ↗
19. Optical frontend for a convolutional neural network10.1364/ao.58.003179 ↗
20. The effects of small displacements of spatial filters10.1364/ao.6.001221 ↗
21. Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification10.1038/s41598-018-30619-y ↗