Photonics for Neuromorphic Computing: Fundamentals, Devices, and Opportunities
Source abstract
Abstract
Abstract In the dynamic landscape of Artificial Intelligence (AI), two notable phenomena are becoming predominant: the exponential growth of large AI model sizes and the explosion of massive amount of data. Meanwhile, scientific research such as quantum computing and protein synthesis increasingly demand higher computing capacities. As the Moore's Law approaches its terminus, there is an urgent need for alternative computing paradigms that satisfy this growing computing demand and break through the barrier of the von Neumann model. Neuromorphic computing, inspired by the mechanism and functionality of human brains, uses physical artificial neurons to do computations and is drawing widespread attention. This review studies the expansion of optoelectronic devices on photonic integration platforms that has led to significant growth in photonic computing, where photonic integrated circuits (PICs) have enabled ultrafast artificial neural networks (ANN) with sub‐nanosecond latencies, low heat dissipation, and high parallelism. In particular, various technologies and devices employed in neuromorphic photonic AI accelerators, spanning from traditional optics to PCSEL lasers are examined. Lastly, it is recognized that existing neuromorphic technologies encounter obstacles in meeting the peta‐level computing speed and energy efficiency threshold, and potential approaches in new devices, fabrication, materials, and integration to drive innovation are also explored. As the current challenges and barriers in cost, scalability, footprint, and computing capacity are resolved one‐by‐one, photonic neuromorphic systems are bound to co‐exist with, if not replace, conventional electronic computers and transform the landscape of AI and scientific computing in the foreseeable future.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Neural Networks and Reservoir Computing · Advanced Memory and Neural Computing · Optical Network Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Science and Engineering, Guangdong Key Laboratory of Optoelectronic Materials and Chips, Shenzhen Key Lab of Semiconductor Lasers The Chinese University of Hong Kong, Shenzhen Shenzhen Guangdong 518172 China
SONT Technologies Co. LTD Shenzhen Guangdong 510245 China
Funding
National Natural Science Foundation of China · Shenzhen Research Institute of Big Data
References (100+)
Show source-provided references
1. Russell S. · 2010
2. J.Wei Y.Tay R.Bommasani C.Raffel B.Zoph S.Borgeaud D.Yogatama M.Bosma D.Zhou D.Metzler E. H.Chi T.Hashimoto O.Vinyals P.Liang J.Dean W.Fedus et al. arXiv preprint arXiv:2206.076822022.
3. 10.1002/adma.20190276110.1002/adma.201902761 ↗
4. 10.1002/admt.20180058910.1002/admt.201800589 ↗
5. 10.1002/adma.20220509810.1002/adma.202205098 ↗
6. 10.1038/s43588-021-00184-y10.1038/s43588-021-00184-y ↗
7. 10.1038/s41566-020-00754-y10.1038/s41566-020-00754-y ↗
8. 10.1109/JSTQE.2019.293045510.1109/JSTQE.2019.2930455 ↗
9. 10.1364/OME.8.00385110.1364/OME.8.003851 ↗
10. 10.1364/OE.27.00962010.1364/OE.27.009620 ↗
11. 10.1364/OPTICA.6.00113210.1364/OPTICA.6.001132 ↗
12. 10.1364/OPTICA.5.00086410.1364/OPTICA.5.000864 ↗
13. 10.1126/science.aat808410.1126/science.aat8084 ↗
14. 10.1038/nphoton.2017.9310.1038/nphoton.2017.93 ↗
15. 10.1038/s41586-020-03070-110.1038/s41586-020-03070-1 ↗
16. 10.1038/s41586-020-03063-010.1038/s41586-020-03063-0 ↗
17. 10.1038/s41566-023-01233-w10.1038/s41566-023-01233-w ↗
18. 10.1038/s41928-022-00719-910.1038/s41928-022-00719-9 ↗
19. 10.1038/s41586-022-04714-010.1038/s41586-022-04714-0 ↗
20. 10.1038/343325a010.1038/343325a0 ↗
21. 10.1038/s41586-019-1157-810.1038/s41586-019-1157-8 ↗
22. 10.1038/s41586-023-06558-810.1038/s41586-023-06558-8 ↗
23. 10.1038/s41928-017-0006-810.1038/s41928-017-0006-8 ↗
24. 10.1088/1674-1056/ab90e710.1088/1674-1056/ab90e7 ↗
25. 10.3389/fnano.2023.114739610.3389/fnano.2023.1147396 ↗
26. 10.1126/science.aam974410.1126/science.aam9744 ↗
27. 10.1109/MM.2017.321110510.1109/MM.2017.3211105 ↗
28. Xue S. · International Core Journal of Engineering · 2021 · 7 · 330
29. 10.1109/JSTQE.2019.294148510.1109/JSTQE.2019.2941485 ↗
30. 10.1145/359576.35957910.1145/359576.359579 ↗
31. Arikpo I. · Global Journal of Mathematical Sciences · 2007 · 6 · 97
32. 10.1016/j.micpro.2019.01.00910.1016/j.micpro.2019.01.009 ↗
33. 10.1145/1095408.109541810.1145/1095408.1095418 ↗
34. 10.1007/s11432-020-3156-710.1007/s11432-020-3156-7 ↗
35. 10.1109/TPDS.2013.12510.1109/TPDS.2013.125 ↗
36. M.Shaafiee R.Logeswaran A.Seddon in2017 7th International Conference on Cloud Computing Data Science & Engineering‐Confluence IEEE Piscataway NJ2017 pp.199–203.10.1109/CONFLUENCE.2017.7943149 ↗
37. 10.1038/s41467-021-27774-810.1038/s41467-021-27774-8 ↗
38. Hamerly R. · Phys. Rev. X · 2019 · 9
39. C.Neagu Ph.D. thesis Politecnico di Torino 2023.
40. 10.1007/978-1-4613-1639-810.1007/978-1-4613-1639-8 ↗
41. 10.1145/216585.21658810.1145/216585.216588 ↗
42. M.Horowitz in2014 IEEE international solid‐state circuits conference digest of technical papers (ISSCC) IEEE Piscataway NJ2014 pp.10–14.
43. 10.1038/s41928-018-0092-210.1038/s41928-018-0092-2 ↗
44. G.Chirkov D.Wentzlaff inProceedings of the 37th International Conference on Supercomputing ACM Inc. New York2023 p.410.10.1145/3577193.3593702 ↗
45. 10.1109/MCSE.2017.2910.1109/MCSE.2017.29 ↗
46. 10.1038/s41928-017-0005-910.1038/s41928-017-0005-9 ↗
47. 10.1016/S0375-9601(02)01365-810.1016/S0375-9601(02)01365-8 ↗
48. 10.1109/JEDS.2020.298740210.1109/JEDS.2020.2987402 ↗
49. S. A.McKee inProceedings of the 1st conference on Computing frontiers ACM Inc. New York2004 p.162.10.1145/977091.977115 ↗
50. 10.1145/232974.23298410.1145/232974.232984 ↗
51. 10.1109/TNANO.2003.82077310.1109/TNANO.2003.820773 ↗
52. Gopi B. · NeuroQuantology · 2022 · 20 · 5999
53. 10.1002/pssa.20170087510.1002/pssa.201700875 ↗
54. 10.3389/fnins.2015.0014110.3389/fnins.2015.00141 ↗
55. 10.1109/JPROC.2014.231356510.1109/JPROC.2014.2313565 ↗
56. S. G.Ramasubramanian R.Venkatesan M.Sharad K.Roy A.Raghunathan inProceedings of the 2014 international symposium on Low power electronics and design.ACM Inc. New York2014 p.15.10.1145/2627369.2627625 ↗
57. E.Farquhar C.Gordon P.Hasler in2006 IEEE international symposium on circuits and systems IEEE Piscataway NJ2006 p.4.
58. 10.1007/s11265-020-01558-710.1007/s11265-020-01558-7 ↗
59. 10.1088/0957-4484/24/38/38200110.1088/0957-4484/24/38/382001 ↗
60. 10.4324/9781003009405-2310.4324/9781003009405-23 ↗
61. Kandel E. R. · 2000
62. 10.1109/5.5835610.1109/5.58356 ↗
63. 10.1109/JPROC.2014.230463810.1109/JPROC.2014.2304638 ↗
64. K.Meier Fast analog computing with emergent transient states in neural architectures integrated project proposal Technical report FP6‐2004‐IST‐FET Proactive Part B. Kirchhoff Institut für Physik Ruprecht‐Karls‐Universitat Heidelberg 2004.
65. T.Hylton inDARPA SYNAPSE Bidder's Workshop and Teaming Meeting 2008.
66. 10.1021/nl901874j10.1021/nl901874j ↗
67. 10.3389/fnins.2015.0024110.3389/fnins.2015.00241 ↗
68. 10.1109/2.86936710.1109/2.869367 ↗
69. 10.1109/MM.2018.11213035910.1109/MM.2018.112130359 ↗
70. 10.1109/JQE.2017.278283910.1109/JQE.2017.2782839 ↗
71. 10.1126/science.108966210.1126/science.1089662 ↗
72. 10.1109/JSSC.2013.225903810.1109/JSSC.2013.2259038 ↗
73. 10.1063/5.007209010.1063/5.0072090 ↗
74. A.Borji L.Itti inProc. IEEE conference on computer vision and pattern recognition IEEE Piscataway NJ2014 pp.113–120.
75. 10.1145/2093548.209357410.1145/2093548.2093574 ↗
76. 10.1186/s43074-020-00023-910.1186/s43074-020-00023-9 ↗
77. J.MacMillan E. E.Entin D.Serfaty Americal Psychological Association 2004.
78. 10.1038/s42254-020-0208-210.1038/s42254-020-0208-2 ↗
79. S.Park S.Kim B.Na S.Yoon in2020 57th ACM/IEEE Design Automation Conference (DAC) IEEE Piscataway NJ2020 pp.1–6.10.1109/DAC18072.2020.9218545 ↗
80. C. D.Schuman S. R.Young J. P.Mitchell J. T.Johnston D.Rose B. P.Maldonado B. C.Kaul in2020 11th International Green and Sustainable Computing Workshops (IGSC) IEEE Piscataway NJ2020 pp.1–8.10.1109/IGSC51522.2020.9291228 ↗
81. 10.1109/TNNLS.2013.229677710.1109/TNNLS.2013.2296777 ↗
82. 10.1109/LED.2020.300658110.1109/LED.2020.3006581 ↗
83. 10.1088/1361-6528/ac592810.1088/1361-6528/ac5928 ↗
84. M.Yan N.Meisburger T.Medini A.Shrivastava arXiv preprint arXiv:2201.126672022.
85. H.‐B.Chen S.Fu in2016 IEEE International Conference on Networking Architecture and Storage (NAS) IEEE Picataway NJ2016 pp.1–4.
86. 10.1002/aisy.20200015010.1002/aisy.202000150 ↗
87. 10.1103/RevModPhys.85.96110.1103/RevModPhys.85.961 ↗
88. 10.1016/j.jallcom.2018.04.04010.1016/j.jallcom.2018.04.040 ↗
89. 10.55782/ane-2011-186210.55782/ane-2011-1862 ↗
90. 10.1038/s41565-021-01045-510.1038/s41565-021-01045-5 ↗
91. 10.1007/978-3-031-20473-910.1007/978-3-031-20473-9 ↗
92. 10.1038/s41467-021-27774-810.1038/s41467-021-27774-8 ↗
93. 10.1038/s41586-020-03063-010.1038/s41586-020-03063-0 ↗
94. 10.1364/OME.44733010.1364/OME.447330 ↗
95. 10.1063/1.505263510.1063/1.5052635 ↗
96. 10.1038/s41467-020-14736-910.1038/s41467-020-14736-9 ↗
97. 10.1038/nature0356910.1038/nature03569 ↗
98. 10.1038/nnano.2009.29210.1038/nnano.2009.292 ↗
99. 10.1038/nmat320010.1038/nmat3200 ↗
100. 10.1364/OME.42519610.1364/OME.425196 ↗