journal article·2026-06Open access

Decoding Naturalistic Episodic Memory with Artificial Intelligence and Brain‐Machine Interface

Dong Song

Advanced Science· Volume 13· Issue 31

Abstract

ABSTRACT Episodic memory integrates what, where, and when of experience into a coherent autobiographical narrative. Decades of research have identified hippocampal place, time, and concept cells as neural correlates of these components. Yet a major challenge remains: real‐life memory encoding occurs in high‐dimensional, naturalistic settings, where multimodal sensory, emotional, and cognitive processes intertwine across time and context. Traditional paradigms and analytical tools are insufficient to decode the neural activity underlying such complex experiences. Recent advances in artificial intelligence (AI) offer new means to address this challenge. AI models, such as variational autoencoders and multimodal alignment frameworks, can extract latent representations from neural and behavioral data, capturing the naturalistic structure of memory encoding. Large language models further provide powerful frameworks for interpreting subjective memory reports, linking verbal narratives to memory encoding. When integrated with closed‐loop brain–machine interfaces (BMIs) capable of recording from and manipulating large populations of neurons in relevant brain regions, these tools make it possible to address the long‐standing questions: how to decode memory codes during naturalistic behaviors and whether these memory codes causally generate memories rather than merely correlate with them. This integrated AI–BMI framework outlines a roadmap from mapping to engineering memory, with implications for Alzheimer's disease, traumatic brain injury, and PTSD.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Memory and Neural Mechanisms · Memory Processes and Influences · Traumatic Brain Injury Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Neurological Surgery Department of Biomedical Engineering Neuroscience Graduate Program Neurorestoration Center University of Southern California Los Angeles California USA

References (98)

Show source-provided references
1. Tulving E. · 1972
2. 10.1136/jnnp.20.1.1110.1136/jnnp.20.1.11 ↗
3. 10.1523/JNEUROSCI.06‐10‐02950.198610.1523/JNEUROSCI.06‐10‐02950.1986 ↗
4. 10.1002/hipo.45004041010.1002/hipo.450040410 ↗
5. 10.1126/science.189684910.1126/science.1896849 ↗
6. 10.1016/0006-8993(71)90358-110.1016/0006-8993(71)90358-1 ↗
7. 10.1038/nature0372110.1038/nature03721 ↗
8. O'Keefe J. · 1978
9. 10.1016/j.neuron.2011.07.01210.1016/j.neuron.2011.07.012 ↗
10. 10.1037/0735‐7044.107.5.71510.1037/0735‐7044.107.5.715 ↗
11. 10.1523/JNEUROSCI.1378-09.200910.1523/JNEUROSCI.1378-09.2009 ↗
12. 10.1016/j.neuron.2017.06.03610.1016/j.neuron.2017.06.036 ↗
13. 10.1016/S0896-6273(00)00071-410.1016/S0896-6273(00)00071-4 ↗
14. 10.1038/s41562-023-01706-610.1038/s41562-023-01706-6 ↗
15. 10.1002/hipo.2073110.1002/hipo.20731 ↗
16. 10.1073/pnas.040016210110.1073/pnas.0400162101 ↗
17. 10.1038/nature0368710.1038/nature03687 ↗
18. 10.1126/sciadv.ado616610.1126/sciadv.ado6166 ↗
19. 10.1016/j.neuron.2024.09.01310.1016/j.neuron.2024.09.013 ↗
20. 10.1038/s41586‐024‐07309‐z10.1038/s41586‐024‐07309‐z ↗
21. 10.1371/journal.pbio.300029010.1371/journal.pbio.3000290 ↗
22. 10.1038/s41593‐023‐01550‐x10.1038/s41593‐023‐01550‐x ↗
23. 10.1038/s41467‐024‐52295‐510.1038/s41467‐024‐52295‐5 ↗
24. 10.1002/advs.20250204710.1002/advs.202502047 ↗
25. 10.1162/neco_a_0145910.1162/neco_a_01459 ↗
26. 10.1016/j.neuron.2013.03.00710.1016/j.neuron.2013.03.007 ↗
27. 10.1038/nn.330410.1038/nn.3304 ↗
28. 10.1523/JNEUROSCI.1045‐22.202210.1523/JNEUROSCI.1045‐22.2022 ↗
29. 10.1016/j.conb.2018.07.00910.1016/j.conb.2018.07.009 ↗
30. 10.1126/science.aax075810.1126/science.aax0758 ↗
31. 10.1093/cercor/bhae28710.1093/cercor/bhae287 ↗
32. 10.1523/JNEUROSCI.1728‐22.202310.1523/JNEUROSCI.1728‐22.2023 ↗
33. 10.1016/j.brs.2021.08.01410.1016/j.brs.2021.08.014 ↗
34. 10.1038/s41467‐018‐06876‐w10.1038/s41467‐018‐06876‐w ↗
35. 10.1016/j.brs.2023.07.00210.1016/j.brs.2023.07.002 ↗
36. 10.1038/s41467‐017‐02753‐010.1038/s41467‐017‐02753‐0 ↗
37. 10.1126/science.280.5365.92110.1126/science.280.5365.921 ↗
38. 10.1126/science.118821010.1126/science.1188210 ↗
39. A Wearable Platform for Closed‐Loop Stimulation and Recording of Single‐Neuron and Local Field Potential Activity in Freely Moving Humans
40. 10.1038/s41467‐023‐42231‐410.1038/s41467‐023‐42231‐4 ↗
41. 10.1523/JNEUROSCI.1005-25.202510.1523/JNEUROSCI.1005-25.2025 ↗
42. 10.1038/s41467‐021‐25376‐y10.1038/s41467‐021‐25376‐y ↗
43. 10.7554/eLife.106758.110.7554/eLife.106758.1 ↗
44. Reading Specific Memories from Human Neurons Before and After Sleep
45. 10.1038/s41562‐024‐01878‐910.1038/s41562‐024‐01878‐9 ↗
46. 10.1073/pnas.221428511910.1073/pnas.2214285119 ↗
47. 10.1038/s41583‐023‐00692‐y10.1038/s41583‐023‐00692‐y ↗
48. 10.1038/s41562‐025‐02119‐310.1038/s41562‐025‐02119‐3 ↗
49. 10.1016/j.neuropsychologia.2024.10897110.1016/j.neuropsychologia.2024.108971 ↗
50. 10.7551/mitpress/11474.001.000110.7551/mitpress/11474.001.0001 ↗
51. 10.1038/nn.424410.1038/nn.4244 ↗
52. Object Detection from Video Tubelets with Convolutional Neural Networks
53. D. P.KingmaandM.Welling “2nd International Conference on Learning Representations ICLR 2014 – Conference Track Proceedings ” (2014).
54. 10.1038/s41592‐018‐0109‐910.1038/s41592‐018‐0109‐9 ↗
55. Attention Is All You Need
56. 10.1162/neco.1997.9.8.173510.1162/neco.1997.9.8.1735 ↗
57. T.Chen S.Kornblith M.Norouzi andG.Hinton “37th International Conference on Machine Learning ICML 2020 Vol. PartF168147‐3 ” (2020).
58. Representation Learning with Contrastive Predictive Coding
59. 10.1016/j.neucom.2025.13140910.1016/j.neucom.2025.131409 ↗
60. 10.1109/TPAMI.2023.327515610.1109/TPAMI.2023.3275156 ↗
61. Y.Jiang K.Ning Z.Pan et al. “Multi‐Modal Time Series Analysis: a Tutorial and Survey ” inProceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining(2025) 6043–6053.10.1145/3711896.3736567 ↗
62. 10.1007/s10827‐012‐0384‐x10.1007/s10827‐012‐0384‐x ↗
63. 10.1002/978047167937010.1002/9780471679370 ↗
64. 10.1016/j.tins.2022.06.00310.1016/j.tins.2022.06.003 ↗
65. 10.1038/nature1102810.1038/nature11028 ↗
66. 10.1007/978-1-4614-7320-6_558-110.1007/978-1-4614-7320-6_558-1 ↗
67. 10.1109/TNSRE.2016.260442310.1109/TNSRE.2016.2604423 ↗
68. 10.1109/TBME.2007.89194810.1109/TBME.2007.891948 ↗
69. 10.1088/1741‐2560/8/4/04601710.1088/1741‐2560/8/4/046017 ↗
70. 10.1088/1741-2560/10/6/06601310.1088/1741-2560/10/6/066013 ↗
71. 10.1088/1741-2552/aaaed710.1088/1741-2552/aaaed7 ↗
72. 10.1016/j.neuroscience.2010.07.03210.1016/j.neuroscience.2010.07.032 ↗
73. 10.1016/j.neuron.2009.07.01610.1016/j.neuron.2009.07.016 ↗
74. 10.3389/fnsys.2014.0009710.3389/fnsys.2014.00097 ↗
75. 10.1038/nn.430410.1038/nn.4304 ↗
76. 10.1038/s41593‐023‐01324‐510.1038/s41593‐023‐01324‐5 ↗
77. 10.7554/eLife.3627510.7554/eLife.36275 ↗
78. 10.1016/j.neuron.2020.01.02110.1016/j.neuron.2020.01.021 ↗
79. 10.1088/1741-2552/aa752610.1088/1741-2552/aa7526 ↗
80. 10.1016/j.neuron.2024.12.02310.1016/j.neuron.2024.12.023 ↗
81. 10.1038/nature0951010.1038/nature09510 ↗
82. 10.3389/fnins.2019.0101110.3389/fnins.2019.01011 ↗
83. 10.1088/1741-2552/aa945110.1088/1741-2552/aa9451 ↗
84. 10.1073/pnas.190065411610.1073/pnas.1900654116 ↗
85. 10.1038/s41746-022-00592-y10.1038/s41746-022-00592-y ↗
86. 10.1016/j.artmed.2024.10283010.1016/j.artmed.2024.102830 ↗
87. 10.1038/s41746-020-00367-310.1038/s41746-020-00367-3 ↗
88. 10.1146/annurev‐control‐061720‐01234810.1146/annurev‐control‐061720‐012348 ↗
89. 10.1146/annurev.psych.53.100901.13511410.1146/annurev.psych.53.100901.135114 ↗
90. 10.1002/ana.2129510.1002/ana.21295 ↗
91. 10.1111/j.2044‐8295.1973.tb01322.x10.1111/j.2044‐8295.1973.tb01322.x ↗
92. 10.1080/0168863890840092810.1080/01688638908400928 ↗
93. 10.1037/0278‐7393.20.6.134110.1037/0278‐7393.20.6.1341 ↗
94. 10.1016/j.metip.2025.10018310.1016/j.metip.2025.100183 ↗
95. 10.1016/j.brs.2023.04.00710.1016/j.brs.2023.04.007 ↗
96. 10.1016/j.neuron.2020.02.02410.1016/j.neuron.2020.02.024 ↗
97. 10.1186/s12910‐020‐00532‐z10.1186/s12910‐020‐00532‐z ↗
98. 10.1007/s12152-022-09512-z10.1007/s12152-022-09512-z ↗