Reinforcement Learning and Physics
Source abstract
Abstract
Machine learning techniques provide a remarkable tool for advancing scientific research, and this area has significantly grown in the past few years. In particular, reinforcement learning, an approach that maximizes a (long-term) reward by means of the actions taken by an agent in a given environment, can allow one for optimizing scientific discovery in a variety of fields such as physics, chemistry, and biology. Morover, physical systems, in particular quantum systems, may allow one for more efficient reinforcement learning protocols. In this review, we describe recent results in the field of reinforcement learning and physics. We include standard reinforcement learning techniques in the computer science community for enhancing physics research, as well as the more recent and emerging area of quantum reinforcement learning, inside quantum machine learning, for improving reinforcement learning computations.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Quantum Computing Algorithms and Architecture · Neural Networks and Reservoir Computing · Quantum Information and Cryptography
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
IDAL, Electronic Engineering Department, ETSE-UV, University of Valencia, Avenida de la Universitat s/n Burjassot, 46100 Valencia, Spain
Departamento de Física Atómica, Molecular y Nuclear, Universidad de Sevilla, 41080 Sevilla, Spain
Funding
Ministerio de Ciencia e Innovación
References (49)
Show source-provided references
1. Theodoridis, S. (2020). Machine Learning: A Bayesian and Optimization Perspective, Academic Press.
2. Shalev-Shwartz, S., and Ben-David, S. (2014). Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press.10.1017/CBO9781107298019 ↗
3. Mathur, P. (2014). Machine Learning Applications Using Python: Cases Studies from Healthcare, Retail and Finance, APress.
4. Martín-Guerrero, J.D., Lisboa, P.J.G., and Vellido, A. (2016, January 27–29). Physics and machine learning: Emerging paradigms. Proceedings of the ESANN 2016 European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium.
5. Schütt, K.T., Chmiela, S., von Lilienfeld, O.A., Tkatchenko, A., Tsuda, K., and Müller, K.-R. (2020). Machine Learning meets Quantum Physics, Springer Nature. Lecture Notes in Physics.10.1007/978-3-030-40245-7 ↗
6. Nielsen, M., and Chuang, I.L.S. (2010). Quantum Computation and Quantum Information: 10th Anniversary Edition, Cambridge University Press.
7. Quantum machine learning
8. Single trajectory characterization via machine learning10.1088/1367-2630/ab6065 ↗
9. Restricted Boltzmann machines in quantum physics10.1038/s41567-019-0545-1 ↗
10. JUNIPR: A framework for unsupervised machine learning in particle physics10.1140/epjc/s10052-019-6607-9 ↗
11. Projection-based model reduction: Formulations for physics-based machine learning10.1016/j.compfluid.2018.07.021 ↗
12. Thermal field prediction for laser scanning paths in laser aided additive manufacturing by physics-based machine learning10.1016/j.cma.2019.112734 ↗
13. Adaptive quantum computation in changing environments using projective simulation10.1038/srep12874 ↗
14. Fast machine-learning online optimization of ultra-cold-atom experiments10.1038/srep25890 ↗
15. Palittapongarnpim, P., Wittek, P., and Sanders, B.C. (2016, January 27–29). Controlling Adaptive Quantum Phase Estimation with Scalable Reinforcement Learning. Proceedings of the 24th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN-16), Bruges, Belgium.
16. Breaking adiabatic quantum control with deep learning10.1103/PhysRevA.103.L040401 ↗
17. Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning: An Introduction, MIT Press.10.1109/TNN.1998.712192 ↗
18. Alpaydin, E. (2020). Introduction to Machine Learning, MIT Press. [4th ed.].
19. Bertsekas, D.P. (2001). Dynamic Programming and Optimal Control: Volume II, Athenas Scientific.10.1007/0-306-48332-7_333 ↗
20. Q-learning10.1007/BF00992698 ↗
21. Reinforcement learning for robot research: A comprehensive review and open issues10.1177/17298814211007305 ↗
22. Assigning discounts in a marketing campaign by using reinforcement learning and neural networks10.1016/j.eswa.2008.10.064 ↗
23. A Reinforcement Learning approach for Individualizing Erythropoietin Dosages in Hemodialysis Patients10.1016/j.eswa.2009.02.041 ↗
24. Solving the quantum many-body problem with artificial neural networks10.1126/science.aag2302 ↗
25. Reinforcement Learning with Neural Networks for Quantum Feedback
26. Reinforcement Learning in Different Phases of Quantum Control
27. Active learning machine learns to create new quantum experiments10.1073/pnas.1714936115 ↗
28. Retrieving Quantum Information with Active Learning10.1103/PhysRevLett.124.140504 ↗
29. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
30. Deep reinforcement learning for efficient measurement of quantum devices10.1038/s41534-021-00434-x ↗
31. When does reinforcement learning stand out in quantum control? A comparative study on state preparation10.1038/s41534-019-0201-8 ↗
32. Deep reinforcement learning for quantum gate control10.1209/0295-5075/126/60002 ↗
33. Evolutionary reinforcement learning of dynamical large deviations10.1063/5.0015301 ↗
34. A review on deep reinforcement learning for fluid mechanics10.1016/j.compfluid.2021.104973 ↗
35. Adaptive optics control using model-based reinforcement learning10.1364/OE.420270 ↗
36. Beeler, C., Yahorau, U., Coles, R., Mills, K., Whitelam, S., and Tamblyn, I. (2019). Optimizing thermodynamic trajectories using evolutionary and gradient-based reinforcement learning. arXiv.
37. A reinforcement learning approach to rare trajectory sampling10.1088/1367-2630/abd7bd ↗
38. Quantum machine learning and quantum biomimetics: A perspective10.1088/2632-2153/ab9803 ↗
39. Quantum Reinforcement Learning10.1109/TSMCB.2008.925743 ↗
40. Quantum speedup for active learning agents
41. Quantum-enhanced machine learning10.1103/PhysRevLett.117.130501 ↗
42. Basic protocols in quantum reinforcement learning with superconducting circuits10.1038/s41598-017-01711-6 ↗
43. Cárdenas-López, F.A., Lamata, L., Retamal, J.C., and Solano, E. (2018). Multiqubit and multilevel quantum reinforcement learning with quantum technologies. PLoS ONE, 13.10.1371/journal.pone.0200455 ↗
44. Measurement-based adaptation protocol with quantum reinforcement learning10.1103/PhysRevA.98.042315 ↗
45. Reconstruction of a Photonic Qubit State with Reinforcement Learning10.1002/qute.201800074 ↗
46. Olivares-Sánchez, J., Casanova, J., Solano, E., and Lamata, L. (2020). Measurement-based adaptation protocol with quantum reinforcement learning in a Rigetti quantum computer. Quantum Rep., 2.10.3390/quantum2020019 ↗
47. Reinforcement learning for semi-autonomous approximate quantum eigensolver10.1088/2632-2153/ab43b4 ↗
48. Lamata, L. (2021). Quantum Reinforcement Learning with Quantum Photonics. Photonics, 8.10.3390/photonics8020033 ↗
49. Spagnolo, M., Morris, J., Piacentini, S., Antesberger, M., Massa, F., Ceccarelli, F., Crespi, A., Osellame, R., and Walther, P. (2021). Experimental quantum memristor. arXiv.10.1038/s41566-022-00973-5 ↗