Heuristically Adaptive Diffusion‐Model Evolutionary Strategy
Source abstract
Abstract
ABSTRACT Diffusion Models (DMs) and Evolutionary Algorithms (EAs) share a core generative principle: iterative refinement of random initial distributions to produce high‐quality solutions. DMs degrade and restore data using Gaussian noise, enabling versatile generation, while EAs optimize numerical parameters through biologically inspired heuristics. Our research integrates these frameworks, employing deep learning‐based DMs to enhance EAs across diverse domains. By iteratively refining DMs with heuristically curated databases, we generate better‐adapted offspring parameters, achieving efficient convergence toward high‐fitness solutions while preserving explorative diversity. DMs augment EAs with deep memory, retaining historical data and exploiting subtle correlations for refined sampling. Classifier‐free guidance further enables precise control over evolutionary dynamics, targeting specific genotypical, phenotypical, or population traits. This hybrid approach transforms EAs into adaptive, memory‐enhanced frameworks, offering unprecedented flexibility, and precision in evolutionary optimization, with broad implications for generative modeling and heuristic search.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Metaheuristic Optimization Algorithms Research · Advanced Multi-Objective Optimization Algorithms · Evolutionary Algorithms and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Allen Discovery Center at Tufts University Medford Massachusetts USA
Institute for Theoretical Physics TU Wien Wien Austria
Wyss Institute for Biologically Inspired Engineering at Harvard University Boston Massachusetts USA
Funding
John Templeton Foundation
References (100+)
Show source-provided references
1. The Origin of Species, 1859‐1959
2. Dawkins R. · 2016
3. Kandel E. R. · 2013
4. 10.1016/j.tics.2006.05.00410.1016/j.tics.2006.05.004 ↗
5. Holland J. H. · 2000
6. Dayan P. · 2001
7. 10.1177/2633913723116835510.1177/26339137231168355 ↗
8. 10.1073/pnas.212003711910.1073/pnas.2120037119 ↗
9. 10.3389/fnsys.2022.76820110.3389/fnsys.2022.768201 ↗
10. 10.3389/fevo.2022.82358810.3389/fevo.2022.823588 ↗
11. 10.1371/journal.pcbi.100535810.1371/journal.pcbi.1005358 ↗
12. 10.1016/j.tree.2015.11.00910.1016/j.tree.2015.11.009 ↗
13. 10.1007/s11692-015-9358-z10.1007/s11692-015-9358-z ↗
14. 10.1186/s13062-015-0094-110.1186/s13062-015-0094-1 ↗
15. How Learning Can Guide Evolution
16. A New Factor in Evolution
17. P. A.Vikhar “Evolutionary Algorithms: A Critical Review and Its Future Prospects ” in2016 International Conference on Global Trends in Signal Processing Information Computing and Communication (ICGTSPICC)(IEEE 2016) 261–265.10.1109/ICGTSPICC.2016.7955308 ↗
18. Golberg D. E. · 1989
19. J. J.Grefenstette “Genetic Algorithms and Machine Learning ” inProceedings of the Sixth Annual Conference on Computational Learning Theory(1993):3–4.10.1145/168304.168305 ↗
20. 10.7551/mitpress/1090.001.000110.7551/mitpress/1090.001.0001 ↗
21. 10.1007/s11042‐020‐10139‐610.1007/s11042‐020‐10139‐6 ↗
22. 10.1162/10636560175019039810.1162/106365601750190398 ↗
23. 10.3390/e2609076510.3390/e26090765 ↗
24. 10.1038/s42003‐024‐06037‐410.1038/s42003‐024‐06037‐4 ↗
25. 10.1007/s00018-023-04790-z10.1007/s00018-023-04790-z ↗
26. 10.1016/j.tig.2025.04.00210.1016/j.tig.2025.04.002 ↗
27. 10.1016/j.tig.2025.01.00810.1016/j.tig.2025.01.008 ↗
28. 10.1039/C5IB00221D10.1039/C5IB00221D ↗
29. 10.1098/rsif.2016.055510.1098/rsif.2016.0555 ↗
30. 10.1016/j.biosystems.2023.10492710.1016/j.biosystems.2023.104927 ↗
31. 10.3390/e2607053210.3390/e26070532 ↗
32. 10.3390/e2501013110.3390/e25010131 ↗
33. J.HoandT.Salimans “Classifier‐free diffusion guidance ” inNeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications(2021) https://openreview.net/forum?id=qw8AKxfYbI.
34. Sutton R. S. · 1998
35. 10.1109/TSMC.1983.631307710.1109/TSMC.1983.6313077 ↗
36. Dhariwal P. · 2021 · 8780
37. Ho J. · 2020 · 6840
38. J.Song C.Meng andS.Ermon “Denoising diffusion implicit models ” inInternational Conference on Learning Representations(2021) https://openreview.net/forum?id=St1giarCHLP.
39. J.Sohl‐Dickstein E.Weiss N.Maheswaranathan andS.Ganguli “Deep unsupervised learning using nonequilibrium thermodynamics ” inInternational conference on machine learning(PMLR 2015):2256–2265.
40. R.Rombach A.Blattmann D.Lorenz P.Esser andB.Ommer “High‐resolution image synthesis with latent diffusion models ” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition(IEEE 2022):10 684–10 695.10.1109/CVPR52688.2022.01042 ↗
41. T.Brooks B.Peebles C.Holmes et al. “Video Generation Models as World Simulators ” (2024).
42. 10.1038/s41586‐021‐03819‐210.1038/s41586‐021‐03819‐2 ↗
43. X.YanandY.Jin “EmoDM: A Diffusion Model for Evolutionary Multi‐Objective Optimization ” (2024) https://arxiv.org/abs/2401.15931.
44. C. F.Higham D. J.Higham andP.Grindrod “Diffusion Models for Generative Artificial Intelligence: An Introduction for Applied Mathematicians ” (2023) https://arxiv.org/abs/2312.14977.
45. S.Krishnamoorthy S. M.Mashkaria andA.Grover “Diffusion Models for Black‐Box Optimization ” inProceedings of the 40th International Conference on Machine Learning ser. Proceedings of Machine Learning Research A.Krause E.Brunskill K.Cho B.Engelhardt S.Sabato andJ.Scarlett Eds. vol.202(PMLR 23–29Jul 2023):17 842–17 857 https://proceedings.mlr.press/v202/krishnamoorthy23a.html.
46. W.Peebles I.Radosavovic T.Brooks A. A.Efros andJ.Malik “Learning to Learn With Generative Models of Neural Network Checkpoints ” (2022) https://arxiv.org/abs/2209.12892.
47. E.Alonso A.Jelley V.Micheli et al. “Diffusion for World Modeling: Visual Details Matter in Atari ” inThe Thirty‐Eighth Annual Conference on Neural Information Processing Systems(2024) https://openreview.net/forum?id=NadTwTODgC.10.52202/079017-1873 ↗
48. Y.Zhang B.Hartl H.Hazan andM.Levin “Diffusion Models Are Evolutionary Algorithms ” inThe Thirteenth International Conference on Learning Representations ICLR 2025 Singapore April 24–28 2025(OpenReview.net 2025) https://openreview.net/forum?id=xVefsBbG2O.
49. 10.1103/PhysRev.83.3410.1103/PhysRev.83.34 ↗
50. 10.3390/e2605038110.3390/e26050381 ↗
51. Wolfram S. · 2002
52. 10.1086/59882210.1086/598822 ↗
53. 10.1098/rsfs.2016.013510.1098/rsfs.2016.0135 ↗
54. A. Y.Ng D.Harada andS. J.Russell “Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping ” inProceedings of the Sixteenth International Conference on Machine Learning ser. ICML '99(Morgan Kaufmann Publishers Inc. 1999) 278–287.
55. 10.1038/nrg226710.1038/nrg2267 ↗
56. Schlosser G. · 2004
57. 10.1016/S0303-2647(02)00140-510.1016/S0303-2647(02)00140-5 ↗
58. 10.1371/journal.pcbi.100220810.1371/journal.pcbi.1002208 ↗
59. 10.1111/j.1558-5646.1996.tb02339.x10.1111/j.1558-5646.1996.tb02339.x ↗
60. I.Sutskever J.Martens G.Dahl andG.Hinton “On the Importance of Initialization and Momentum in Deep Learning ” inProceedings of the 30th International Conference on Machine Learning ser. Proceedings of Machine Learning Research S.DasguptaandD.McAllester Eds. vol.28(PMLR 17–19Jun 2013) 1139–1147 https://proceedings.mlr.press/v28/sutskever13.html.
61. Y.Bengio J.Louradour R.Collobert andJ.Weston “Curriculum Learning ” inProceedings of the 26th Annual International Conference on Machine Learning ser. ICML '09(Association for Computing Machinery 2009):41–48 https://doi.org/10.1145/1553374.1553380.10.1145/1553374.1553380 ↗
62. 10.1111/j.1420‐9101.2009.01775.x10.1111/j.1420‐9101.2009.01775.x ↗
63. 10.1111/evo.1233710.1111/evo.12337 ↗
64. 10.1890/0012-9658(2006)87[1445:SOEFDD]2.0.CO;210.1890/0012-9658(2006)87[1445:SOEFDD]2.0.CO;2 ↗
65. J.Schmidhuber “Reinforcement Learning Upside Down: Don't Predict Rewards – Just Map Them to Actions ” (2020) https://arxiv.org/abs/1912.02875.
66. R. K.Srivastava P.Shyam F.Mutz W.Jaśkowski andJ.Schmidhuber “Training Agents Using Upside‐Down Reinforcement Learning ” (2021) https://arxiv.org/abs/1912.02877.
67. 10.1089/bioe.2022.003310.1089/bioe.2022.0033 ↗
68. 10.3390/e2606048110.3390/e26060481 ↗
69. 10.1162/EVCO_a_0002510.1162/EVCO_a_00025 ↗
70. 10.3389/frobt.2016.0004010.3389/frobt.2016.00040 ↗
71. 10.1103/PhysRevE.93.01331010.1103/PhysRevE.93.013310 ↗
72. Risi S. · 2025
73. 10.1016/0893-6080(89)90020-810.1016/0893-6080(89)90020-8 ↗
74. J.Schulman F.Wolski P.Dhariwal A.Radford andO.Klimov “Proximal policy optimization algorithms ” (2017) https://arxiv.org/abs/1707.06347.
75. 10.1016/j.artint.2021.10353510.1016/j.artint.2021.103535 ↗
76. 10.1111/1758-5899.1200210.1111/1758-5899.12002 ↗
77. 10.1038/s42005‐025‐02101‐510.1038/s42005‐025‐02101‐5 ↗
78. 10.1073/pnas.201968311810.1073/pnas.2019683118 ↗
79. Tang Y. · 2021
80. Y.Tang D.Nguyen andD.Ha “Neuroevolution of self‐interpretable agents ” inProceedings of the 2020 Genetic and Evolutionary Computation Conference ser. GECCO '20(Association for Computing Machinery 2020) 414–424 https://doi.org/10.1145/3377930.3389847.10.1145/3377930.3389847 ↗
81. 10.1162/10636560232016981110.1162/106365602320169811 ↗
82. Rumelhart D. E. · 1986 · 318
83. G.Brockman V.Cheung L.Pettersson J.Schneider J.Schulman J.Tang andW.Zaremba “OpenAI Gym ” (2016) https://arxiv.org/abs/1606.01540.
84. 10.1016/j.copbio.2018.03.00810.1016/j.copbio.2018.03.008 ↗
85. 10.1007/978-3-319-15524-110.1007/978-3-319-15524-1 ↗
86. 10.1109/TEVC.2021.311711610.1109/TEVC.2021.3117116 ↗
87. 10.1162/evco_a_0018210.1162/evco_a_00182 ↗
88. J.‐B.MouretandJ.Clune “Illuminating Search Spaces by Mapping Elites ”ArXivabs/1504.04909(2015) https://arxiv.org/abs/1504.04909.
89. 10.3389/fnsys.2022.76820110.3389/fnsys.2022.768201 ↗
90. 10.3389/fpsyg.2015.0166010.3389/fpsyg.2015.01660 ↗
91. 10.1016/j.neubiorev.2021.09.03410.1016/j.neubiorev.2021.09.034 ↗
92. 10.23915/distill.0002310.23915/distill.00023 ↗
93. 10.1080/1365881021013700410.1080/13658810210137004 ↗
94. 10.1016/j.plrev.2018.12.00210.1016/j.plrev.2018.12.002 ↗
95. 10.1073/pnas.79.8.255410.1073/pnas.79.8.2554 ↗
96. 10.3390/e2507096410.3390/e25070964 ↗
97. 10.1113/jphysiol.2014.27238510.1113/jphysiol.2014.272385 ↗
98. U.Alon An Introduction to Systems Biology: Design Principles of Biological Circuits 0th ed(Chapman and Hall/CRC) https://www.taylorfrancis.com/books/9781420011432.
99. 10.1038/nrg210210.1038/nrg2102 ↗
100. 10.1126/science.111383210.1126/science.1113832 ↗