Explaining a molecular diffusion model
Source abstract
Abstract
Diffusion models have gained considerable importance in many scientific fields. These models perturb the original data distributions by adding noise during the diffusion phase, which is then removed again during the subsequent denoising phase when generating the output. Predictions of diffusion are difficult to rationalize. Current efforts to explain the generative process and outputs of diffusion models are essentially limited to training data attribution for image generation. Herein, we report a feature attribution approach to better understand how diffusion models used in molecular design arrive at their results. As a proof of concept, we analyze an equivariant diffusion model for generating linkers in fragment-based compound design. The analysis yields plausible explanations for linker predictions and uncovers unexpected atomic contributions to generative design. Notably, the equivariant diffusion model does not require learning the underlying chemistry to produce chemically sound compound structures.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: stochastic dynamics and bifurcation · Advanced Physical and Chemical Molecular Interactions · Nonlinear Dynamics and Pattern Formation
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (36)
Show source-provided references
1. Diffusion models: A comprehensive survey of methods and applications10.1145/3554729 ↗
2. Generative adversarial nets
3. Auto-encoding variational Bayes
4. Denoising diffusion probabilistic models
5. High-resolution image synthesis with latent diffusion models
6. Generative modeling by estimating gradients of the data distribution
7. Representations of knowledge in complex systems10.1111/j.2517-6161.1994.tb02000.x ↗
8. Score-based generative modeling through stochastic differential equations
9. Torsional diffusion for molecular conformer generation10.52202/068431-1760 ↗
10. GeoDIFF: A geometric diffusion model for molecular conformation generation
11. Equivariant diffusion for molecule generation in 3D
12. Equivariant 3D-conditional diffusion model for molecular linker design10.1038/s42256-024-00815-9 ↗
13. Structure-based drug design with equivariant diffusion models10.1038/s43588-024-00737-x ↗
14. Antigen-specific antibody design and optimization with diffusion-based generative models for protein structures10.52202/068431-0709 ↗
15. De novo design of protein structure and function with RFdiffusion10.1038/s41586-023-06415-8 ↗
16. XAI—Explainable artificial intelligence10.1126/scirobotics.aay7120 ↗
17. Explainable Generative AI (GenXAI): A survey, conceptualization, and research agenda10.1007/s10462-024-10916-x ↗
18. A Bayesian approach to analysing training data attribution in deep learning10.52202/075280-2803 ↗
19. The journey, not the destination: How data guides diffusion models
20. Zheng · 2023
21. Survey of contrastive and counterfactual explanation generation methods for explainable artificial intelligence10.1109/ACCESS.2021.3051315 ↗
22. Lu, M., Lin, C., Kim, C., Lee, S. I. An efficient framework for crediting data contributors of diffusion models. The Thirteenth International Conference on Learning Representations, 13612, 2025. https://iclr.cc/Conferences/2025.
23. A value for n-person games
24. Algorithms to estimate Shapley value feature attributions10.1038/s42256-023-00657-x ↗
25. Zhang, Q., Yu, C., Yan, Y., Kuang, X., Ma, Y., Cao, Y., Yiu, S. M., Wu, T. xDDPM: explainable denoising diffusion probabilistic model for scientific modeling. ICLR 2024 Workshop on AI4DifferentialEquations In Science, 38, 2024. https://ai4diffeqtnsinsci.github.io/.
26. Explaining generative diffusion models via visual analysis for interpretable decision-making process10.1016/j.eswa.2024.123231 ↗
27. E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials10.1038/s41467-022-29939-5 ↗
28. Deep generative models for 3D linker design10.1021/acs.jcim.9b01120 ↗
29. Automatic chemical design using a data-driven continuous representation of molecules10.1021/acscentsci.7b00572 ↗
30. ZINC− a free database of commercially available compounds for virtual screening10.1021/ci049714+ ↗
31. Explaining prediction models and individual predictions with feature contributions10.1007/s10115-013-0679-x ↗
32. EdgeSHAPer: bond-centric Shapley value-based explanation method for graph neural networks10.1016/j.isci.2022.105043 ↗
33. Explaining Identity-Aware Graph Classifiers Through the Language of Motifs
34. Gnnshap: Scalable and accurate GNN explanation using Shapley values
35. Balanced Chamfer distance as a comprehensive metric for point cloud completion
36. Individual comparisons by ranking methods10.2307/3001968 ↗