journal article·2024-06-10Open access

Choice Function-Based Hyper-Heuristics for Causal Discovery under Linear Structural Equation Models

Yinglong Dang, Xiaoguang Gao, Zidong Wang

Biomimetics· Volume 9· Issue 6

Abstract

Causal discovery is central to human cognition, and learning directed acyclic graphs (DAGs) is its foundation. Recently, many nature-inspired meta-heuristic optimization algorithms have been proposed to serve as the basis for DAG learning. However, a single meta-heuristic algorithm requires specific domain knowledge and empirical parameter tuning and cannot guarantee good performance in all cases. Hyper-heuristics provide an alternative methodology to meta-heuristics, enabling multiple heuristic algorithms to be combined and optimized to achieve better generalization ability. In this paper, we propose a multi-population choice function hyper-heuristic to discover the causal relationships encoded in a DAG. This algorithm provides a reasonable solution for combining structural priors or possible expert knowledge with swarm intelligence. Under a linear structural equation model (SEM), we first identify the partial v-structures through partial correlation analysis as the structural priors of the next nature-inspired swarm intelligence approach. Then, through partial correlation analysis, we can limit the search space. Experimental results demonstrate the effectiveness of the proposed methods compared to the earlier state-of-the-art methods on six standard networks.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Bayesian Modeling and Causal Inference · Multi-Criteria Decision Making · Data Mining Algorithms and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electronic and Information, Northwestern Polytechnical University, Xi’an 710129, China

Funding

National Natural Science Foundation of China · Fundamental Research Funds for the Central Universities, China · key core technology research plan of Xi’an, China

References (55)

Show source-provided references
1. Mendelian randomization for cardiovascular diseases: Principles and applications10.1093/eurheartj/ehad736 ↗
2. Causal inference in drug discovery and development10.1016/j.drudis.2023.103737 ↗
3. Improving generalization of machine learning-identified biomarkers using causal modelling with examples from immune receptor diagnostics10.1038/s42256-023-00781-8 ↗
4. Causal discovery for the microbiome10.1016/S2666-5247(22)00186-0 ↗
5. Causal inference for time series10.1038/s43017-023-00431-y ↗
6. A linear non-Gaussian acyclic model for causal discovery
7. Hoyer, P.O., Janzing, D., Mooij, J.M., Peters, J., and Schölkopf, B. (2008, January 8–11). Nonlinear causal discovery with additive noise models. Proceedings of the Advances in Neural Information Processing Systems 21—Proceedings of the 2008 Conference, Vancouver, BC, Canada.
8. On Estimation of Functional Causal Models: General Results and Application to the Post-Nonlinear Causal Model10.1145/2700476 ↗
9. Information-geometric approach to inferring causal directions10.1016/j.artint.2012.01.002 ↗
10. Spirtes, P., Glymour, C., and Scheines, R. (2001). Causation, Prediction, and Search, MIT Press. [2nd ed.].10.7551/mitpress/1754.001.0001 ↗
11. A Bayesian method for the induction of probabilistic networks from data10.1007/BF00994110 ↗
12. Learning Optimal Bayesian Networks: A Shortest Path Perspective10.1613/jair.4039 ↗
13. Optimal structure identification with greedy search
14. Structure learning of Bayesian networks using dual genetic algorithm10.1093/ietisy/e91-d.1.32 ↗
15. Machine learning for direct marketing response models: Bayesian networks with evolutionary programming10.1287/mnsc.1060.0514 ↗
16. Searching for the best elimination sequence in Bayesian networks by using ant colony optimization10.1016/S0167-8655(01)00123-4 ↗
17. Askari, M.B.A., Ahsaee, M.G., and IEEE (March, January 28). Bayesian network structure learning based on cuckoo search algorithm. Proceedings of the 6th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS), Shahid Bahonar Univ Kerman, Kerman, Iran.
18. Novel binary encoding water cycle algorithm for solving Bayesian network structures learning problem10.1016/j.knosys.2018.03.007 ↗
19. A new PC-PSO algorithm for Bayesian network structure learning with structure priors10.1016/j.eswa.2021.115237 ↗
20. BNC-PSO: Structure learning of Bayesian networks by Particle Swarm Optimization10.1016/j.ins.2016.01.090 ↗
21. An artificial bee colony algorithm for learning Bayesian networks10.1007/s00500-012-0966-6 ↗
22. Structural learning of Bayesian networks by bacterial foraging optimization10.1016/j.ijar.2015.11.003 ↗
23. A novel discrete firefly algorithm for Bayesian network structure learning10.1016/j.knosys.2022.108426 ↗
24. A hyper-heuristic based artificial bee colony algorithm for k-Interconnected multi-depot multi-traveling salesman problem10.1016/j.ins.2018.06.027 ↗
25. Hyper-heuristic algorithm for traffic flow-based vehicle routing problem with simultaneous delivery and pickup
26. A Case Study of Controlling Crossover in a Selection Hyper-heuristic Framework Using the Multidimensional Knapsack Problem10.1162/EVCO_a_00145 ↗
27. An experimental study of hyper-heuristic selection and acceptance mechanism for combinatorial t-way test suite generation10.1016/j.ins.2017.03.007 ↗
28. The max-min hill-climbing Bayesian network structure learning algorithm10.1007/s10994-006-6889-7 ↗
29. A partial correlation-based Bayesian network structure learning algorithm under linear SEM10.1016/j.knosys.2011.04.005 ↗
30. A survey of Bayesian Network structure learning10.1007/s10462-022-10351-w ↗
31. Order-Independent Constraint-Based Causal Structure Learning
32. A Hybrid Causal Search Algorithm for Latent Variable Models
33. Tsamardinos, I., Aliferis, C.F., and Statnikov, A. (2003, January 24–27). Time and sample efficient discovery of Markov blankets and direct causal relations. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.10.1145/956750.956838 ↗
34. Exact Bayesian structure discovery in Bayesian networks
35. Efficient Structure Learning of Bayesian Networks using Constraints
36. Bayesian Network Structure Learning with Integer Programming: Polytopes, Facets and Complexity10.1613/jair.5203 ↗
37. Koller, D., and Friedman, N. (2009). Probabilistic Graphical Models: Principles and Techniques, MIT Press.
38. DirectLiNGAM: A Direct Method for Learning a Linear Non-Gaussian Structural Equation Model
39. Zheng, X., Aragam, B., Ravikumar, P., and Xing, E.P. (2018, January 2–8). DAGs with NO TEARS: Continuous Optimization for Structure Learning. Proceedings of the 32nd Conference on Neural Information Processing Systems (NIPS), Montreal, QC, Canada.
40. Yu, Y., Chen, J., Gao, T., and Yu, M. (2019, January 9–15). DAG-GNN: DAG Structure Learning with Graph Neural Networks. Proceedings of the 36th International Conference on Machine Learning (ICML), Long Beach, CA, USA.
41. Wang, X., Du, Y., Zhu, S., Ke, L., Chen, Z., Hao, J., and Wang, J. (2021, January 19–27). Ordering-Based Causal Discovery with Reinforcement Learning. Proceedings of the IJCAI International Joint Conference on Artificial Intelligence, Montreal, QC, Canada.10.24963/ijcai.2021/491 ↗
42. Zhang, M.H., Jiang, S.L., Cui, Z.C., Garnett, R., and Chen, Y.X. (2019, January 8–14). D-VAE: A Variational Autoencoder for Directed Acyclic Graphs. Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS), Vancouver, BC, Canada.
43. Zheng, X., Dan, C., Aragam, B., Ravikumar, P., and Xing, E.P. (2020, January 26–28). Learning Sparse Nonparametric DAGs. Proceedings of the 23rd International Conference on Artificial Intelligence and Statistics (AISTATS), Electr Network, Online.
44. Lee, H.C., Danieletto, M., Miotto, R., Cherng, S.T., and Dudley, J.T. (2020, January 3–7). Scaling structural learning with NO-BEARS to infer causal transcriptome networks. Proceedings of the Pacific Symposium on Biocomputing, Fairmont Orchid, HI, USA.
45. Wei, D., Gao, T., and Yu, Y. (2020, January 6–12). DAGs with no fears: A closer look at continuous optimization for learning Bayesian networks. Proceedings of the Advances in Neural Information Processing Systems, Virtual.
46. Unsuitability of NOTEARS for Causal Graph Discovery when Dealing with Dimensional Quantities10.1007/s11063-021-10694-5 ↗
47. Ramsey, J., Spirtes, P., and Zhang, J. (2006, January 13–16). Adjacency-faithfulness and conservative causal inference. Proceedings of the 22nd Conference on Uncertainty in Artificial Intelligence, UAI 2006, Cambridge, MA, USA.
48. Detection of unfaithfulness and robust causal inference10.1007/s11023-008-9096-4 ↗
49. Bayesian network learning algorithms using structural restrictions10.1016/j.ijar.2006.06.009 ↗
50. Correia, A.H.C., de Campos, C.P., and van der Gaag, L.C. (2019, January 3–6). An Experimental Study of Prior Dependence in Bayesian Network Structure Learning. Proceedings of the 11th International Symposium on Imprecise Probabilities—Theories and Applications (ISIPTA), Ghent, Belgium.
51. Borboudakis, G., and Tsamardinos, I. (2013, January 12–14). Scoring and searching over Bayesian networks with causal and associative priors. Proceedings of the Uncertainty in Artificial Intelligence—Proceedings of the 29th Conference, UAI 2013, Bellevue, WA, USA.
52. Learning Bayesian Networks from Markov Random Fields: An Efficient Algorithm for Linear Models10.1145/2362383.2362384 ↗
53. The roles, challenges, and merits of the p value
54. Wang, Z., and Chan, L. (2010, January 25–28). An efficient causal discovery algorithm for linear models. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.10.1145/1835804.1835944 ↗
55. Learning Bayesian networks from data: An information-theory based approach10.1016/S0004-3702(02)00191-1 ↗