journal article·2023Open access

BN-GEPSO: Learning Bayesian Network Structure Using Generalized Particle Swarm Optimization

Muhammad Saad Salman, Ibrahim M. Almanjahie, AmanUllah Yasin, Ammara Nawaz Cheema

Computers, Materials & Continua· Volume 75· Issue 2

Abstract

At present Bayesian Networks (BN) are being used widely for demonstrating uncertain knowledge in many disciplines, including biology, computer science, risk analysis, service quality analysis, and business. But they suffer from the problem that when the nodes and edges increase, the structure learning difficulty increases and algorithms become inefficient. To solve this problem, heuristic optimization algorithms are used, which tend to find a near-optimal answer rather than an exact one, with particle swarm optimization (PSO) being one of them. PSO is a swarm intelligence-based algorithm having basic inspiration from flocks of birds (how they search for food). PSO is employed widely because it is easier to code, converges quickly, and can be parallelized easily. We use a recently proposed version of PSO called generalized particle swarm optimization (GEPSO) to learn bayesian network structure. We construct an initial directed acyclic graph (DAG) by using the max-min parent’s children (MMPC) algorithm and cross relative average entropy. This DAG is used to create a population for the GEPSO optimization procedure. Moreover, we propose a velocity update procedure to increase the efficiency of the algorithmic search process. Results of the experiments show that as the complexity of the dataset increases, our algorithm Bayesian network generalized particle swarm optimization (BN-GEPSO) outperforms the PSO algorithm in terms of the Bayesian information criterion (BIC) score.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Bayesian Modeling and Causal Inference · Machine Learning and Data Classification · AI-based Problem Solving and Planning

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (43)

Show source-provided references
1. Jensen · Bayesian Networks and Decision Graphs · 2001 · 23
2. A quantitative risk analysis model considering uncertain information10.1016/j.psep.2018.06.029 ↗
3. Causal protein-signaling networks derived from multiparameter single-cell data
4. A novel qos prediction approach for cloud services using bayesian network model
5. Behavioral intrusion prediction model on bayesian network over healthcare infrastructure10.32604/cmc.2022.023571 ↗
6. A method of emergent event evolution reasoning based on ontology cluster and bayesian network10.1109/ACCESS.2019.2894777 ↗
7. Mean opinion score estimation for mobile broadband networks using bayesian networks10.32604/cmc.2022.024642 ↗
8. K. Murphy, “An introduction to graphical models,” 2001. [Online]. Available: http://www2.denizyuret.com/ref/murphy/intro_gm.pdf
9. An improved particle swarm optimization algorithm for bayesian network structure learning via local information constraint10.1109/ACCESS.2021.3065532 ↗
10. Scoring bayesian networks of mixed variables
11. Saga: A hybrid search algorithm for bayesian network structure learning of transcriptional regulatory networks
12. An improved constraint-based bayesian network learning method using gaussian kernel probability density estimator10.1016/j.eswa.2018.06.058 ↗
13. Spirtes · Causation, prediction, and search · 2000 · 78
14. A recursive method for structural learning of directed acyclic graphs
15. A parallel algorithm for bayesian network structure learning from large data sets10.1016/j.knosys.2016.07.031 ↗
16. Hybrid optimization algorithm for bayesian network structure learning
17. A hybrid methodology for learning belief networks: Benedict10.1016/S0888-613X(01)00041-X ↗
18. Large-sample learning of bayesian networks is np-hard
19. Structure learning of bayesian networks by continuous particle swarm optimization algorithms10.1080/00949655.2018.1440395 ↗
20. A new pc-pso algorithm for bayesian network structure learning with structure priors10.1016/j.eswa.2021.115237 ↗
21. A novel discrete particle swarm optimization algorithm for solving bayesian network structures learning problem10.1080/00207160.2019.1566535 ↗
22. Bayesian network structure learning based on modified particle swarm optimisation10.1504/IJICT.2016.073641 ↗
23. Bnc-pso: Structure learning of bayesian networks by particle swarm optimization10.1016/j.ins.2016.01.090 ↗
24. Particle swarm optimization based method for bayesian network structure learning
25. Bayesian network hybrid learning using an elite-guided genetic algorithm10.1007/s10462-018-9615-5 ↗
26. Parallel simulated annealing with a greedy algorithm for bayesian network structure learning10.1109/TKDE.2019.2899096 ↗
27. Bnbeeepi: An approach of epistasis mining based on artificial bee colony algorithm optimizing bayesian network
28. Differential-evolution-based coevolution ant colony optimization algorithm for bayesian network structure learning10.3390/a11110188 ↗
29. Structure learning of bayesian network: A review
30. A novel discrete firefly algorithm for Bayesian network structure learning10.1016/j.knosys.2022.108426 ↗
31. Learning bayesian network structures with discrete particle swarm optimization algorithm
32. Research on learning bayesian networks by particle swarm optimization10.3923/itj.2006.540.545 ↗
33. A heuristic method for learning bayesian networks using discrete particle swarm optimization10.1007/s10115-009-0239-6 ↗
34. The max-min hillclimbing bayesian network structure learning algorithm10.1007/s10994-006-6889-7 ↗
35. Learning bayesian networks with discrete variables from data
36. E. Lantz, S. Ray and D. Page, “Learning bayesian network structure from correlation-immune data,” arXiv preprint arXiv: 1206. 5271, 2012.
37. Particle swarm optimization10.1109/ICNN.1995.488968 ↗
38. E. Brenner and D. Sontag, “Sparsityboost: A new scoring function for learning bayesian network structure,” arXiv preprint arXiv: 1309. 6820, 2013.
39. Bayesian network structure learning based on the chaotic particle swarm optimization algorithm
40. A hybrid particle swarm optimization method for structure learning of probabilistic relational models10.1016/j.ins.2014.04.058 ↗
41. Approximating discrete probability distributions with dependence trees10.1109/TIT.1968.1054142 ↗
42. Bayesian network structure learning based on small sample data
43. Gepso: A new generalized particle swarm optimization algorithm10.1016/j.matcom.2020.08.013 ↗