Initialisation Approaches for Population-Based Metaheuristic Algorithms: A Comprehensive Review
Source abstract
Abstract
A situation where the set of initial solutions lies near the position of the true optimality (most favourable or desirable solution) by chance can increase the probability of finding the true optimality and significantly reduce the search efforts. In optimisation problems, the location of the global optimum solution is unknown a priori, and initialisation is a stochastic process. In addition, the population size is equally important; if there are problems with high dimensions, a small population size may lie sparsely in unpromising regions, and may return suboptimal solutions with bias. In addition, the different distributions used as position vectors for the initial population may have different sampling emphasis; hence, different degrees of diversity. The initialisation control parameters of population-based metaheuristic algorithms play a significant role in improving the performance of the algorithms. Researchers have identified this significance, and they have put much effort into finding various distribution schemes that will enhance the diversity of the initial populations of the algorithms, and obtain the correct balance of the population size and number of iterations which will guarantee optimal solutions for a given problem set. Despite the affirmation of the role initialisation plays, to our knowledge few studies or surveys have been conducted on this subject area. Therefore, this paper presents a comprehensive survey of different initialisation schemes to improve the quality of solutions obtained by most metaheuristic optimisers for a given problem set. Popular schemes used to improve the diversity of the population can be categorised into random numbers, quasirandom sequences, chaos theory, probability distributions, hybrids of other heuristic or metaheuristic algorithms, Lévy, and others. We discuss the different levels of success of these schemes and identify their limitations. Similarly, we identify gaps and present useful insights for future research directions. Finally, we present a comparison of the effect of population size, the maximum number of iterations, and ten (10) different initialisation methods on the performance of three (3) population-based metaheuristic optimizers: bat algorithm (BA), Grey Wolf Optimizer (GWO), and butterfly optimization algorithm (BOA).
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Metaheuristic Optimization Algorithms Research · Advanced Multi-Objective Optimization Algorithms · Evolutionary Algorithms and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mathematics, Statistics and Computer Science, University of KwaZulu-Natal, King Edward Road, Pietermaritzburg 3201, KwaZulu-Natal, South Africa
References (100+)
Show source-provided references
1. Meyers, R.A. (2017). Social Algorithms. Encyclopedia of Complexity and Systems Science, Springer.
2. Metaheuristics: A comprehensive overview and classification along with bibliometric analysis10.1007/s10462-020-09952-0 ↗
3. A conceptual comparison of several metaheuristic algorithms on continuous optimization problems10.1007/s00521-019-04132-w ↗
4. A survey on new generation metaheuristic algorithms10.1016/j.cie.2019.106040 ↗
5. Kondamadugula, S., and Naidu, S.R. (2016, January 16–19). Accelerated evolutionary algorithms with parameter importance based population initialization for variation-aware analog yield optimization. Proceedings of the 2016 IEEE 59th International Midwest Symposium on Circuits and Systems (MWSCAS), Abu Dhabi, United Arab Emirates.10.1109/MWSCAS.2016.7869996 ↗
6. Sequence-based deterministic initialization for evolutionary algorithms10.1109/TCYB.2016.2630722 ↗
7. Nature inspired optimization algorithms or simply variations of metaheuristics10.1007/s10462-020-09893-8 ↗
8. Pant, M., Thangaraj, R., Grosan, C., and Abraham, A. (2008, January 1–6). Improved particle swarm optimization with low-discrepancy sequences. Proceedings of the 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence), Hong Kong, China.10.1109/CEC.2008.4631204 ↗
9. Gentle, J. (2006). Random Number Generation and Monte Carlo Methods, Springer Science & Business Media.
10. Agushaka, J.O., and Ezugwu, A.E. (2021). Advanced Arithmetic Optimization Algorithm for solving mechanical engineering design problems. PLoS ONE, 16.10.1371/journal.pone.0255703 ↗
11. An overview of particle swarm optimization variants10.1016/j.proeng.2013.02.063 ↗
12. Osaba, E., Carballedo, R., Diaz, F., Onieva, E., Lopez, P., and Perallos, A. (2014, January 2–4). On the influence of using initialization functions on genetic algorithms solving combinatorial optimization problems: A first study on the TSP. Proceedings of the 2014 IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS), Linz, Austria.10.1109/EAIS.2014.6867465 ↗
13. Influence of initialization on the performance of metaheuristic optimizers10.1016/j.asoc.2020.106193 ↗
14. Weidt Neiva, F., and de Souza da Silva, R.L. (2016). Systematic Literature Review in Computer Science—A Practical Guide, Federal University of Juiz de Fora. Technical Report of Computer Science Department DCC/UFJF RelaTeDCC 002/2016.
15. Deep learning architectures in emerging cloud computing architectures: Recent development, challenges and next research trend10.1016/j.asoc.2020.106582 ↗
16. On random numbers and the performance of genetic algorithms
17. Daida, J., Ross, S., McClain, J., Ampy, D., and Holczer, M. (1997). Challenges with verification, repeatability, and meaningful comparisons in genetic programming. Genetic Programming 1997: Proceedings of the Second Annual Conference, Morgan Kaufmann Publishers.
18. Randomized halton sequences10.1016/S0895-7177(00)00178-3 ↗
19. Niederreiter, H. (1992). Random Number Generation and Quasi-Monte Carlo Methods, Society for Industrial and Applied Mathematics.10.1137/1.9781611970081 ↗
20. Quasirandom sequences and their discrepancies10.1137/0915077 ↗
21. Uy, N.Q., Hoai, N., McKay, R., and Tuan, P. (2007, January 25–28). Initialising PSO with randomized low-discrepancy sequences: The comparative results. Proceedings of the 2007 IEEE Congress on Evolutionary Computation, Singapore.
22. Influence of Initializing Krill Herd Algorithm with Low-Discrepancy Sequences10.1109/ACCESS.2020.3039602 ↗
23. Brits, R., Engelbrecht, A., and van den Bergh, F. (2002, January 18–22). A niching particle swarm optimizer. Proceedings of the 4th Asia-Pacific Conference on Simulated Evolution and Learning, Singapore.
24. Wingsuit flying search—A novel global optimization algorithm10.1109/ACCESS.2020.2981196 ↗
25. An improved bat algorithm based on novel initialization technique for global optimization problem
26. Kimura, S., and Matsumura, K. (2005, January 25–29). Genetic algorithms using low-discrepancy sequences. Proceedings of the 7th Annual Conference on Genetic and Evolutionary Computation, Washington, DC, USA.10.1145/1068009.1068225 ↗
27. Application of deterministic low-discrepancy sequences in global optimization10.1007/s10589-005-4615-1 ↗
28. Thangaraj, R., Pant, M., Abraham, A., and Badr, Y. (2009, January 10–12). Hybrid evolutionary algorithm for solving global optimization problems. Proceedings of the International Conference on Hybrid Artificial Intelligence Systems, Salamanca, Spain.10.1007/978-3-642-02319-4_37 ↗
29. Comparison of Different Bat Initialization Techniques for Global Optimization Problems10.4018/IJAMC.2021010109 ↗
30. Nakib, A., Daachi, B., and Siarry, P. (2012, January 21–25). Hybrid differential evolution using low-discrepancy sequences for image segmentation. Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum, Shanghai, China.10.1109/IPDPSW.2012.79 ↗
31. Probabilistic shape design optimization of structural components under fatigue10.1016/j.compstruc.2016.12.008 ↗
32. Optimization of neural network parameters by Stochastic Fractal Search for dynamic state estimation under communication failure10.1016/j.epsr.2017.03.002 ↗
33. Hybrid cuckoo search optimization algorithms applied to complex wellbore trajectories aided by dynamic, chaos-enhanced, fat-tailed distribution sampling and metaheuristic profiling10.1016/j.jngse.2016.06.060 ↗
34. Meta heuristic algorithms for vehicle routing problem with stochastic demands10.3844/jcssp.2011.533.542 ↗
35. Investigating smart sampling as a population initialization method for differential evolution in continuous problems10.1016/j.ins.2011.12.037 ↗
36. Rauf, H.T., Bangyal, W.H., Ahmad, J., and Bangyal, S.A. (2018, January 18–20). Training of artificial neural network using pso with novel initialization technique. Proceedings of the 2018 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT), Zallaq, Bahrain.10.1109/3ICT.2018.8855743 ↗
37. Hybrid artificial intelligence approach based on neural fuzzy inference model and metaheuristic optimization for flood susceptibilitgy modeling in a high-frequency tropical cyclone area using GIS10.1016/j.jhydrol.2016.06.027 ↗
38. Optimization of an adaptive neuro-fuzzy inference system for groundwater potential mapping10.1007/s10040-019-02017-9 ↗
39. A hybrid metaheuristic for the cyclic antibandwidth problem10.1016/j.knosys.2013.08.026 ↗
40. Wang, G.G., Hao, G.S., Cheng, S., and Cui, Z. (2017, January 25–27). An improved monarch butterfly optimization with equal partition and f/t mutation. Proceedings of the International Conference on Swarm Intelligence, Hong Kong, China.10.1007/978-3-319-61824-1_12 ↗
41. Krill herd and piecewise-linear initialization algorithms for designing Takagi–Sugeno systems10.3103/S8756699017040100 ↗
42. Drscro: A metaheuristic algorithm for task scheduling on heterogeneous systems10.1155/2015/396582 ↗
43. Kang, T., Yao, J., Jin, M., Yang, S., and Duong, T. (2018). A novel improved cuckoo search algorithm for parameter estimation of photovoltaic (PV) models. Energies, 11.10.3390/en11051060 ↗
44. Improving genetic algorithm performance by population initialization with dispatching rules10.1016/j.cie.2019.106030 ↗
45. Pareto front particle swarm optimizer for discrete time-cost trade-off problem10.1061/(ASCE)CP.1943-5487.0000606 ↗
46. Wijayanto, A.W., and Purwarianti, A. (2014, January 8–10). Improvement design of fuzzy geo-demographic clustering using Artificial Bee Colony optimization. Proceedings of the 2014 International Conference on Cyber and IT Service Management (CITSM), Bali, Indonesia.10.1109/CITSM.2014.7042178 ↗
47. Metaheuristic algorithm for solving the multiobjective vehicle routing problem with time window and drones10.1177/1729881420920031 ↗
48. An enhanced differential evolution algorithm based on multiple mutation strategies10.1155/2015/285730 ↗
49. Yeoh, J.M., Caraffini, F., Homapour, E.S.V., and Milani, A. (2019). A clustering system for dynamic data streams based on metaheuristic optimization. Mathematics, 7.10.3390/math7121229 ↗
50. Carrizales-Turrubiates, O., Rangel-Valdez, N., and Torres-Jiménez, J. (December, January 26). Optimal shortening of covering arrays. Proceedings of the Mexican International Conference on Artificial Intelligence, Puebla, Mexico.
51. Robust medical image segmentation using particle swarm optimization aided level set based global fitting energy active contour approach10.1016/j.engappai.2014.07.001 ↗
52. Improved spatial fuzzy c-means clustering for image segmentation using PSO initialization, Mahalanobis distance and post-segmentation correction10.1016/j.dsp.2013.07.005 ↗
53. A GRASP-based memetic algorithm with path relinking for the far from most string problem10.1016/j.engappai.2015.01.020 ↗
54. PSO+: A new particle swarm optimization algorithm for constrained problems10.1016/j.asoc.2019.105865 ↗
55. A competitive swarm optimizer with hybrid encoding for simultaneously optimizing the weights and structure of Extreme Learning Machines for classification problems10.1007/s13042-020-01073-y ↗
56. Sawant, S.S., Prabukumar, M., and Samiappan, S. (2019, January 24–26). A band selection method for hyperspectral image classification based on cuckoo search algorithm with correlation based initialization. Proceedings of the 2019 10th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), Amsterdam, The Netherlands.10.1109/WHISPERS.2019.8920950 ↗
57. Lin, L., Ji, Z., He, S., and Zhu, Z. (2012, January 10–15). A crown jewel defense strategy based particle swarm optimization. Proceedings of the 2012 IEEE Congress on Evolutionary Computation, Brisbane, Australia.
58. A DE-LS Metaheuristic Algorithm for Hybrid Flow-Shop Scheduling Problem considering Multiple Requirements of Customers
59. Global-best brain storm optimization algorithm10.1016/j.swevo.2017.05.001 ↗
60. A Grayscale Segmentation Approach Using the Firefly Algorithm and the Gaussian Mixture Model10.4018/IJSIR.2018010103 ↗
61. A multi-layer line search method to improve the initialization of optimization algorithms10.1016/j.ejor.2015.06.044 ↗
62. Optimization of wavelet neural networks with the firefly algorithm for approximation problems10.1007/s00521-015-2140-4 ↗
63. A learning automata-based multiobjective hyper-heuristic10.1109/TEVC.2017.2785346 ↗
64. Mehrmolaei, S., Keyvanpour, M.R., and Savargiv, M. (2020). Metaheuristics on time series clustering problem: Theoretical and empirical evaluation. Evol. Intell.10.1007/s12065-020-00511-8 ↗
65. Mathematical modeling and multiobjective evolutionary algorithms applied to dynamic flexible job shop scheduling problems10.1016/j.ins.2014.11.036 ↗
66. An improved global-best harmony search algorithm for faster optimization10.1016/j.eswa.2014.03.016 ↗
67. Hybrid differential evolution and greedy algorithm (DEGR) for solving multi-skill resource-constrained project scheduling problem10.1016/j.asoc.2017.10.014 ↗
68. Local search metaheuristic for solving hybrid flow shop problem in slabs and beams manufacturing10.1016/j.eswa.2020.113716 ↗
69. Comparison of different one-dimensional maps as chaotic search pattern in chaos optimization algorithms
70. A novel adaptive cuckoo search algorithm for contrast enhancement of satellite images10.1109/JSTARS.2017.2699200 ↗
71. Afrabandpey, H., Ghaffari, M., Mirzaei, A., and Safayani, M. (2014, January 4–6). A novel bat algorithm based on chaos for optimization tasks. Proceedings of the 2014 Iranian Conference on Intelligent Systems (ICIS), Bam, Iran.10.1109/IranianCIS.2014.6802527 ↗
72. Chaos enhanced bacterial foraging optimization for global optimization10.1109/ACCESS.2018.2876996 ↗
73. Chaotic adaptive butterfly mating optimization and its applications in synthesis and structure optimization of antenna arrays10.1155/2019/1730868 ↗
74. Yuan, X., Miao, Z., Liu, Z., Yan, Z., and Zhou, F. (2020). Multi-Strategy Ensemble Whale Optimization Algorithm and Its Application to Analog Circuits Intelligent Fault Diagnosis. Appl. Sci., 10.10.3390/app10113667 ↗
75. Toward an optimal kernel extreme learning machine using a chaotic moth-flame optimization strategy with applications in medical diagnoses10.1016/j.neucom.2017.04.060 ↗
76. Firefly algorithm with chaos10.1016/j.cnsns.2012.06.009 ↗
77. Wu, B., and Fan, S.H. (2011, January 29–31). Improved artificial bee colony algorithm with chaos. Proceedings of the International Workshop on Computer Science for Environmental Engineering and EcoInformatics, Kunming, China.10.1007/978-3-642-22694-6_8 ↗
78. Biogeography-based optimization with chaos10.1007/s00521-014-1597-x ↗
79. Chaotic krill herd algorithm10.1016/j.ins.2014.02.123 ↗
80. An efficient chaotic water cycle algorithm for optimization tasks10.1007/s00521-015-2037-2 ↗
81. Chaotic grey wolf optimization algorithm for constrained optimization problems
82. A novel chaotic salp swarm algorithm for global optimization and feature selection10.1007/s10489-018-1158-6 ↗
83. Feature selection strategy based on hybrid crow search optimization algorithm integrated with chaos theory and fuzzy c-means algorithm for medical diagnosis problems10.1007/s00500-019-03988-3 ↗
84. Chaotic swarming of particles: A new method for size optimization of truss structures10.1016/j.advengsoft.2013.09.006 ↗
85. A chaotic quantum-behaved particle swarm optimization based on lateral inhibition for image matching10.1016/j.ijleo.2011.09.052 ↗
86. Faia, R., Pinto, T., Vale, Z., and Corchado, J.M. (2017). An ad-hoc initial solution heuristic for metaheuristic optimization of energy market participation portfolios. Energies, 10.10.3390/en10070883 ↗
87. A Novel Bat Algorithm Strategy for Maximum Power Point Tracker of Photovoltaic Energy Systems under Dynamic Partial Shading10.1109/ACCESS.2020.2964759 ↗
88. Control allocation for a class of morphing aircraft with integer constraints based on Lévy flight10.23919/JSEE.2020.000056 ↗
89. Energy-Based Acoustic Localization by Improved Elephant Herding Optimization10.1109/ACCESS.2020.2971787 ↗
90. Eltamaly, A.M., Al-Saud, M.S., and Abo-Khalil, A.G. (2020). Performance Improvement of PV Systems’ Maximum Power Point Tracker Based on a Scanning PSO Particle Strategy. Sustainability, 12.10.3390/su12031185 ↗
91. Imaging the search space: A nature-inspired metaheuristic extension10.1007/s12065-019-00325-3 ↗
92. Fast initialization methods for the nonconvex economic dispatch problem10.1016/j.energy.2020.117635 ↗
93. Hussein, W.A., Sahran, S., and Abdullah, S.N.H.S. (2013, January 28–29). A new initialization algorithm for bees algorithm. Proceedings of the International Multi-Conference on Artificial Intelligence Technology, Shah Alam, Malaysia.10.1007/978-3-642-40567-9_4 ↗
94. An efficient modified grey wolf optimizer with Lévy flight for optimization tasks10.1016/j.asoc.2017.06.044 ↗
95. A chaotic Levy flight bat algorithm for parameter estimation in nonlinear dynamic biological systems
96. Design optimization of real world steel space frames using artificial bee colony algorithm with Levy flight distribution10.1016/j.advengsoft.2015.10.013 ↗
97. A Levy flight-based grey wolf optimizer combined with back-propagation algorithm for neural network training10.1007/s00521-017-2952-5 ↗
98. A new hybrid chaotic atom search optimization based on tree-seed algorithm and Levy flight for solving optimization problems10.1007/s00366-020-00994-0 ↗
99. PSOSCALF: A new hybrid PSO based on Sine Cosine Algorithm and Levy flight for solving optimization problems10.1016/j.asoc.2018.09.019 ↗
100. An enhanced version of black hole algorithm via levy flight for optimization and data clustering problems10.1109/ACCESS.2019.2937021 ↗