journal article·2024-09-04Open access

An Adaptive Surrogate-Assisted Particle Swarm Optimization Algorithm Combining Effectively Global and Local Surrogate Models and Its Application

Shaochun Qu, Fuguang Liu, Zijian Cao

Applied Sciences· Volume 14· Issue 17

Abstract

Numerous surrogate-assisted evolutionary algorithms have been proposed for expensive optimization problems. However, each surrogate model has its own characteristics and different applicable situations, which caused a serious challenge for model selection. To alleviate this challenge, this paper proposes an adaptive surrogate-assisted particle swarm optimization (ASAPSO) algorithm by effectively combining global and local surrogate models, which utilizes the uncertainty level of the current population state to evaluate the approximation ability of the surrogate model in its predictions. In ASAPSO, the transformation between local and global surrogate models is controlled by an adaptive Gaussian distribution parameter with a gauge of the advisability to improve the search process with better local exploration and diversity in uncertain solutions. Four expensive optimization benchmark functions and an airfoil aerodynamic real-world engineering optimization problem are utilized to validate the effectiveness and performance of ASAPSO. Experimental results demonstrate that ASAPSO has superiority in terms of solution accuracy compared with state-of-the-art algorithms.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Multi-Objective Optimization Algorithms · Metaheuristic Optimization Algorithms Research · Evolutionary Algorithms and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Engineering, Xi’an Technological University, Xi’an 710021, China

Funding

National Foreign Expert Program of the Ministry of Science and Technology · Shaanxi Natural Science Basic Research Project

References (39)

Show source-provided references
1. Bangyal, W.H., Shakir, R., Rehman, N.U., Ashraf, A., and Ahmad, J. (2023, January 14–18). An Improved Seagull Algorithm for Numerical Optimization Problem. Proceedings of the International Conference on Swarm Intelligence, Shenzhen, China.10.1007/978-3-031-36622-2_24 ↗
2. A comprehensive survey of fitness approximation in evolutionary computation10.1007/s00500-003-0328-5 ↗
3. Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions10.1007/s00158-009-0420-2 ↗
4. Shilane, D., Liang, R.H., and Dudoit, S. (2010). Computational Intelligence in Expensive Optimization Problems, Springer Science & Business Media.
5. A surrogate-assisted reference vector guided evolutionary algorithm for computationally expensive many-objective optimization10.1109/TEVC.2016.2622301 ↗
6. Variable surrogate model-based particle swarm optimization for high-dimensional expensive problems10.1007/s40747-022-00910-7 ↗
7. Bangyal, W.H., Nisar, K., Soomro, T.R., Ag Ibrahim, A.A., Mallah, G.A., Hassan, N.U., and Rehman, N.U. (2022). An improved particle swarm optimization algorithm for data classification. Appl. Sci., 13.10.3390/app13010283 ↗
8. Bangyal, W.H., Malik, Z.A., Saleem, I., and Rehman, N.U. (2021, January 9–10). An analysis of initialization techniques of particle swarm optimization algorithm for global optimization. Proceedings of the 2021 International Conference on Innovative Computing (ICIC), Lahore, Pakistan.10.1109/ICIC53490.2021.9692931 ↗
9. A framework for evolutionary optimization with approximate fifitness functions10.1109/TEVC.2002.800884 ↗
10. Data-driven surrogate-assisted multiobjective evolutionary optimization of a trauma system10.1109/TEVC.2016.2555315 ↗
11. Jin, Y., and Sendhoff, B. (2004, January 26–30). Reducing fifitness evaluations using clustering techniques and neural network ensembles. Proceedings of the Genetic and Evolutionary Computation Conference, Seattle, WA, USA.10.1007/978-3-540-24854-5_71 ↗
12. Lim, D., Ong, Y.-S., Jin, Y., and Sendhoff, B. (2007, January 7–11). A study on metamodeling techniques, ensembles, and multi-surrogates in evolutionary computation. Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, London, UK.10.1145/1276958.1277203 ↗
13. Zhou, Z., Ong, Y.S., Nguyen, M.H., and Lim, D. (2005, January 2–5). A study on polynomial regression and Gaussian process global surrogate model in hierarchical surrogate-assisted evolutionary algorithm. Proceedings of the 2005 IEEE Congress on Evolutionary Computation, Edinburgh, UK.
14. Evolutionary programming for high-dimensional constrained expensive black-box optimization using radial basis functions10.1109/TEVC.2013.2262111 ↗
15. A two-layer surrogate-assisted particle swarm optimization algorithm10.1007/s00500-014-1283-z ↗
16. A fast surrogate-assisted particle swarm optimization algorithm for computationally expensive problems10.1016/j.asoc.2020.106303 ↗
17. Guo, D., Chai, T., Ding, J., and Jin, Y. (2016, January 6–9). Small data driven evolutionary multi-objective optimization of fused magnesium furnaces. Proceedings of the 2016 IEEE Symposium Series on Computational Intelligence (SSCI), Athens, Greece.
18. A Gaussian process surrogate model assisted evolutionary algorithm for medium scale expensive optimization problems10.1109/TEVC.2013.2248012 ↗
19. Generalizing surrogate-assisted evolutionary computation10.1109/TEVC.2009.2027359 ↗
20. A new fitness estimation strategy for particle swarm optimization10.1016/j.ins.2012.09.030 ↗
21. Combining global and local surrogate models to accelerate evolutionary optimization10.1109/TSMCC.2005.855506 ↗
22. A nonlinear mapping for data structure analysis10.1109/T-C.1969.222678 ↗
23. Committee-based active learning for surrogate-assisted particle swarm optimization of expensive problems10.1109/TCYB.2017.2710978 ↗
24. Sun, C., Jin, Y., and Tan, Y. (2018, January 15–19). Semi-supervised learning assisted particle swarm optimization of computationally expensive problems. Proceedings of the Genetic and Evolutionary Computation Conference, Kyoto, Japan.10.1145/3205455.3205596 ↗
25. Surrogate-assisted hierarchical particle swarm optimization10.1016/j.ins.2018.04.062 ↗
26. Surrogate-assisted particle swarm optimization algorithm with Pareto active learning for expensive multi-objective optimization10.1109/JAS.2019.1911450 ↗
27. An efficient surrogate-assisted hybrid optimization algorithm for expensive optimization problems10.1016/j.ins.2020.11.056 ↗
28. Accelerating evolutionary algorithms with Gaussian process fitness function models10.1109/TSMCC.2004.841917 ↗
29. Zapotecas Martínez, S., and Coello Coello, C.A. (2013, January 6–10). MOEA/D assisted by RBF networks for expensive multi-objective optimization problems. Proceedings of the 15th Annual Conference on Genetic and Evolutionary Computation, Amsterdam, The Netherlands.10.1145/2463372.2465805 ↗
30. Faster convergence by means of fitness estimation10.1007/s00500-003-0329-4 ↗
31. Surrogate-assisted cooperative swarm optimization of high-dimensional expensive problems10.1109/TEVC.2017.2675628 ↗
32. Ensemble of surrogates10.1007/s00158-006-0051-9 ↗
33. A data-driven surrogate-assisted evolutionary algorithm applied to a many-objective blast furnace optimization problem10.1080/10426914.2016.1269923 ↗
34. Particle swarm optimization for single objective continuous space problems: A review10.1162/EVCO_r_00180 ↗
35. Eberhart, R., and Kennedy, J. (1995, January 4–6). A new optimizer using particle swarm theory. Proceedings of the MHS’95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science, Nagoya, Japan.
36. The particle swarm-explosion, stability, and convergence in a multidimensional complex space10.1109/4235.985692 ↗
37. Airfoil shape optimization using Bézier curve and genetic algorithm10.3846/aviation.2022.16471 ↗
38. Feed-forward artificial neural network as surrogate model to predict lift and drag coefficient of NACA airfoil and searching of maximum lift-to-drag ratio10.15632/jtam-pl/189805 ↗
39. Aerodynamic shape optimization using a physics-informed hot-start method combined with modified metric-based proper orthogonal decomposition10.1063/5.0224111 ↗