Probability Selection-Based Surrogate-Assisted Evolutionary Algorithm for Expensive Optimization
Source abstract
Abstract
Surrogate-assisted evolutionary algorithms (SAEAs) have emerged as a powerful class of optimization methods that utilize surrogate models to address expensive optimization problems (EOPs), where fitness evaluations (FEs) are expensive or limited. By leveraging previously evaluated solutions to learn predictive models, SAEAs enable efficient search under constrained evaluation budgets. However, the performance of SAEAs heavily depends on the quality and utilization of surrogate models, and balancing the accuracy and generalization ability makes effective model construction and management a key challenge. Therefore, this paper introduces a novel probability selection-based surrogate-assisted evolutionary algorithm (PS-SAEA) to enhance optimization performance under FE-constrained conditions. The PS-SAEA has two novel designs. First, a probabilistic model selection (PMS) strategy is proposed to stochastically select surrogate models, striking a balance between prediction accuracy and generalization by avoiding overfitting commonly caused by greedy selection. Second, a weighted model ensemble (WME) mechanism is developed to integrate selected models, assigning weights based on individual prediction errors to improve the accuracy and reliability of fitness estimation. Extensive experiments on benchmark problems with varying dimensionalities demonstrate that PS-SAEA consistently outperforms several state-of-the-art SAEAs, validating its effectiveness and robustness in dealing with various complex EOPs.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Multi-Objective Optimization Algorithms · Metaheuristic Optimization Algorithms Research · Machine Learning and Data Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Center for Educational Technology and Resource Development, Ministry of Education, Beijing 100031, China
College of Artificial Intelligence, Nankai University, Tianjin 300350, China
Funding
National Natural Science Foundation of China · Tianjin Top Scientist Studio Project · Natural Science Foundation of Tianjin · Tianjin Belt and Road Joint Laboratory · Fundamental Research Funds for the Central Universities, Nankai University
References (38)
Show source-provided references
1. Multigranularity Surrogate Modeling for Evolutionary Multiobjective Optimization with Expensive Constraints10.1109/TNNLS.2023.3297624 ↗
2. An Iterative Two-Stage Multifidelity Optimization Algorithm for Computationally Expensive Problems10.1109/TEVC.2022.3170970 ↗
3. Guo, Z., Lin, S., Suo, R., and Zhang, X. (2023). An Offline Weighted-Bagging Data-Driven Evolutionary Algorithm with Data Generation Based on Clustering. Mathematics, 11.10.3390/math11020431 ↗
4. Wu, X., Liu, S., Lin, Q., Tan, K.C., and Leung, V.C.M. (2024). Evolutionary Multitasking with Adaptive Knowledge Transfer for Expensive Multiobjective Optimization. IEEE Trans. Evol. Comput., 1.10.1109/TEVC.2024.3494039 ↗
5. Data-Driven Evolutionary Optimization: An Overview and Case Studies10.1109/TEVC.2018.2869001 ↗
6. A Surrogate-Assisted Memetic Algorithm for Permuta-tion-Based Combinatorial Optimization Problems10.1016/j.swevo.2025.102060 ↗
7. Surrogate-Assisted Evolutionary Algorithms for Expensive Combinatorial Optimization: A Survey10.1007/s40747-024-01465-5 ↗
8. Parallel Surrogate-Assisted Global Optimization with Expensive Functions—A Survey10.1007/s00158-016-1432-3 ↗
9. A Hierarchical Surrogate-Assisted Differential Evolution with Core Space Localization10.1109/TCYB.2024.3489885 ↗
10. Data-Driven Surrogate-Assisted Multiobjective Evolutionary Optimization of a Trauma System10.1109/TEVC.2016.2555315 ↗
11. Russo, I.L.S., and Barbosa, H.J.C. (2022, January 18–23). A Multitasking Surrogate-Assisted Differential Evolution Method for Solving Bi-Level Optimization Problems. Proceedings of the 2022 IEEE Congress on Evolutionary Computation (CEC), Padua, Italy.10.1109/CEC55065.2022.9870241 ↗
12. Huang, P., Wang, H., and Ma, W. (2019, January 6–9). Stochastic Ranking for Offline Data-Driven Evolutionary Optimization Using Radial Basis Function Networks with Multiple Kernels. Proceedings of the 2019 IEEE Symposium Series on Computational Intelligence (SSCI), Xiamen, China.10.1109/SSCI44817.2019.9002961 ↗
13. A Review of Surrogate-Assisted Evolutionary Algorithms for Expensive Optimization Problems10.1016/j.eswa.2022.119495 ↗
14. Data-Driven Evolutionary Algorithm with Perturbation-Based Ensemble Surrogates10.1109/TCYB.2020.3008280 ↗
15. Boosting Data-Driven Evolutionary Algorithm with Localized Data Generation10.1109/TEVC.2020.2979740 ↗
16. Petelin, D., Filipič, B., and Kocijan, J. (2011). Optimization of Gaussian Process Models with Evolutionary Algorithms. Adaptive and Natural Computing Algorithms. ICANNGA 2011, Springer. Lecture Notes in Computer Science.10.1007/978-3-642-20282-7_43 ↗
17. Surrogate-Assisted Evolutionary Deep Learning Using an End-to-End Random Forest-Based Performance Predictor10.1109/TEVC.2019.2924461 ↗
18. A Random Forest-Assisted Evolutionary Algorithm for Data-Driven Constrained Multiobjective Combinatorial Optimization of Trauma Systems10.1109/TCYB.2018.2869674 ↗
19. Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems10.1109/TEVC.2017.2675628 ↗
20. Convolutional Neural Networks-Based Lung Nodule Classification: A Surrogate-Assisted Evolutionary Algorithm for Hyperparameter Optimization10.1109/TEVC.2021.3060833 ↗
21. Offline Data-Driven Evolutionary Optimization Using Selective Surrogate Ensembles10.1109/TEVC.2018.2834881 ↗
22. Offline Data-Driven Evolutionary Optimization Based on Tri-Training10.1016/j.swevo.2020.100800 ↗
23. A Noise-Resistant Infill Sampling Criterion in Surrogate-Assisted Multi-Objective Evolutionary Algorithms10.1016/j.swevo.2024.101492 ↗
24. Off-Line Data-Driven Multi-Objective Optimization: Knowledge Transfer between Surrogates and Generation of Final Solutions
25. Xue, X., Hu, Y., Feng, L., Zhang, K., Song, L., and Tan, K.C. (2024). Surrogate-Assisted Search with Competitive Knowledge Transfer for Expensive Optimization. IEEE Trans. Evol. Comput., 1.10.1109/TEVC.2024.3478732 ↗
26. Pan, S., Vermetten, D., López-Ibáñez, M., Bäck, T., and Wang, H. (2024, January 14–18). Transfer Learning of Surrogate Models via Domain Affine Transformation. Proceedings of the Genetic and Evolutionary Computation Conference, Melbourne, Australia.10.1145/3638529.3654032 ↗
27. Contrastive Learning: An Alternative Surrogate for Offline Data-Driven Evolutionary Computation10.1109/TEVC.2022.3170638 ↗
28. Federated Many-Task Bayesian Optimization10.1109/TEVC.2023.3279775 ↗
29. Symbolic Regression-Assisted Offline Data-Driven Evolutionary Computation10.1109/TEVC.2024.3482326 ↗
30. Efficient Large-Scale Expensive Optimization via Surrogate-Assisted Sub-Problem Selection10.1109/TEVC.2025.3544449 ↗
31. Surrogate-Assisted Autoencoder-Embedded Evolutionary Optimization Algorithm to Solve High-Dimensional Expensive Problems10.1109/TEVC.2021.3113923 ↗
32. Multiobjective Infill Criterion Driven Gaussian Process-Assisted Particle Swarm Optimization of High-Dimensional Expensive Problems10.1109/TEVC.2018.2869247 ↗
33. Lin, D., Huang, H., Li, X., and Gong, Y. (2022). Empirical Study of Data-Driven Evolutionary Algorithms in Noisy Environments. Mathematics, 10.10.3390/math10060943 ↗
34. A Dynamic Surrogate-Assisted Evolutionary Algorithm Framework for Expensive Structural Optimization10.1007/s00158-019-02391-8 ↗
35. Hao, H., Zhang, X., and Zhou, A. (2025). Expensive Optimization via Relation. IEEE Trans. Evol. Comput., 1.10.1109/TEVC.2025.3542303 ↗
36. Large Sample Properties of Simulations Using Latin Hypercube Sampling10.1080/00401706.1987.10488205 ↗
37. Simulated binary crossover for continuous search space
38. A combined genetic adaptive search (GeneAS) for engineering design