The Impact of Different Parallel Strategies on the Performance of Kriging-Based Efficient Global Optimization Algorithms
Source abstract
Abstract
A parallel efficient global optimization (EGO) algorithm with a pseudo expected improvement (PEI) multi-point sampling criterion, proposed in recent years, is developed to adapt the capabilities of modern parallel computing power. However, a comprehensive and clear discussion on the impact of different point-filling strategies on the optimization performance of the parallel EGO algorithm is still lacking, limiting its theoretical reference for practical applications and technological advancements. To address this gap, this study comprehensively investigates the optimization performance of the parallel EGO algorithm based on the PEI multi-point sampling criterion by analyzing the impact of different point-filling strategies under kriging surrogate models of varying fidelity. Therefore, nine benchmark test functions with different optimization problem characteristics were selected as optimization test objects, and the results were systematically analyzed from the perspectives of convergence performance, optimization efficiency, and algorithmic diversity. The analysis results indicate that the higher-fidelity kriging surrogate model enhances the stability of the parallel EGO algorithm in terms of convergence performance, optimization efficiency, and algorithmic diversity.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Multi-Objective Optimization Algorithms · Metaheuristic Optimization Algorithms Research · Advanced Optimization Algorithms Research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Graduate School of System Informatics, Kobe University, Kobe 657-8501, Hyogo, Japan
Institute of Auto Engineering, BYD Auto Industry Co., Ltd., Shenzhen 518118, China
Graduate School of Advanced Science and Engineering, Hiroshima University, Higashihiroshima 739-8527, Hiroshima, Japan
Complex Phenomena Unified Simulation Research Team, RIKEN, Center for Computational Science, Kobe 650-0074, Hyogo, Japan
Funding
MEXT · RIKEN Center for Computational Science · China Scholarship Council (CSC)
References (33)
Show source-provided references
1. Derivative-Free Optimization Methods10.1017/S0962492919000060 ↗
2. Gradient-Based Optimizer (GBO): A Review, Theory, Variants, and Applications10.1007/s11831-022-09872-y ↗
3. Particle Swarm Optimization Algorithm: An Overview10.1007/s00500-016-2474-6 ↗
4. Nature Inspired Meta Heuristic Algorithms for Optimization Problems10.1007/s00607-021-00955-5 ↗
5. Advances in Surrogate Based Modeling, Feasibility Analysis, and Optimization: A Review10.1016/j.compchemeng.2017.09.017 ↗
6. Aerodynamic Optimisation of a High-Speed Train Head Shape Using an Advanced Hybrid Surrogate-Based Nonlinear Model Representation Method10.1007/s11081-020-09554-3 ↗
7. Surrogate-Based Aerodynamic Shape Optimization of a Sliding Shear Variable Sweep Wing over a Wide Mach-Number Range with Plasma Constraint Relaxation10.1007/s00158-023-03507-x ↗
8. An Adaptive SVD–Krylov Reduced Order Model for Surrogate Based Structural Shape Optimization through Isogeometric Boundary Element Method10.1016/j.cma.2019.02.023 ↗
9. Surrogate-Based Structural Optimization Design of Large-Scale Rectangular Pressure Vessel Using Radial Point Interpolation Method10.1016/j.ijpvp.2022.104638 ↗
10. Efficient Global Optimization of Expensive Black-Box Functions10.1023/A:1008306431147 ↗
11. A Taxonomy of Global Optimization Methods Based on Response Surfaces10.1023/A:1012771025575 ↗
12. On the Design of Optimization Strategies Based on Global Response Surface Approximation Models10.1007/s10898-004-6733-1 ↗
13. Expected Improvement in Efficient Global Optimization through Bootstrapped Kriging10.1007/s10898-011-9741-y ↗
14. Statistical Improvement Criteria for Use in Multiobjective Design Optimization10.2514/1.16875 ↗
15. Expected Improvement Matrix-Based Infill Criteria for Expensive Multiobjective Optimization10.1109/TEVC.2017.2697503 ↗
16. Enhanced Expected Hypervolume Improvement Criterion for Parallel Multi-Objective Optimization10.1016/j.jocs.2022.101903 ↗
17. Design and Analysis of “Noisy” Computer Experiments10.2514/1.20068 ↗
18. An Improved System for Efficient Shape Optimization of Vehicle Aerodynamics with “Noisy” Computations10.1007/s00158-022-03323-9 ↗
19. Adaptive Surrogate-Based Design Optimization with Expected Improvement Used as Infill Criterion10.1080/02331934.2011.644286 ↗
20. A Complete Expected Improvement Criterion for Gaussian Process Assisted Highly Constrained Expensive Optimization10.1016/j.ins.2018.09.003 ↗
21. A Parallel Constrained Efficient Global Optimization Algorithm for Expensive Constrained Optimization Problems10.1080/0305215X.2020.1722118 ↗
22. Optimization of Expensive Black-Box Problems via Gradient-Enhanced Kriging10.1016/j.cma.2020.112861 ↗
23. Tenne, Y., and Goh, C.-K. (2010). Kriging Is Well-Suited to Parallelize Optimization. Computational Intelligence in Expensive Optimization Problems, Springer.10.1007/978-3-642-10701-6 ↗
24. Pseudo Expected Improvement Criterion for Parallel EGO Algorithm10.1007/s10898-016-0484-7 ↗
25. Kriging-Based Unconstrained Global Optimization through Multi-Point Sampling10.1080/0305215X.2019.1668934 ↗
26. Design and Analysis of Computer Experiments
27. Improving Variable-Fidelity Surrogate Modeling via Gradient-Enhanced Kriging and a Generalized Hybrid Bridge Function10.1016/j.ast.2012.01.006 ↗
28. (2022, August 20). Problem Definitions and Evaluation Criteria for the CEC 2013 Special Session on Real-Parameter Optimization. ResearchGate. Available online: https://www.researchgate.net/publication/256995189_Problem_Definitions_and_Evaluation_Criteria_for_the_CEC_2013_Special_Session_on_Real-Parameter_Optimization.
29. Modified Algorithms for Fast Construction of Optimal Latin-Hypercube Design10.1109/ACCESS.2020.3032122 ↗
30. Wang, Q., Nakashima, T., Kanehira, T., and Mutsuda, H. (2022, January 15–17). A Python Toolbox for Surrogate-Based Optimization. Proceedings of the 2022 IEEE 12th International Conference on Electronics Information and Emergency Communication (ICEIEC), Beijing, China.10.1109/ICEIEC54567.2022.9835067 ↗
31. Gradient-Enhanced Kriging-Based Parallel Efficient Global Optimization Algorithm and Its Application in Aerodynamic Shape Optimization10.1109/ACCESS.2025.3560292 ↗
32. Relative Power of the Wilcoxon Test, the Friedman Test, and Repeated-Measures ANOVA on Ranks10.1080/00220973.1993.9943832 ↗
33. Optimizing the Parameters of Hybrid Active Power Filters through a Comprehensive and Dynamic Multi-Swarm Gravitational Search Algorithm10.1016/j.engappai.2023.106469 ↗