MHMetLib: A New Performance Indicators Library for Trajectory and Population-Based Metaheuristics
Source abstract
Abstract
Traditional performance evaluation metrics for metaheuristics focus primarily on the best solution obtained or the computational resources required to solve a problem. However, further valuable insights into algorithmic components and design can be extracted during the search process. This information enhances understanding of algorithmic design, supports algorithm configuration, and informs methodological advancements. This study presents MHMetLib, a unified indicators library for analyzing both trajectory-based and population-based metaheuristics. The library offers indicators for convergence, diversity, and operator behavior. This enables comprehensive behavioral analysis beyond traditional scalar measures. Each indicator is formally defined and details its objective, computational requirements, and application domain. MHMetLib was implemented and evaluated within the IOHProfiler platform. This ensures consistent evaluation of algorithmic behavior across different metaheuristic families and supports comparison, diagnostics, and configuration. MHMetLib is also compatible with other metaheuristic frameworks or custom algorithmic implementations. Its effectiveness is demonstrated using standard benchmark problems such as OneMax, IsingTorus, and NQueens on evolutionary algorithms and simulated annealing. The results highlight the indicators’ ability to reveal significant dynamics in metaheuristic search processes.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Metaheuristic Optimization Algorithms Research · Vehicle Routing Optimization Methods · Advanced Multi-Objective Optimization Algorithms
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Departamento de Informática, Universidad Técnica Federico Santa María, Av. Vicuña Mackenna 3939, Santiago 8940897, Chile
Departamento de Informática, Universidad Técnica Federico Santa María, Avenida España 1680, Valparaíso 2390123, Chile
Applied Mathematics and Systems Research Institute, National Autonomous University of Mexico, Circuito Escolar S/N, Ciudad Universitaria, Coyoacán, Mexico City 04510, Mexico
Funding
ANID Fondecyt Initiation into Research program
References (33)
Show source-provided references
1. A comparative analysis of metaheuristic techniques for high availability systems10.1109/ACCESS.2024.3352078 ↗
2. Performance comparison of metaheuristic optimization-based parametric methods in wind turbine power curve modeling10.1109/ACCESS.2024.3429051 ↗
3. Comparison of metaheuristic algorithms for interface-constrained channel assignment in a hybrid Dynamic Spectrum Access–Wi-Fi infrastructure WMN10.1109/ACCESS.2022.3155642 ↗
4. Hansen, N., Auger, A., Finck, S., and Ros, R. (2010). Real-Parameter Black-Box Optimization Benchmarking 2010: Experimental Setup. [Ph.D. Thesis, INRIA].
5. Eiben, A.E., and Smith, J.E. (2003). Genetic algorithms. Introduction to Evolutionary Computing, Springer.10.1007/978-3-662-05094-1 ↗
6. Performance assessment of the metaheuristic optimization algorithms: An exhaustive review10.1007/s10462-020-09906-6 ↗
7. Comparison of High-Dimensional Bayesian Optimization Algorithms on BBOB10.1145/3670683 ↗
8. Reproducibility in Evolutionary Computation
9. Kononova, A.V., van Stein, N., Mersmann, O., Bäck, T., Bartz-Beielstein, T., Glasmachers, T., Hellwig, M., Krey, S., Kůdela, J., and Naujoks, B. (2025). Benchmarking that Matters: Rethinking Benchmarking for Practical Impact. arXiv.
10. Wang, H., Castellanos, C.I.H., and Eftimov, T. (2021). On Statistical Analysis of MOEAs with Multiple Performance Indicators. Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization, Shenzhen, China, 28–31 March 2021, Springer.10.1007/978-3-030-72062-9_3 ↗
11. jMetalPy: A Python framework for multi-objective optimization with metaheuristics10.1016/j.swevo.2019.100598 ↗
12. Pymoo: Multi-Objective Optimization in Python10.1109/ACCESS.2020.2990567 ↗
13. COCO: A platform for comparing continuous optimizers in a black-box setting10.1080/10556788.2020.1808977 ↗
14. Benchmarking discrete optimization heuristics with IOHprofiler10.1016/j.asoc.2019.106027 ↗
15. IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristics10.1162/evco_a_00342 ↗
16. Empirical Analysis of the Dynamic Binary Value Problem with IOHprofiler10.1007/978-3-031-70068-2_2 ↗
17. Vermetten, D., Rook, J., Preuß, O.L., de Nobel, J., Doerr, C., López-Ibañez, M., Trautmann, H., and Bäck, T. (2025). MO-IOHinspector: Anytime benchmarking of multi-objective algorithms using IOHprofiler. Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization, Canberra, ACT, Australia, 4–7 March 2025, Springer.10.1007/978-981-96-3506-1_17 ↗
18. IOHanalyzer: Detailed performance analyses for iterative optimization heuristics10.1145/3510426 ↗
19. Search trajectory networks: A tool for analysing and visualising the behaviour of metaheuristics10.1016/j.asoc.2021.107492 ↗
20. Lavinas, Y., Ochoa, G., Minku, L.L., and Santana, R. (2022). Search Trajectories Networks of Multiobjective Evolutionary Algorithms. arXiv.10.1007/978-3-031-02462-7_15 ↗
21. STNWeb: A new visualization tool for analyzing optimization algorithms10.1016/j.simpa.2023.100558 ↗
22. BIAS: A Toolbox for Benchmarking Structural Bias in the Continuous Domain10.1109/TEVC.2022.3189848 ↗
23. A survey of features used for representing black-box single-objective continuous optimization10.1016/j.swevo.2026.102288 ↗
24. The irace package: Iterated racing for automatic algorithm configuration
25. SMAC3: A versatile Bayesian optimization package for hyperparameter optimization
26. Hutter, F., Kotthoff, L., and Vanschoren, J. (2019). Automated Machine Learning: Methods, Systems, Challenges, Springer Nature.10.1007/978-3-030-05318-5 ↗
27. Automatic design of metaheuristics for practical engineering applications10.1109/ACCESS.2023.3236836 ↗
28. Explainable Benchmarking for Iterative Optimization Heuristics10.1145/3673908 ↗
29. Rodemann, J., Croppi, F., Arens, P., Sale, Y., Herbinger, J., Bischl, B., Hüllermeier, E., Augustin, T., Walsh, C.J., and Casalicchio, G. (2025). Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration for Exosuit Personalization. Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Porto, Portugal, 15–19 September 2025, Springer.10.1007/978-3-662-72243-5_30 ↗
30. EvoMapX: An explainable framework for metaheuristic optimization algorithms10.1016/j.eswa.2025.129514 ↗
31. Doerr, C., Wang, H., Ye, F., van Rijn, S., and Bäck, T. (2018). IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristics. arXiv.
32. Multidimensional scaling for evolutionary algorithms—Visualization of the path through search space and solution space using Sammon mapping
33. Review of the development of multidimensional scaling methods