journal article·2022-09-25Open access

A Distributed Bi-Behaviors Crow Search Algorithm for Dynamic Multi-Objective Optimization and Many-Objective Optimization Problems

Ahlem Aboud, Nizar Rokbani, Bilel Neji, Zaher Al Al Barakeh, Seyedali Mirjalili, Adel M. Alimi

Applied Sciences· Volume 12· Issue 19

Abstract

Dynamic Multi-Objective Optimization Problems (DMOPs) and Many-Objective Optimization Problems (MaOPs) are two classes of the optimization field that have potential applications in engineering. Modified Multi-Objective Evolutionary Algorithms hybrid approaches seem to be suitable to effectively deal with such problems. However, the standard Crow Search Algorithm has not been considered for either DMOPs or MaOPs to date. This paper proposes a Distributed Bi-behaviors Crow Search Algorithm (DB-CSA) with two different mechanisms, one corresponding to the search behavior and another to the exploitative behavior with a dynamic switch mechanism. The bi-behaviors CSA chasing profile is defined based on a large Gaussian-like Beta-1 function, which ensures diversity enhancement, while the narrow Gaussian Beta-2 function is used to improve the solution tuning and convergence behavior. Two variants of the proposed DB-CSA approach are developed: the first variant is used to solve a set of MaOPs with 2, 3, 5, 7, 8, 10,15 objectives, and the second aims to solve several types of DMOPs with different time-varying Pareto optimal sets and a Pareto optimal front. The second variant of DB-CSA algorithm (DB-CSA-II) is proposed to solve DMOPs, including a dynamic optimization process to effectively detect and react to the dynamic change. The Inverted General Distance, the Mean Inverted General Distance and the Hypervolume Difference are the main measurement metrics used to compare the DB-CSA approach to the state-of-the-art MOEAs. The Taguchi method has been used to manage the meta-parameters of the DB-CSA algorithm. All quantitative results are analyzed using the non-parametric Wilcoxon signed rank test with 0.05 significance level, which validated the efficiency of the proposed method for solving 44 test beds (21 DMOPs and 23 MaOPS).
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Multi-Objective Optimization Algorithms · Optimal Experimental Design Methods · Metaheuristic Optimization Algorithms Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

University of Sousse, ISITCom, Sousse 4011, Tunisia

REGIM Lab: REsearch Groups in Intelligent Machines, University of Sfax, National Engineering School of Sfax (ENIS), BP 1173, Sfax 3038, Tunisia

High Institute of Applied Science and Technology of Sousse, University of Sousse, Sousse 4003, Tunisia

College of Engineering and Technology, American University of the Middle East, Egaila 54200, Kuwait

Yonsei Frontier Lab, Yonsei University, Seoul 03722, Korea

Centre for Artificial Intelligence Research and Optimisation, Torrens University Australia, Brisbane 2607, Australia

Department of Electrical and Electronic Engineering Science, Faculty of Engineering and the Built Environment, University of Johannesburg, Johannesburg 2006, South Africa

Funding

Ministry of Higher Education and Scientific Research of Tunisia

References (85)

Show source-provided references
1. Deb, K., Rao N, U.B., and Karthik, S. (2007). Dynamic multi-objective optimization and decision-making using modified NSGA-II: A case study on hydro-thermal power scheduling. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer.10.1007/978-3-540-70928-2_60 ↗
2. Dynamic Multi Objective Particle Swarm Optimization Based on a New Environment Change Detection Strategy
3. Aboud, A., Fdhila, R., and Alimi, A. (2016, January 9–12). MOPSO for dynamic feature selection problem based big data fusion. Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016—Conference Proceedings, Budapest, Hungary.10.1109/SMC.2016.7844846 ↗
4. Aboud, A., Rokbani, N., Fdhila, R., Qahtani, A.M., Almutiry, O., Dhahri, H., Hussain, A., and Alimi, A.M. (2022). DPb-MOPSO: A dynamic Pareto bi-level Multi-objective Particle Swarm Optimization Algorithm. App. Soft Comput., 109622.10.1016/j.asoc.2022.109622 ↗
5. Kennedy, J., and Eberhart, R. (December, January 27). Particle swarm optimization. Proceedings of the ICNN’95—International Conference on Neural Networks, Perth, WA, Australia.
6. Dynamic multiobjective optimization problems: Test cases, approximations, and applications10.1109/TEVC.2004.831456 ↗
7. A pareto-based evolutionary algorithm using decomposition and truncation for dynamic multi-objective optimization10.1016/j.asoc.2019.105673 ↗
8. A prediction strategy based on center points and knee points for evolutionary dynamic multi-objective optimization10.1016/j.asoc.2017.08.004 ↗
9. A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm10.1016/j.compstruc.2016.03.001 ↗
10. A New Heuristic Optimization Algorithm: Harmony Search10.1177/003754970107600201 ↗
11. A Steady-State and Generational Evolutionary Algorithm for Dynamic Multiobjective Optimization10.1109/TEVC.2016.2574621 ↗
12. A competitive-cooperative coevolutionary paradigm for dynamic multiobjective optimization10.1109/TEVC.2008.920671 ↗
13. MOEA/D: A multiobjective evolutionary algorithm based on decomposition10.1109/TEVC.2007.892759 ↗
14. A Population prediction strategy for evolutionary dynamic multiobjective optimization10.1109/TCYB.2013.2245892 ↗
15. A Fast Dynamic Evolutionary Multiobjective Algorithm via Manifold Transfer Learning10.1109/TCYB.2020.2989465 ↗
16. Evolutionary Dynamic Multiobjective Optimization Assisted by a Support Vector Regression Predictor10.1109/TEVC.2019.2925722 ↗
17. Transfer Learning-Based Dynamic Multiobjective Optimization Algorithms10.1109/TEVC.2017.2771451 ↗
18. Evolutionary Dynamic Multiobjective Optimization Via Kalman Filter Prediction10.1109/TCYB.2015.2490738 ↗
19. On the evolutionary optimization of many conflicting objectives10.1109/TEVC.2007.910138 ↗
20. Hughes, E.J. (2003, January 8–12). Multiple single objective Pareto sampling. Proceedings of the 2003 Congress on Evolutionary Computation, Canberra, Australia.
21. Hughes, E.J. (2007, January 25–28). MSOPS-II: A general-purpose many-objective optimiser. Proceedings of the 2007 IEEE Congress on Evolutionary Computation, CEC 2007, Singapore.10.1109/CEC.2007.4424985 ↗
22. A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization10.1109/TEVC.2016.2519378 ↗
23. Decomposition of a multiobjective optimization problem into a number of simple multiobjective subproblems10.1109/TEVC.2013.2281533 ↗
24. An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, Part I: Solving problems with box constraints10.1109/TEVC.2013.2281535 ↗
25. An evolutionary many-objective optimization algorithm based on dominance and decomposition10.1109/TEVC.2014.2373386 ↗
26. A Decomposition Method Based on Random Objective Division for MOEA/D in Many-Objective Optimization10.1109/ACCESS.2020.2999417 ↗
27. HypE: An algorithm for fast hypervolume-based many-objective optimization10.1162/EVCO_a_00009 ↗
28. SMS-EMOA: Multiobjective selection based on dominated hypervolume10.1016/j.ejor.2006.08.008 ↗
29. Indicator-based selection in multiobjective search
30. Feng, S., and Wen, J. (2019, January 13–16). An Evolutionary Many-Objective Optimization Algorithm Based on IGD Indicator and Region Decomposition. Proceedings of the 2019 15th International Conference on Computational Intelligence and Security, CIS 2019, Macau, China.10.1109/CIS.2019.00051 ↗
31. IGD Indicator-Based Evolutionary Algorithm for Many-Objective Optimization Problems10.1109/TEVC.2018.2791283 ↗
32. A new evolutionary algorithm for solving many-objective optimization problems10.1109/TSMCB.2008.926329 ↗
33. Borg: An auto-adaptive many-objective evolutionary computing framework10.1162/EVCO_a_00075 ↗
34. Gaoping, W., and Huawei, J. (2007, January 15–19). Fuzzy-dominance and its application in evolutionary many objective optimization. Proceedings of the CIS Workshops 2007, 2007 International Conference on Computational Intelligence and Security Workshops, Harbin, China.
35. A grid-based evolutionary algorithm for many-objective optimization10.1109/TEVC.2012.2227145 ↗
36. A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization10.1109/TEVC.2015.2420112 ↗
37. An investigation on preference order ranking scheme for multiobjective evolutionary optimization10.1109/TEVC.2006.876362 ↗
38. Diversity management in evolutionary many-objective optimization10.1109/TEVC.2010.2058117 ↗
39. Shift-based density estimation for pareto-based algorithms in many-objective optimization10.1109/TEVC.2013.2262178 ↗
40. A knee point-driven evolutionary algorithm for many-objective optimization10.1109/TEVC.2014.2378512 ↗
41. Preference-inspired coevolutionary algorithms for many-objective optimization10.1109/TEVC.2012.2204264 ↗
42. Praditwong, K., and Yao, X. (2006, January 3–6). A new multi-objective evolutionary optimisation algorithm: The two-archive algorithm. Proceedings of the 2006 International Conference on Computational Intelligence and Security, ICCIAS 2006, Guangzhou, China.10.1109/ICCIAS.2006.294139 ↗
43. Two Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization10.1109/TEVC.2014.2350987 ↗
44. Measuring the convergence and diversity of CDAS Multi-Objective Particle Swarm Optimization Algorithms: A study of many-objective problems10.1016/j.neucom.2011.03.053 ↗
45. Castro, O., and Pozo, A. (2014, January 9–12). A MOPSO based on hyper-heuristic to optimize many-objective problems. Proceedings of the 2014 IEEE Symposium on Swarm Intelligence, Proceedings, Orlando, FL, USA.10.1109/SIS.2014.7011803 ↗
46. Indicator-based set evolution particle swarm optimization for many-objective problems10.1007/s00500-015-1637-1 ↗
47. Many-Objective Particle Swarm Optimization Using Two-Stage Strategy and Parallel Cell Coordinate System10.1109/TCYB.2016.2548239 ↗
48. Maltese, J., Ombuki-Berman, B., and Engelbrecht, A. (2016, January 24–29). Pareto-based many-objective optimization using knee points. Proceedings of the 2016 IEEE Congress on Evolutionary Computation, CEC 2016, Vancouver, BC, Canada.10.1109/CEC.2016.7744255 ↗
49. A Many-Objective Particle Swarm Optimizer with Leaders Selected from Historical Solutions by Using Scalar Projections10.1109/TCYB.2018.2884083 ↗
50. A hybrid leader selection strategy for many-objective particle swarm optimization10.1109/ACCESS.2020.3031002 ↗
51. Ma, L., Huang, M., Yang, S., Wang, R., and Wang, X. (2021). An Adaptive Localized Decision Variable Analysis Approach to Large-Scale Multiobjective and Many-Objective Optimization. IEEE Trans. Cybern.10.1109/TCYB.2020.3041212 ↗
52. A Vector Angle-Based Evolutionary Algorithm for Unconstrained Many-Objective Optimization10.1109/TEVC.2016.2587808 ↗
53. A Strengthened Dominance Relation Considering Convergence and Diversity for Evolutionary Many-Objective Optimization10.1109/TEVC.2018.2866854 ↗
54. Solving Many-Objective Optimization Problems by a Pareto-Based Evolutionary Algorithm with Preprocessing and a Penalty Mechanism10.1109/TCYB.2020.2988896 ↗
55. Evolutionary Many-Objective Optimization: A Comparative Study of the State-of-The-Art10.1109/ACCESS.2018.2832181 ↗
56. A strength pareto evolutionary algorithm based on reference direction for multiobjective and many-objective optimization10.1109/TEVC.2016.2592479 ↗
57. Solving Many-Objective Optimization Problems via Multistage Evolutionary Search10.1109/TSMC.2019.2930737 ↗
58. A comprehensive survey of Crow Search Algorithm and its applications10.1007/s10462-020-09911-9 ↗
59. Nobahari, H., and Bighashdel, A. (2017, January 7–9). MOCSA: A Multi-Objective Crow Search Algorithm for Multi-Objective optimization. Proceedings of the 2nd Conference on Swarm Intelligence and Evolutionary Computation, CSIEC 2017–Proceedings, Kerman, Iran.10.1109/CSIEC.2017.7940171 ↗
60. MOTCO: Multi-objective Taylor Crow Optimization Algorithm for Cluster Head Selection in Energy Aware Wireless Sensor Network10.1007/s11036-019-01271-1 ↗
61. Souza, R., Coelho, L., MacEdo, C., and Pierezan, J. (2018, January 8–13). A V-Shaped Binary Crow Search Algorithm for Feature Selection. Proceedings of the 2018 IEEE Congress on Evolutionary Computation (CEC), Rio de Janeiro, Brazil.
62. A Binary Crow Search Algorithm for Solving Two-dimensional Bin Packing Problem with Fixed Orientation10.1016/j.procs.2020.03.420 ↗
63. Coelho, L.S., Richter, C., Mariani, V., and Askarzadeh, A. (2016, January 13–16). Modified crow search approach applied to electromagnetic optimization. Proceedings of the 2016 IEEE Conference on Electromagnetic Field Computation (CEFC), Miami, FL, USA.
64. Usability feature extraction using modified crow search algorithm: A novel approach10.1007/s00521-018-3688-6 ↗
65. A modified crow search algorithm (MCSA) for solving economic load dispatch problem10.1016/j.asoc.2018.06.040 ↗
66. A modified crow search algorithm with applications to power system problems
67. Huang, K.W., Girsang, A.S., Wu, Z.X., and Chuang, Y.W. (2019). A Hybrid Crow Search Algorithm for Solving Permutation Flow Shop Scheduling Problems. Appl. Sci., 9.10.3390/app9071353 ↗
68. Díaz, P., Pérez-Cisneros, M., Cuevas, E., Avalos, O., Gálvez, J., Hinojosa, S., and Zaldivar, D. (2018). An Improved Crow Search Algorithm Applied to Energy Problems. Energies, 11.10.3390/en11030571 ↗
69. Meddeb, A., Amor, N., Abbes, M., and Chebbi, S. (2018). A Novel Approach Based on Crow Search Algorithm for Solving Reactive Power Dispatch Problem. Energies, 11.10.3390/en11123321 ↗
70. Enhanced crow search algorithm for optimum design of structures10.1016/j.asoc.2019.01.026 ↗
71. Enhanced crow search algorithm for AVR optimization10.1007/s00500-019-04640-w ↗
72. An Enhanced Crow Search Algorithm Applied to Energy Approaches
73. Designing of stand-alone hybrid PV/wind/battery system using improved crow search algorithm considering reliability index10.1007/s40095-019-00319-y ↗
74. A New Hybrid Algorithm Based on Grey Wolf Optimization and Crow Search Algorithm for Unconstrained Function Optimization and Feature Selection10.1109/ACCESS.2019.2897325 ↗
75. Huang, K.W., and Wu, Z.X. (2019). CPO: A Crow Particle Optimization Algorithm. Int. J. Comput. Intell. Syst., 12.10.2991/ijcis.2018.125905658 ↗
76. Merging Lion with Crow Search Algorithm for Optimal Location and Sizing of UPQC in Distribution Network10.1007/s40313-020-00564-1 ↗
77. Beta Neuro-Fuzzy Systems
78. Rokbani, N., Slim, M., and Alimi, A.M. (2021, January 27–28). The Beta distributed PSO, β-PSO, with application to Inverse Kinematics. Proceedings of the National Computing Colleges Conference (NCCC), Taif, Saudi Arabia.10.1109/NCCC49330.2021.9428811 ↗
79. Garzelli, A., Capobianco, L., and Nencini, F. (2008). Fusion of multispectral and panchromatic images as an optimisation problem. Image Fusion, Elsevier.10.1016/B978-0-12-372529-5.00005-6 ↗
80. A fast and elitist multiobjective genetic algorithm: NSGA-II10.1109/4235.996017 ↗
81. Biswas, S., Das, S., Suganthan, P., and Coello, C. (2014, January 6–11). Evolutionary multiobjective optimization in dynamic environments: A set of novel benchmark functions. Proceedings of the 2014 IEEE Congress on Evolutionary Computation, CEC 2014, Beijing, China.10.1109/CEC.2014.6900487 ↗
82. JMetal: A Java framework for multi-objective optimization10.1016/j.advengsoft.2011.05.014 ↗
83. Genichi, T., Rajesh, J., and Shin, T. (2004). Computer-based Robust Engineering: Essentials for DFSS, ASQ Quality Press.
84. Bi-heuristic ant colony optimization-based approaches for traveling salesman problem10.1007/s00500-020-05406-5 ↗
85. Dordevic, M. (2019, January 13–15). Statistical analysis of various hybridization of evolutionary algorithm for traveling salesman problem. Proceedings of the IEEE International Conference on Industrial Technology, Melbourne, Australia.10.1109/ICIT.2019.8755092 ↗