journal article·2024-01-19Open access

Query Optimization in Distributed Database Based on Improved Artificial Bee Colony Algorithm

Yan Du, Zhi Cai, Zhiming Ding

Applied Sciences· Volume 14· Issue 2

Abstract

Query optimization is one of the key factors affecting the performance of database systems that aim to enact the query execution plan with minimum cost. Particularly in distributed database systems, due to the multiple copies of the data that are stored in different data nodes, resulting in the dramatic increase in the feasible query execution plans for a query statement. Because of the increasing volume of stored data, the cluster size of distributed databases also increases, resulting in poor performance of current query optimization algorithms. In this case, a dynamic perturbation-based artificial bee colony algorithm is proposed to solve the query optimization problem in distributed database systems. The improved artificial bee colony algorithm improves the global search capability by combining the selection, crossover, and mutation operators of the genetic algorithm to overcome the problem of falling into the local optimal solution easily. At the same time, the dynamic perturbation factor is introduced so that the algorithm parameters can be dynamically varied along with the process of iteration as well as the convergence degree of the whole population to improve the convergence efficiency of the algorithm. Finally, comparative experiments conducted to assess the average execution cost of Top-k query plans generated by the algorithms and the convergence speed of algorithms under the conditions of query statements in six different dimension sets. The results demonstrate that the Top-k query plans generated by the proposed method have a lower execution cost and a faster convergence speed, which can effectively improve the query efficiency. However, this method requires more execution time.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Cloud Computing and Resource Management · Optimization and Search Problems · Data Management and Algorithms

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China

Research Center of Spatial-Temporal Data Management and Data Science, Institute of Software, Chinese Academy of Sciences, Beijing 100090, China

Funding

National Key R&D Program of China · Key R&D Program of Shandong Province · National Natural Science of Foundation of China

References (41)

Show source-provided references
1. IDC (2018, October 16). Global Data Volume Trends [EB/OL]. Available online: https://www.seagate.com/files/www-content/our-StoryAmazon/trends/files/idc-seagate-dataage-chine-whitepaper.pdf.
2. MGI (2011, May 13). Big Data: The Next Frontier for Innovation, Competition, and Productivity [EB/OL]. Available online: https://www.mckinsey.com/business-Functions/mckinsey-digital/our-insights/big-data-the-next-frontier-for-innovation.
3. Fault-tolerant based group key servers with enhancement of utilizing the contributory server for cloud storage applications10.1080/03772063.2021.1893842 ↗
4. Design and analysis of stochastic DSS query optimizers in a distributed database system10.1016/j.eij.2015.10.003 ↗
5. Özsu, M.T., and Valduriez, P. (1999). Principles of Distributed Database Systems, Prentice-Hall, Inc.. [2nd ed.].
6. Özsu, M.T., and Valduriez, P. (2011). Principles of Distributed Database Systems, Springer Science and Business Media.10.1007/978-1-4419-8834-8 ↗
7. A multi-colony ant algorithm for optimizing join queries in distributed database systems10.1007/s10115-012-0608-4 ↗
8. VLL: A lock manager redesign for main memory database systems10.1007/s00778-014-0377-7 ↗
9. Solving a novel multiobjective placement problem of recloser and distributed generation sources insimultaneous mode by improved harmony search algorithm10.1002/cplx.21567 ↗
10. Research and Application of Distributed Database Systems
11. Query optimization mechanisms in the cloud environments: A systematic study10.1002/dac.3940 ↗
12. A novel data aggregation using multi objective based male lion optimization algorithm (DA-MOMLOA) in wireless sensor network10.1007/s12652-021-03230-9 ↗
13. A cost model for random access queries in document stores10.1007/s00778-021-00660-x ↗
14. Li, C. (2012). Research on Optimization of Distributed Database Query Strategy. [Master’s Thesis, Xi’an University of Electronic Science and Technology].
15. Randomized Algorithms for Optimizing Large Join Queries10.1145/93605.98740 ↗
16. Forestiero, A., Mastroianni, C., and Spezzano, G. (2007, January 10–13). Antares: An ant-inspired P2P information system for a self-structured grid. Proceedings of the 2007 2nd Bio-Inspired Models of Network, Information and Computing Systems, Budapest, Hungary.10.1109/BIMNICS.2007.4610103 ↗
17. Rathore, V., Worring, M., Mishra, D., Joshi, A., and Maheshwari, S. (2019). Emerging Trends in Expert Applications and Security. Advances in Intelligent Systems and Computing, Springer.10.1007/978-981-13-2285-3 ↗
18. QoS-based dissemination of content in grids10.1016/j.future.2007.05.003 ↗
19. Evaluating query execution plans by implementing join operators using particle swarm optimization
20. Yao, M. (2017, January 24–26). A distributed database query optimization method based on genetic algorithm and immune theory. Proceedings of the 2017 8th IEEE International Conference on Software Engineering and Service Science (ICSESS), Beijing, China.10.1109/ICSESS.2017.8343024 ↗
21. Efficient optimization of large join queries using tabu search10.1016/0020-0255(94)00094-R ↗
22. Optimizing Access Strategies for a Distributed Database Design using Genetic Fragmentation
23. Yang, W., Peizhi, W., Xing, D., and Likun, Z. (2015). An improved genetic algorithm for optimization of distributed database query. J. Guilin Univ. Electron. Technol.
24. Dong, H., and Liang, Y. (2007, January 7–11). Genetic Algorithms for Large Join Query Optimization. Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, London, UK.10.1145/1276958.1277193 ↗
25. Stillger, M., and Spiliopoulou, M. (1996, January 28–31). Genetic Programming in Database Query Optimization. Proceedings of the First Annual Conference on Genetic Programming, Stanford, CA, USA.
26. Evolutionary Fuzzy-based gravitational search algorithm for query optimization in crowdsourcing system to minimize cost and latency10.1111/coin.12382 ↗
27. An effective discrete artificial bee colony based SPARQL query path optimization by reordering triples10.1007/s11390-020-9901-y ↗
28. Distributed query plan generation using ant colony optimization10.4018/ijamc.2015010101 ↗
29. Query optimization of distributed database based on multiple ant colony genetic algorithm
30. QIACO: A Quantum Dynamic Cost Ant System for Query Optimization in Distributed Database10.1109/ACCESS.2021.3049544 ↗
31. Optimization Method for Distributed Database Query Based on an Adaptive Double Entropy Genetic Algorithm10.1109/ACCESS.2022.3141589 ↗
32. FACO: A hybrid fuzzy ant colony optimization algorithm for virtual machine scheduling in high-performance cloud computing10.1007/s12652-019-01631-5 ↗
33. A Novel Artificial Bee Colony Algorithm Based on Modified Search Equation and Orthogonal Learning10.1109/TSMCB.2012.2222373 ↗
34. Survey on Artificial bee colony Algorithm
35. Phongmoo, S., Leksakul, K., Charoenchai, N., and Boonmee, C. (2023). Artificial Bee Colony Algorithm with Pareto-Based Approach for Multi-Objective Three-Dimensional Single Container Loading Problems. Appl. Sci., 13.10.3390/app13116601 ↗
36. Escamilla-Serna, N.J., Seck-Tuoh-Mora, J.C., Medina-Marin, J., Barragan-Vite, I., and Corona-Armenta, J.R. (2022). A Hybrid Search Using Genetic Algorithms and Random-Restart Hill-Climbing for Flexible Job Shop Scheduling Instances with High Flexibility. Appl. Sci., 12.10.3390/app12168050 ↗
37. Generating optimal query plans for distributed query processing using teacher-learner based optimization10.1016/j.procs.2015.06.033 ↗
38. Recommendation platform in Internet of Things leveraging on a self-organizing multiagent approach10.1007/s00521-022-07231-3 ↗
39. Transparent and Efficient Parallelization of Swarm Algorithms10.1145/2897373 ↗
40. Alaya, I., Solnon, C., and Ghedira, K. (2017, January 6–8). Ant Colony Optimization for Multi-objective Optimization Problems. Proceedings of the IEEE International Conference on Tools with Artificial Intelligence, Boston, MA, USA.
41. Kang, G., Yang, Z., Yuan, X., and Wu, J. (2023). Fault Reconstruction for a Giant Satellite Swarm Based on Hybrid Multi-Objective Optimization. Appl. Sci., 13.10.3390/app13116674 ↗