An Adaptive Task Traffic Shaping Method for Highly Concurrent Geographic Information System Services with Limited Resources
Source abstract
Abstract
Under the condition of limited resources, when the GIS service platform is faced with high concurrent service requests, the high concurrent processing capacity of a single server is the main bottleneck affecting the quality of service (QoS) of the GIS service platform. Traditional traffic shaping methods, such as token bucket algorithms, alleviate the pressure in high-concurrency situations to a certain extent, but due to their fixed-rate settings, it is difficult to cope with complex and variable task requests, leading to unstable system performance. This paper proposes an adaptive task traffic shaping method to improve the utilization efficiency of server resources, reduce task processing delay, and improve service stability and response speed by monitoring the system load in real time and dynamically adjusting the processing rate of GIS task traffic. The relationship between the task arrival rate and server load is established based on the queueing theory model, and the token fill rate of the token bucket is adjusted adaptively according to resource load evaluation, so as to optimize the task processing flow. The experimental results show that under different GIS task scenarios, the processing performance of this paper’s method is better than or close to that of the traditional method under the optimal fill rate condition, which can significantly reduce the task latency and improve the concurrent processing capability of the GIS service platform.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Distributed and Parallel Computing Systems · Cloud Computing and Resource Management · Caching and Content Delivery
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Chinese Academy of Surveying and Mapping, Beijing 100036, China
Funding
National Key Research and Development Program of China · Fundamental Research Funds for Central Public Welfare Research Institutes
References (44)
Show source-provided references
1. An integrated GIS platform architecture for spatiotemporal big data10.1016/j.future.2018.10.034 ↗
2. A state-of-the-art review on the quantitative and qualitative assessment of water resources using google earth engine10.1007/s10661-024-13315-5 ↗
3. A cloud-integrated GIS for forest cover loss and land use change monitoring using statistical methods and geospatial technology over northern Algeria10.1016/j.jenvman.2023.118029 ↗
4. QoS Control for Guaranteed Service Bundles Over Fiber-Wireless (FiWi) Broadband Access Networks10.1109/JLT.2011.2132753 ↗
5. Kokkonis, G., Psannis, K., and Roumeliotis, M. (2015). Network Adaptive Flow Control Algorithm for Haptic Data Over the Internet–NAFCAH, Springer.10.1007/978-3-319-23207-2_10 ↗
6. Chen, X., Leung, K.C., and Lam, A.Y.S. (2017, January 21–25). Leaky bucket-inspired power output smoothing with load-adaptive algorithm. Proceedings of the 2017 IEEE International Conference on Communications (ICC), Paris, France.10.1109/ICC.2017.7996944 ↗
7. A Data Rate and Concurrency Balanced Approach for Broadcast in Wireless Mesh Networks10.1109/TWC.2014.2329295 ↗
8. Routing and scheduling co-design for holistic software-defined deterministic network10.1016/j.fmre.2023.11.007 ↗
9. A deep reinforcement learning algorithm for heterogeneous industrial tasks with high concurrent computing offloading
10. Specification of Guaranteed Quality of Service
11. A ConvNets-based approach for capturing the heterogeneity of spatial domain in parallel geoprocessing10.1080/17538947.2024.2398066 ↗
12. Lamti, L., and Afifi, H. (1998, January 26–29). The fair shaper: An efficient mechanism for Internet bandwidth share over ATM in a multitasks OS. Proceedings of the 1998 IEEE ATM Workshop Proceedings. ‘Meeting the Challenges of Deploying the Global Broadband Network Infrastructure’ (Cat. No.98EX164), Fairfax, VA, USA.
13. Dynamic versus Static Traffic Policing: A New Approach for Videoconference Traffic over Wireless Cellular Networks10.1109/TMC.2009.18 ↗
14. Cavalca, U., Mesquita, C.M., Pereira, A.M., and Carrano, E.G. (2013, January 20–23). A computational intelligence based approach for computer network traffic shaping. Proceedings of the 2013 IEEE Congress on Evolutionary Computation, Cancun, Mexico.10.1109/CEC.2013.6557893 ↗
15. Kale, M.R., Labhane, S., Manu, S.E., Mehta, P., Amudha, A., and Gupta, A. (2024, January 24–28). Scalable and Efficient Real-Time Data Processing in Cloud-Based Manufacturing Systems. Proceedings of the 2024 15th International Conference on Computing Communication and Networking Technologies (ICCCNT), Kamand, India.10.1109/ICCCNT61001.2024.10725934 ↗
16. Efficient Dynamic Resource Management for Spatial Multitasking GPUs10.1109/TCC.2024.3511548 ↗
17. New directions in communications (or which way to the information age?)10.1109/MCOM.1986.1092946 ↗
18. General Characterization Parameters for Integrated Service Network Elements
19. Rabie, S. (2005, July 01). A Differentiated Service Two-Rate, Three-Color Marker with Efficient Handling of in-Profile Traffic. Available online: https://www.rfc-editor.org/rfc/rfc4115.
20. Lee, C.H., and Kim, Y.T. (2013, January 28–30). QoS-aware hierarchical token bucket (QHTB) queuing disciplines for QoS-guaranteed Diffserv provisioning with optimized bandwidth utilization and priority-based preemption. Proceedings of the International Conference on Information Networking 2013 (ICOIN), Bangkok, Thailand.
21. BCube-based Data Center Network Simulation Using NS3
22. Traffic Survey System Based on GPS, GPRS and GIS10.4028/www.scientific.net/AMR.328-330.989 ↗
23. Ali, A., Hutchison, D., Angelov, P., and Smith, P. (2013, January 9–11). Towards an autonomous resilience strategy the implementation of a self evolving rate limiter. Proceedings of the 2013 13th UK Workshop on Computational Intelligence (UKCI), Guildford, UK.10.1109/UKCI.2013.6651320 ↗
24. Peng, Y., Liu, Q., and Varman, P. (2019, January 20–24). Scalable QoS for Distributed Storage Clusters using Dynamic Token Allocation. Proceedings of the 2019 35th Symposium on Mass Storage Systems and Technologies (MSST), Santa Clara, CA, USA.10.1109/MSST.2019.00-19 ↗
25. Zhao, W., and Stankovic, J.A. (1989, January 5–7). Performance analysis of FCFS and improved FCFS scheduling algorithms for dynamic real-time computer systems. Proceedings of the 1989 Real-Time Systems Symposium, Santa Monica, CA, USA.
26. Analisis Quality of Service (QoS) Jaringan Internet Universitas Menggunakan Metode Hierarchical Token Bucket (HTB)
27. Anitha, P., Vimala, H.S., and Shreyas, J. (2023, January 7–9). PQTBA: Priority Queue based Token Bucket Algorithm for congestion control in IoT network. Proceedings of the 2023 IEEE 8th International Conference for Convergence in Technology (I2CT), Lonavla, India.
28. Simulation of Token Bucket Algorithm for Network Traffic Performance
29. TBDB: Token bucket-based dynamic batching for resource scheduling supporting neural network inference in intelligent consumer electronics10.1109/TCE.2023.3339633 ↗
30. An efficient resource allocation to improve QoS of 5G slicing networks using general processor sharing-based scheduling algorithm10.1002/dac.4250 ↗
31. Balanced fair resource sharing in computer clusters10.1016/j.peva.2017.08.006 ↗
32. Impact of Channel Memory on the Data Freshness10.1109/LCOMM.2022.3220538 ↗
33. An adaptive task scheduling algorithm for 3-D target imaging in radar network10.1186/s13634-022-00866-3 ↗
34. Rong, J., Liu, F., Miao, Y., Zhu, H., and Wu, C. (2023). Adaptive Task Scheduling Algorithm for Multifunction Integrated System with Joint Radar–Communications Waveform. Electronics, 12.10.3390/electronics12071560 ↗
35. Maqbool, A., Usmani, Z.u.A., Afzal, F., and Razia, A. (2020). Disaster Mitigation in Urban Pakistan Using Agent Based Modeling with GIS. ISPRS Int. J. Geo-Inf., 9.10.3390/ijgi9040203 ↗
36. Measures of Performance in the M/M/1/N Queue via the Methods of Order Statistics
37. Fiorini, P.M. (2021, January 22–25). Analyzing the Busy Period of the M/M/1 Queue via Order Statistics and Record Values. Proceedings of the 2021 11th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS), Cracow, Poland.10.1109/IDAACS53288.2021.9660840 ↗
38. Resource Scheduling and Load Balancing Algorithms in Cloud Computing10.1016/j.procs.2023.12.088 ↗
39. An effective scheduling in data centres for efficient CPU usage and service level agreement fulfilment using machine learning10.1080/09540091.2021.1926929 ↗
40. Memory Usage Estimation for Dataflow-Model-Based Software Development Methodology10.1109/MDAT.2023.3286333 ↗
41. Evaluation Test and Improvement of Load Balancing Algorithms of Nginx10.1109/ACCESS.2022.3146422 ↗
42. Shahid, M.A., Alam, M.M., and Su’ud, M.M. (2023). Performance Evaluation of Load-Balancing Algorithms with Different Service Broker Policies for Cloud Computing. Appl. Sci., 13.10.3390/app13031586 ↗
43. Li, C., Zheng, J., Okamura, H., and Dohi, T. (2023). Performance Evaluation of a Cloud Datacenter Using CPU Utilization Data. Mathematics, 11.10.3390/math11030513 ↗
44. SDNRoute: Proactive routing optimization in Software Defined Networks10.1016/j.comcom.2024.07.015 ↗