journal article·2020-03-02Open access

HI-Sky: Hash Index-Based Skyline Query Processing

Jong-Hyeok Choi, Fei Hao, Aziz Nasridinov

Applied Sciences· Volume 10· Issue 5

Abstract

The skyline query has recently attracted a considerable amount of research interest in several fields. The query conducts computations using the domination test, where “domination” means that a data point does not have a worse value than others in any dimension, and has a better value in at least one dimension. Therefore, the skyline query can be used to construct efficient queries based on data from a variety of fields. However, when the number of dimensions or the amount of data increases, naïve skyline queries lead to a degradation in overall performance owing to the higher cost of comparisons among data. Several methods using index structures have been proposed to solve this problem but have not improved the performance of skyline queries because their indices are heavily influenced by the dimensionality and data amount. Therefore, in this study, we propose HI-Sky, a method that can perform quick skyline computations by using the hash index to overcome the above shortcomings. HI-Sky effectively manages data through the hash index and significantly improves performance by effectively eliminating unnecessary data comparisons when computing the skyline. We provide the theoretical background for HI-Sky and verify its improvement in skyline query performance through comparisons with prevalent methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Data Management and Algorithms · Advanced Database Systems and Queries · Data Mining Algorithms and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, Chungbuk National University, Cheongju 28644, Korea

School of Computer Science, Shaanxi Normal University, Xi’an 710119, China

Department of Computer Science, College of Engineering, Mathematics and Physical Sciences, University of Exeter, Exeter EX4 4PY, UK

Funding

Ministry of Trade, Industry and Energy · National Research Foundation of Korea

References (36)

Show source-provided references
1. Skyline queries, front and back10.1145/2536669.2536671 ↗
2. Cui, B., Lu, H., Xu, Q., Chen, L., Dai, Y., and Zhou, Y. (2008, January 7–12). Parallel distributed processing of constrained skyline queries by filtering. Proceedings of the IEEE 24th International Conference on Data Engineering, Cancun, Mexico.10.1109/ICDE.2008.4497463 ↗
3. Skyline-based aggregator node selection in wireless sensor networks10.1155/2013/356194 ↗
4. Ranking and clustering web services using multicriteria dominance relationships10.1109/TSC.2010.14 ↗
5. Parallel computation of skyline and reverse skyline queries using mapreduce10.14778/2556549.2556580 ↗
6. Papadias, D., Tao, Y., Fu, G., and Seeger, B. (2003, January 9–12). An optimal and progressive algorithm for skyline queries. Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, San Diego, CA, USA.10.1145/872757.872814 ↗
7. Authenticating location-based skyline queries in arbitrary subspaces10.1109/TKDE.2013.137 ↗
8. R-trees: A dynamic index structure for spatial searching10.1145/971697.602266 ↗
9. Berchtold, S., Keim, D., and Kriegel, H. (2001). An index structure for high-dimensional data. Readings in Multimedia Computing and Networking, Morgan Kaufmann.
10. Z-sky: An efficient skyline query processing framework based on z-order10.1007/s00778-009-0166-x ↗
11. Lee, K., Zheng, B., Li, H., and Lee, W.-C. (2007, January 23–27). Approaching the skyline in Z order. Proceedings of the 33rd International Conference on Very large data Bases, Vienna, Austria.
12. Multidimensional access methods10.1145/280277.280279 ↗
13. Lawder, J.K., and King, P.J.H. (2000, January 3–5). Using Space-Filling Curves for Multi-dimensional Indexing. Proceedings of the 17th British National Conference on Databases, Exeter, UK.10.1007/3-540-45033-5_3 ↗
14. Zhang, S., Mamoulis, N., and Cheung, D.W. (July, January 29). Scalable skyline computation using object-based space partitioning. Proceedings of the 2009 ACM SIGMOD International Conference on Management of Data, New York, NY, USA.10.1145/1559845.1559897 ↗
15. Borzsonyi, S., Kossmann, D., and Stocker, K. (2001, January 2–6). The Skyline operator. Proceedings of the 17th International Conference on Data Engineering, Heidelberg, Germany.
16. Chomicki, J., Godfrey, P., Gryz, J., and Liang, D. (2003, January 5–8). Skyline with presorting. Proceedings of the 19th International Conference on Data Engineering, Bangalore, India.
17. Skyline with presorting: Theory and optimizations
18. Vlachou, A., Doulkeridis, C., and Kotidis, Y. (2008, January 9–12). Angle-based space partitioning for efficient parallel skyline computation. Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, Vancouver, BC, Canada.10.1145/1376616.1376642 ↗
19. Zhang, B., Zhou, S., and Guan, J. (2011, January 22–25). Adapting Skyline Computation to the MapReduce Framework: Algorithms and Experiments. Proceedings of the 16th International Conference on Database Systems for Advanced Applications, Hong Kong, China.10.1007/978-3-642-20244-5_39 ↗
20. Chen, L., Hwang, K., and Wu, J. (2012, January 21–25). MapReduce Skyline Query Processing with a New Angular Partitioning Approach. Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum, Shanghai, China.10.1109/IPDPSW.2012.279 ↗
21. Efficient Skyline Computation on Big Data10.1109/TKDE.2012.203 ↗
22. Efficient Processing of Skyline Queries Using MapReduce10.1109/TKDE.2017.2654459 ↗
23. Islam, M.S., Liu, C., Rahayu, W., and Anwar, T. (2016, January 24–28). Q+Tree: An Efficient Quad Tree based Data Indexing for Parallelizing Dynamic and Reverse Skylines. Proceedings of the 25th ACM International Conference on Information and Knowledge Management, Indianapolis, IN, USA.10.1145/2983323.2983764 ↗
24. Efficient Parallel Skyline Query Processing for High-Dimensional Data10.1109/TKDE.2018.2809598 ↗
25. Eldawy, A., and Mokbel, M.F. (2015, January 13–17). Spatialhadoop: A mapreduce framework for spatial data. Proceedings of the 2015 IEEE 31st International Conference on Data Engineering, Seoul, Korea.10.1109/ICDE.2015.7113382 ↗
26. Efficient skyline query processing in spatialhadoop10.1016/j.is.2014.10.003 ↗
27. Bayer, R., and McCreight, E. (2002). Organization and maintenance of large ordered indexes. Software Pioneers, Springer.10.1007/978-3-642-59412-0_15 ↗
28. Jensen, C., Lin, D., and Ooi, B. (September, January 31). Query and update efficient B+-tree based indexing of moving objects. Proceedings of the 30th International Conference on Very Large Data Bases, Toronto, Canada.
29. Lee, M.L., Hsu, W., Jensen, C.S., Cui, B., and Teo, K.L. (2003, January 9–12). Supporting frequent updates in R-trees: A bottom-up approach. Proceedings of the 29th International Conference on Very Large Data Bases, Berlin, Germany.
30. Lehman, T.J., and Carey, M.J. (1986, January 25–28). A Study of Index Structures for Main Memory Database Management Systems. Proceedings of the 12th International Conference on Very Large Data Bases, Kyoto, Japan.
31. Song, Z., and Roussopoulos, N. (2001, January 8–10). Hashing moving objects. Proceedings of the International Conference on Mobile Data Management, Hong Kong, China.10.1007/3-540-44498-X_13 ↗
32. Grid-PPPS: A Skyline Method for Efficiently Handling Top-k Queries in Internet of Things10.1155/2014/401618 ↗
33. Rocha-Junior, J.B., Vlachou, A., Doulkeridis, C., and Nørvåg, K. (2009, January 1–2). AGiDS: A grid-based strategy for distributed skyline query processing. Proceedings of the International Conference on Data Management in Grid and P2P Systems, Linz, Austria.10.1007/978-3-642-03715-3_2 ↗
34. Online decorrelation of humidity and temperature in chemical sensors for continuous monitoring10.1016/j.chemolab.2016.07.004 ↗
35. A survey on indexing techniques for big data: Taxonomy and performance evaluation10.1007/s10115-015-0830-y ↗
36. Belussi, A., Migliorini, S., and Eldawy, A. (2018, January 6–9). Detecting skewness of big spatial data in SpatialHadoop. Proceedings of the 26th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, New York, NY, USA.10.1145/3274895.3274923 ↗