Efficient Flexible M-tree Bulk Loading Using FastMap and Space-filling Curves
Source abstract
Abstract
Many database applications currently deal with objects in a metric space. Examples of such objects include unstructured multimedia objects and points of interest (POIs) in a road network. The M-tree is a dynamic index structure that facilitates an efficient search for objects in a metric space. Studies have been conducted on the bulk loading of large datasets in an M-tree. However, because previous algorithms involve excessive distance computations and disk accesses, they perform poorly in terms of their index construction and search capability. This study proposes two efficient M-tree bulk loading algorithms. Our algorithms minimize the number of distance computations and disk accesses using FastMap and a space-filling curve, thereby significantly improving the index construction and search performance. Our second algorithm is an extension of the first, and it incorporates a partitioning clustering technique and flexible node architecture to further improve the search performance. Through the use of various synthetic and real-world datasets, the experimental results demonstrated that our algorithms improved the index construction performance by up to three orders of magnitude and the search performance by up to 20.3 times over the previous algorithm.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Data Management and Algorithms · Advanced Image and Video Retrieval Techniques · Image Retrieval and Classification Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (27)
Show source-provided references
1. Image retrieval: Ideas, influences, and trends of the new age10.1145/1348246.1348248 ↗
2. Kernelized locality-sensitive hashing for scalable image search
3. Content-based image retrieval at the end of the early years10.1109/34.895972 ↗
4. Efficient AKNN spatial network queries using the M-treeGeographic Information Systems
5. Efficient approximation of spatial network queries using the M-tree with road network embedding Statistical Database Management
6. Aggregate nearest neighbor queries in road networks10.1109/TKDE.2005.87 ↗
7. M-tree: An efficient access method for similarity search in metric spaces
8. Index-driven similarity search in metric spaces10.1145/958942.958948 ↗
9. Indexing the distance: An efficient method to KNN processing
10. Bulk loading the M-tree
11. A parallel bulk loading algorithm for M-tree on multi-core CPUs
12. Bulk loading the M-tree to enhance query performance
13. k-nearest neighbors on road networks: A journey in experimentation and in-memory implementation10.14778/2904121.2904125 ↗
14. Flexible aggregate nearest neighbor queries in road networks
15. FastMap: A fast algorithm for indexing, data-mining and visualization of traditional and multimedia datasets
16. Hilbert R-tree: An improved R-tree using fractals
17. Borg · Classical Scaling, in Modern Multidimensional Scaling: Theory and Applications · 2005 · 261
18. Global versus local methods in nonlinear dimensionality reduction
19. Han · Data Mining: Concepts and Techniques · 2012 · 443
20. The X-tree: An index structure for high-dimensional data
21. On packing R-trees
22. Scalable single source shortest path algorithms for massively parallel systems
23. Contraction hierarchies: Faster and simpler hierarchical routing in road networks
24. Hierarchical graph embedding for efficient query processing in very large traffic networks
25. Massively parallel a* search on a GPU
26. A hub-based labeling algorithm for shortest paths in road networks
27. Fast shortest-path distance queries on road networks by pruned highway labeling