Key-Value Store Coupled with an Operating System for Storing Large-Scale燰alues
Source abstract
Abstract
The key-value store can provide flexibility of data types because it does not need to specify the data types to be stored in advance and can store any types of data as the value of the key-value pair. Various types of studies have been conducted to improve the performance of the key-value store while maintaining its flexibility. However, the research efforts storing the large-scale values such as multimedia data files (e.g., images or videos) in the key-value store were limited. In this study, we propose a new key-value store, WR-Store++ aiming to store the large-scale values stably. Specifically, it provides a new design of separating data and index by working with the built-in data structure of the Windows operating system and the file system. The utilization of the built-in data structure of the Windows operating system achieves the efficiency of the key-value store and that of the file system extends the limited space of the storage significantly. We also present chunk-based memory management and parallel processing of WR-Store++ to further improve its performance in the GET operation. Through the experiments, we show that WR-Store++ can store at least 32.74 times larger datasets than the existing baseline key-value store, WR-Store, which has the limitation in storing large-scale data sets. Furthermore, in terms of processing efficiency, we show that WR-Store++ outperforms not only WR-Store but also the other state-of-the-art key-value stores, LevelDB, RocksDB, and BerkeleyDB, for individual key-value operations and mixed workloads.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Data Storage Technologies · Cloud Computing and Resource Management · Peer-to-Peer Network Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (35)
Show source-provided references
1. Big data platform architecture under the background of financial technology: In the insurance industry as an example
2. Bbridge: A big data platform for social multimedia analytics
3. Big building data-A big data platform for smart buildings10.1016/j.egypro.2017.07.354 ↗
4. Big data-based improved data acquisition and storage system for designing industrial data platform10.1109/ACCESS.2019.2909060 ↗
5. A complete and fast scraping method for collecting tweets
6. A new text classification model based on contrastive word embedding for detecting cybersecurity intelligence in twitter10.3390/electronics9091527 ↗
7. Cyberattack detection model using community detection and text analysis on social media
8. Real and synthetic data sets for benchmarking key-value stores focusing on various data types and sizes10.1016/j.dib.2020.105441 ↗
9. Dynamo: Amazon’s highly available key-value store10.1145/1323293.1294281 ↗
10. F4: Facebook’s warm {BLOB} storage system
11. Wisckey: Separating keys from values in SSD-conscious storage10.1145/3033273 ↗
12. SlimDB: A space-efficient key-value storage engine for semi-sorted data
13. NVLSM: A persistent memory key-value store using log-structured merge tree with accumulative compaction
14. Reducing tail latency of LSM-tree based key-value store via limited compaction
15. Kvell: The design and implementation of a fast persistent key-value store
16. Optimal bloom filters and adaptive merging for LSM-trees10.1145/3276980 ↗
17. SineKV Decoupled secondary indexing for LSM-based key-value stores
18. ElasticBF: Elastic bloom filter with hotness awareness for boosting read performance in large key-value stores
19. Chucky: A succinct cuckoo filter for LSM-tree
20. Mega-KV: A case for gpus to maximize the throughput of in-memory key-value stores10.14778/2809974.2809984 ↗
21. Kill two birds with one stone: Auto-tuning RocksDB for high bandwidth and low latency
22. Constructing a lightweight key-value store based on the windows native features10.3390/app9183801 ↗
23. Analysis of SSD internal cache problem in a key-value store system
24. KVCG: A heterogeneous key-value store for skewed workloads
25. Workload analysis of a large-scale key-value store
26. Impacts of delayed replication on the key-value store
27. Kv-direct: High-performance in-memory key-value store with programmable NIC
28. HyperDex: A distributed, searchable key-value store
29. Nova-LSM: A distributed, component-based LSM-tree key-value store
30. Comet: An active distributed key-value store
31. Autoplacer: Scalable self-tuning data placement in distributed key-value stores
32. Object-based storage10.1109/MCOM.2003.1222722 ↗
33. Comparison between Amazon S3 and google cloud drive
34. Cloud storage comparative analysis amazon simple storage vs. Microsoft azure blob storage10.18178/ijmlc.2018.8.1.668 ↗
35. Redundancy analysis and elimination on access patterns of the windows applications based on I/O log data10.1109/ACCESS.2020.2964260 ↗