Research on Multicore Key-Value Storage System for Domain Name Storage
Source abstract
Abstract
This article proposes a domain name caching method for the multicore network-traffic capture system, which significantly improves insert latency, throughput and hit rate. The caching method is composed of caching replacement algorithm, cache set method. The method is easy to implement, low in deployment cost, and suitable for various multicore caching systems. Moreover, it can reduce the use of locks by changing data structures and algorithms. Experimental results show that compared with other caching system, our proposed method reaches the highest throughput under multiple cores, which indicates that the cache method we proposed is best suited for domain name caching.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Caching and Content Delivery · Peer-to-Peer Network Technologies · Advanced Data Storage Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
The Institute of Acoustics of the Chinese Academy of Sciences, 1921 North Fourth Ring West Road, Haidian District, Beijing 100190, China
School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
Funding
Strategic Science and Technology Pilot Project of the Chinese Academy of Sciences: SEANET Technology Standardization Research and System Development
References (40)
Show source-provided references
1. Atikoglu, B., Xu, Y., Frachtenberg, E., Jiang, S., and Paleczny, M. (2012, January 11–15). Workload analysis of a large-scale key-value store. Proceedings of the 12th ACM Sigmetrics/Performance Joint International Conference on Measurement and Modeling of Computer Systems, London, UK.10.1145/2254756.2254766 ↗
2. Marathe, V.J., Seltzer, M., Byan, S., and Harris, T. (2017, January 10–11). Persistent memcached: Bringing legacy code to byte-addressable persistent memory. Proceedings of the 9th {USENIX} Workshop on Hot Topics in Storage and File Systems (HotStorage 17), Santa Clara, CA, USA.
3. Kim, H., and Rajkumar, R. (2016, January 2–7). Real-time cache management for multi-core virtualization. Proceedings of the 2016 International Conference on Embedded Software (EMSOFT), Pittsburgh, PA, USA.10.1145/2968478.2968480 ↗
4. Blankstein, A., Sen, S., and Freedman, M.J. (2017, January 12–14). Hyperbolic caching: Flexible caching for web applications. Proceedings of the 2017 {USENIX} Annual Technical Conference ({USENIX} {ATC} 17), Santa Clara, CA, USA.
5. Dynamo: Amazon’s highly available key-value store10.1145/1323293.1294281 ↗
6. Mao, Y., Kohler, E., and Morris, R.T. (2012, January 10–13). Cache craftiness for fast multicore key-value storage. Proceedings of the 7th ACM European Conference on Computer Systems, Bern, Switzerland.10.1145/2168836.2168855 ↗
7. Wu, F., Yang, M.H., Zhang, B., and Du, D.H. (2020, January 15–17). AC-Key: Adaptive Caching for LSM-based Key-Value Stores. Proceedings of the 2020 {USENIX} Annual Technical Conference ({USENIX} {ATC} 20), Virtual, Online.
8. Tokusashi, Y., and Matsutani, H. (2016, January 24–26). A multilevel NOSQL cache design combining in-NIC and in-kernel caches. Proceedings of the 2016 IEEE 24th Annual Symposium on High-Performance Interconnects (HOTI), Santa Clara, CA, USA.10.1109/HOTI.2016.022 ↗
9. Jin, X., Li, X., Zhang, H., Soulé, R., Lee, J., Foster, N., Kim, C., and Stoica, I. (2017, January 28–31). Netcache: Balancing key-value stores with fast in-network caching. Proceedings of the 26th Symposium on Operating Systems Principles, Shanghai, China.10.1145/3132747.3132764 ↗
10. Wu, X., Zhang, L., Wang, Y., Ren, Y., Hack, M., and Jiang, S. (2016, January 18–21). zexpander: A key-value cache with both high performance and fewer misses. Proceedings of the Eleventh European Conference on Computer Systems, London, UK.10.1145/2901318.2901332 ↗
11. Chen, Y., Lu, Y., Yang, F., Wang, Q., Wang, Y., and Shu, J. (2020, January 16–20). FlatStore: An efficient log-structured key-value storage engine for persistent memory. Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems, Lausanne, Switzerland.10.1145/3373376.3378515 ↗
12. Eisenman, A., Cidon, A., Pergament, E., Haimovich, O., Stutsman, R., Alizadeh, M., and Katti, S. (2017). Flashield: A key-value cache that minimizes writes to flash. arXiv.
13. Chen, L., Li, J., Ma, R., Guan, H., and Jacobsen, H.A. (2019, January 9–13). EnclaveCache: A secure and scalable key-value cache in multi-tenant clouds using Intel SGX. Proceedings of the 20th International Middleware Conference, Davis, CA, USA.10.1145/3361525.3361533 ↗
14. Yang, J., Yue, Y., and Rashmi, K. (2020, January 4–6). A large scale analysis of hundreds of in-memory cache clusters at Twitter. Proceedings of the 14th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 20), Banff, AB, Canada.
15. LR-LRU: A PACS-Oriented intelligent cache replacement policy10.1109/ACCESS.2019.2913961 ↗
16. Waldspurger, C., Saemundsson, T., Ahmad, I., and Park, N. (2017, January 12–14). Cache modeling and optimization using miniature simulations. Proceedings of the 2017 {USENIX} Annual Technical Conference ({USENIX} {ATC} 17), Santa Clara, CA, USA.
17. Didacache: An integration of device and application for flash-based key-value caching10.1145/3203410 ↗
18. Jia, Y., Shao, Z., and Chen, F. (2018, January 9–11). SlimCache: Exploiting data compression opportunities in flash-based key-value caching. Proceedings of the 2018 IEEE 26th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), Milwaukee, WI, USA.10.1109/MASCOTS.2018.00029 ↗
19. Idreos, S., and Callaghan, M. (2020, January 14–19). Key-Value Storage Engines. Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, Portland, OR, USA.10.1145/3318464.3383133 ↗
20. Capability for multi-core and many-core memory systems: A case-study with xeon processors10.1109/ACCESS.2018.2881460 ↗
21. Fan, B., Andersen, D.G., and Kaminsky, M. (2013, January 2–5). Memc3: Compact and concurrent memcache with dumber caching and smarter hashing. Proceedings of the 10th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 13), Lombard, IL, USA.
22. Chandramouli, B., Prasaad, G., Kossmann, D., Levandoski, J., Hunter, J., and Barnett, M. (2018, January 10–15). Faster: A concurrent key-value store with in-place updates. Proceedings of the 2018 International Conference on Management of Data, Houston, TX, USA.10.1145/3183713.3196898 ↗
23. Lim, H., Han, D., Andersen, D.G., and Kaminsky, M. (2014, January 2–4). {MICA}: A holistic approach to fast in-memory key-value storage. Proceedings of the 11th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 14), Seattle, WA, USA.
24. Cphash: A cache-partitioned hash table10.1145/2370036.2145874 ↗
25. Lampson, B., and Lomet, D. (1993, January 24–27). A new presumed commit optimization for two phase commit. Proceedings of the 19th VLDB Conference, Dublin, Ireland.
26. Paxos made simple
27. An empirical evaluation of in-memory multi-version concurrency control10.14778/3067421.3067427 ↗
28. Lahiri, T., Chavan, S., Colgan, M., Das, D., Ganesh, A., Gleeson, M., Hase, S., Holloway, A., Kamp, J., and Lee, T.H. (2015, January 13–17). Oracle database in-memory: A dual format in-memory database. Proceedings of the 2015 IEEE 31st International Conference on Data Engineering, Seoul, Korea.10.1109/ICDE.2015.7113373 ↗
29. Wikipedia Contributors (2021, June 23). MySQL—Wikipedia, The Free Encyclopedia. Available online: https://en.wikipedia.org/wiki/MySQL.
30. Kemper, A., and Neumann, T. (2011, January 11–16). HyPer: A hybrid OLTP&OLAP main memory database system based on virtual memory snapshots. Proceedings of the 2011 IEEE 27th International Conference on Data Engineering, Washington, DC, USA.10.1109/ICDE.2011.5767867 ↗
31. Neumann, T., Mühlbauer, T., and Kemper, A. (June, January 31). Fast serializable multi-version concurrency control for main-memory database systems. Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, Melbourne, VIC, Australia.10.1145/2723372.2749436 ↗
32. Lim, H., Kaminsky, M., and Andersen, D.G. (2017, January 14–19). Cicada: Dependably fast multi-core in-memory transactions. Proceedings of the 2017 ACM International Conference on Management of Data, Chicago, IL, USA.10.1145/3035918.3064015 ↗
33. Stream-based live data replication approach of in-memory cache10.1002/cpe.4052 ↗
34. Efficient distributed memory management with RDMA and caching10.14778/3236187.3236209 ↗
35. A Multifunctional Full-Packet Capture and Network Measurement System Supporting Nanosecond Timestamp and Real-Time Analysis
36. Survey of Research on DPDK Technology Application
37. Breslau, L., Cao, P., Fan, L., Phillips, G., and Shenker, S. (1999, January 21–25). Web caching and Zipf-like distributions: Evidence and implications. Proceedings of the IEEE INFOCOM ’99. Conference on Computer Communications, Proceedings, Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies, The Future is Now (Cat. No.99CH36320), New York, NY, USA.10.1109/INFCOM.1999.749260 ↗
38. Wikipedia Contributors (2021, June 23). Verisign—Wikipedia, The Free Encyclopedia. Available online: https://en.wikipedia.org/wiki/Verisign.
39. Tokusashi, Y., Matsutani, H., and Zilberman, N. (2018). Lake: An energy efficient, low latency, accelerated key-value store. arXiv.
40. Put an elephant into a fridge: Optimizing cache efficiency for in-memory key-value stores10.14778/3397230.3397247 ↗