An Active File Mode Transition Mechanism Based on Directory Activation Ratio in File Synchronization Service
Source abstract
Abstract
In this paper, we propose an active file mode change mechanism in which the file synchronization system of cloud storage automatically changes files in a directory of a client to the online or local mode by considering tradeoff between local storage usage and file access time according to directory activation ratio. When the directory activation ratio rises above a certain threshold, the proposed active file mode change mechanism selects online mode files in this directory based on file access delay time and local storage usage and changes them to the local mode to reduce file access delay of active IoT clients. When the directory activation ratio falls below the threshold, the active file mode change mechanism selects the local mode files based on the last access time and local storage usage and changes them to the online mode to increase available local storage. Experimental results show that the proposed active file mode change mechanism can control when and how much the client can reduce and increase the local storage usage and the file access delay by changing file mode parameters according to the requirements of various IoT devices.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: IoT and Edge/Fog Computing · Cloud Computing and Resource Management · Caching and Content Delivery
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Smart ICT Convergence, Konkuk University, 120 Neungdong-ro, Gwangjin-gu, Seoul 05029, Republic of Korea
Funding
National Research Foundation of Korea (NRF)
References (34)
Show source-provided references
1. Tridgell, A. (1999). Efficient Algorithm for Sorting and Synchronization. [Ph.D. Thesis, Australian National University].
2. An Architecture for Synchronising Cloud File Storage and Organisation Repositories10.1080/17445760.2017.1422500 ↗
3. Drago, I., Bocchi, E., Mellia, M., Slatman, H., and Pras, A. (2013, January 23–25). Benchmarking Personal Cloud Storage. Proceedings of the 2013 Conference on Internet Measurement Conference, Barcelona, Spain.10.1145/2504730.2504762 ↗
4. Li, Z., Wilson, C., Jiang, Z., Liu, Y., Zhao, B.Y., Jin, C., Zhang, Z., and Dai, Y. (2013, January 9–13). Efficient Batched Synchronization in Dropbox-like Cloud Storage Services. Proceedings of the ACM/IFIP/USENIX 14th International Middleware Conference, Beijing, China.10.1007/978-3-642-45065-5_16 ↗
5. Han, S., Shen, H., Kim, T., Krishnamurthy, A., Anderson, T., and Wetherall, D. (2015, January 8–10). MetaSync: File Synchronization Across Multiple Untrusted Storage Services. Proceedings of the USENIX Annual Technical Conference, Santa Clara, CA, USA.
6. Lopez, P.G., Sanchez-Artigas, M., Toda, S., Cotes, C., and Lenton, J. (2014, January 9–13). StackSync: Bringing Elasticity to Dropbox-like File Synchronization. Proceedings of the ACM/IFIP/USENIX 15th International Middleware Conference, Bordeux, France.10.1145/2663165.2663332 ↗
7. A Quantitative and Comparative Study of Network-level Efficiency for Cloud Storage Services10.1145/3274526 ↗
8. Drago, I., Mellia, M., Munafo, M.M., Sperotto, A., Sadre, R., and Pras, A. (2012, January 14–16). Inside Dropbox: Understanding Personal Cloud Storage Services. Proceedings of the 2012 Internet Measurement Conference, Boston, MA, USA.10.1145/2398776.2398827 ↗
9. (2022, September 29). Dropbox Smart Sync. Available online: https://www.dropbox.com/business/smartsync.
10. OneDrive (2022, September 29). Available online: https://onedrive.live.com/.
11. Google Drive (2022, September 29). Available online: https://www.google.com/drive/.
12. Howard, J., Kazar, M., Menees, S., Nichols, D., Satyanarayanan, M., Sidebotham, R.N., and West, M. (1987, January 8–11). Scale and Performance in a Distributed File System. Proceedings of the eleventh ACM Symposium on Operating Systems Principles, Austin, TX, USA.10.1145/41457.37500 ↗
13. Disconnected Operation in the Code File System10.1145/146941.146942 ↗
14. Bessani, A., Mendes, R., Oliveira, T., Neves, N., Correia, M., Pasin, M., and Verissimo, P. (2014, January 19–20). SCFS: A Shared Cloud-backed File System. Proceedings of the USENIX Annual Technical Conference, Philadelphia, PA, USA.
15. The Google File System10.1145/1165389.945450 ↗
16. Muniswamy-Reddy, K.K., Macko, P., and Seltzer, M. (2010, January 23–26). Provenance for the Cloud. Proceedings of the 8th USENIX Conference on File and Storage Technologies, San Jose, CA, USA.
17. CSTORE: A Desktop-oriented Distributed Public Cloud Storage System10.1016/j.compeleceng.2014.11.001 ↗
18. Shvachko, K., Kuang, H., Radia, S., and Chansler, R. (2010, January 3–7). The Hadoop Distributed File System. Proceedings of the IEEE 26th Symposium on Mass Storage Systems and Technologies, Incline Village, NV, USA.10.1109/MSST.2010.5496972 ↗
19. Chen, H., Zhou, E., Liu, J., and Zhang, Z. (2019, January 8–10). An RNN Based Mechanism for File Prefetching. Proceedings of the 18th International Symposium on Distributed Computing and Applications for Business Engineering and Science, Wuhan, China.10.1109/DCABES48411.2019.00011 ↗
20. (2023, April 21). GlusterFS: A Scalable Network Filesystem. Available online: http://www.gluster.org/.
21. Soundararajan, G., Mihailescu, M., and Amza, C. (2008, January 22–27). Context-Aware Prefetching at The Storage Server. Proceedings of the USENIX 2008 Annual Technical Conference, Boston, MA, USA.
22. Lin, L., Li, X., Jiang, H., Zhu, Y., and Tian, L. (2008, January 19–22). AMP: Affinity-Based Metadata Prefetching Scheme in Large-Scale Distributed Storage Systems. Proceedings of the Eighth IEEE International Symposium on Cluster Computing and the Grid, Lyon, France.10.1109/CCGRID.2008.117 ↗
23. (2023, March 28). ArchiverFS. Available online: https://www.mlteksoftware.com/Products/ArchiverFS/Index.aspx.
24. DataCore (2023, March 28). Available online: https://www.datacore.com/blog/active-archive-object-storage/.
25. (2023, April 04). Amazon S3 Intelligent-Tiering. Available online: https://aws.amazon.com/de/blogs/storage/automatically-archive-and-restore-data-with-amazon-s3-intelligent-tiering/.
26. Cherubini, G., Kim, Y., Lantz, M., and Venkatesan, V. (2017, January 18–21). Data Prefetching for Large Tiered Storage Systems. Proceedings of the IEEE International Conference on Data Mining, New Orleans, LA, USA.10.1109/ICDM.2017.99 ↗
27. Alturkestani, T., Tonellot, T., Ltaief, H., Abdelkhalak, R., Etienne, V., and Keyes, D. (2019, January 17–20). MLBS: Transparent Data Caching in Hierarchical Storage for Out-of-Core HPC Applications. Proceedings of the IEEE 26th International Conference on High Performance Computing, Data, and Analytics, Hyderabad, India.10.1109/HiPC.2019.00046 ↗
28. Qian, Y., Li, X., Ihara, S., Dilger, A., Thomaz, C., Wang, S., Cheng, W., Li, C., Zeng, L., and Wang, F. (2019, January 17–19). LPCC: Hierarchical Persistent Client Caching for Lustre. Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, Denver, CO, USA.10.1145/3295500.3356139 ↗
29. Khot, T., Mathew, V., and Shenoy, P. (2010). Adaptive Filetype Aware Prefetching, Department of Computer Sciences, University of Wisconsin.
30. Devarajan, H., Kougkas, A., and Sun, X. (2020, January 18–22). HFetch: Hierarchical Data Prefetching for Scientific Workflows in Multi-Tiered Storage Environments. Proceedings of the IEEE International Parallel and Distributed Processing Symposium, New Orleans, LA, USA.10.1109/IPDPS47924.2020.00017 ↗
31. The Part-time Parliament10.1145/279227.279229 ↗
32. C2CFTP: Direct and Indirect File Transfer Protocols between Clients in Client-server Architecture10.1109/ACCESS.2020.2998725 ↗
33. A File Synchronization Framework Based on Rsync Protocol for Cloud Storage Services10.5370/KIEE.2022.71.8.1164 ↗
34. Moon, Y., and Lim, M. (2019). An Enhanced File Transfer Mechanism Using Additional Blocking Communication Channel and Thread for IoT Environments. Sensors, 19.10.3390/s19061271 ↗