journal article·2025-03-31Open access

A Secure and Efficient Framework for Multimodal Prediction Tasks in Cloud Computing with Sliding-Window Attention Mechanisms

Weiyuan Cui, Qianye Lin, Jiaqi Shi, Xingyu Zhou, Zeyue Li, Haoyuan Zhan, Yihan Qin, Chunli Lv

Applied Sciences· Volume 15· Issue 7

Abstract

An efficient and secure computation framework based on the sliding-window attention mechanism and sliding loss function was proposed to address challenges in temporal and spatial feature modeling for multimodal data processing. The framework aims to overcome the limitations of traditional methods in privacy protection, feature-capturing capabilities, and computational efficiency. The experimental results demonstrated that, in time-series data processing tasks, the proposed method achieved precision, recall, accuracy, and F1-score values of 0.95, 0.91, 0.93, and 0.93, respectively, significantly outperforming the federated learning, secure multi-party computation, homomorphic encryption, and TEE-based approaches. In spatial data processing tasks, these metrics reached 0.93, 0.90, 0.92, and 0.91, also surpassing all the comparative methods. Compared with the existing secure computation frameworks, the proposed approach substantially enhanced computational efficiency while minimizing accuracy loss, all while ensuring data privacy. These findings provide an efficient and reliable solution for privacy protection and data security in cloud computing environments. Furthermore, the research demonstrates significant theoretical value and practical potential in real-world scenarios such as financial forecasting and image analysis.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Traffic Prediction and Management Techniques · Privacy-Preserving Technologies in Data · Human Mobility and Location-Based Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

China Agricultural University, Beijing 100083, China

National School of Development, Peking University, Beijing 100871, China

School of Statistics, University of International Business and Economics, Beijing 100029, China

Beijing Foreign Studies University, Beijing 100089, China

College of Mathematics and Physics, North China Electric Power University, Beijing 102206, China

Capital University of Economics and Business, Beijing 100070, China

Beijing Forestry University, Beijing 100083, China

Funding

National Key Research and Development Program of China

References (52)

Show source-provided references
1. Zhou, S., Zhou, Z., Wang, C., Liang, Y., Wang, L., Zhang, J., Zhang, J., and Lv, C. (2024). A User-Centered Framework for Data Privacy Protection Using Large Language Models and Attention Mechanisms. Appl. Sci., 14.10.3390/app14156824 ↗
2. An, H., Ma, R., Yan, Y., Chen, T., Zhao, Y., Li, P., Li, J., Wang, X., Fan, D., and Lv, C. (2024). Finsformer: A Novel Approach to Detecting Financial Attacks Using Transformer and Cluster-Attention. Appl. Sci., 14.10.3390/app14010460 ↗
3. Al-Ansi, A., Al-Ansi, A.M., Muthanna, A., Elgendy, I.A., and Koucheryavy, A. (2021). Survey on intelligence edge computing in 6G: Characteristics, challenges, potential use cases, and market drivers. Future Internet, 13.10.3390/fi13050118 ↗
4. Arciniegas-Ayala, C., Marcillo, P., Valdivieso Caraguay, A.L., and Hernandez-Alvarez, M. (2024). Prediction of Accident Risk Levels in Traffic Accidents Using Deep Learning and Radial Basis Function Neural Networks Applied to a Dataset with Information on Driving Events. Appl. Sci., 14.10.3390/app14146248 ↗
5. Shen, J., Wang, N., Wan, Z., Luo, Y., Sato, T., Hu, Z., Zhang, X., Guo, S., Zhong, Z., and Li, K. (2022). Sok: On the semantic ai security in autonomous driving. arXiv.
6. Zhang, Y., Wang, H., Xu, R., Yang, X., Wang, Y., and Liu, Y. (2022). High-Precision Seedling Detection Model Based on Multi-Activation Layer and Depth-Separable Convolution Using Images Acquired by Drones. Drones, 6.10.3390/drones6060152 ↗
7. Zhang, Y., Liu, X., Wa, S., Liu, Y., Kang, J., and Lv, C. (2021). GenU-Net++: An Automatic Intracranial Brain Tumors Segmentation Algorithm on 3D Image Series with High Performance. Symmetry, 13.10.3390/sym13122395 ↗
8. An integration of blockchain and AI for secure data sharing and detection of CT images for the hospitals10.1016/j.compmedimag.2020.101812 ↗
9. Zhang, Y., He, S., Wa, S., Zong, Z., Lin, J., Fan, D., Fu, J., and Lv, C. (2022). Symmetry GAN detection network: An automatic one-stage high-accuracy detection network for various types of lesions on CT images. Symmetry, 14.10.3390/sym14020234 ↗
10. Li, Q., Zhang, Y., Ren, J., Li, Q., and Zhang, Y. (2024). You Can Use But Cannot Recognize: Preserving Visual Privacy in Deep Neural Networks. arXiv.10.14722/ndss.2024.241361 ↗
11. Li, Q., and Zhang, Y. (2024, January 5–7). Confidential Federated Learning for Heterogeneous Platforms against Client-Side Privacy Leakages. Proceedings of the ACM-TURC ’24: ACM Turing Award Celebration Conference-China 2024, Changsha, China.10.1145/3674399.3674484 ↗
12. Song, L., Wang, J., Wang, Z., Tu, X., Lin, G., Ruan, W., Wu, H., and Han, W. (2022, January 7–11). Pmpl: A robust multi-party learning framework with a privileged party. Proceedings of the CCS ’22: 2022 ACM SIGSAC Conference on Computer and Communications Security, Los Angeles, CA, USA.10.1145/3548606.3560697 ↗
13. Mammen, P.M. (2021). Federated learning: Opportunities and challenges. arXiv.
14. Arora, S., Beams, A., Chatzigiannis, P., Meiser, S., Patel, K., Raghuraman, S., Rindal, P., Shah, H., Wang, Y., and Wu, Y. (2023). Privacy-preserving financial anomaly detection via federated learning & multi-party computation. arXiv.10.1109/ACSACW65225.2024.00038 ↗
15. Odeh, A., Abdelfattah, E., and Salameh, W. (2024). Privacy-Preserving Data Sharing in Telehealth Services. Appl. Sci., 14.10.3390/app142310808 ↗
16. Privacy-preserving neural networks with homomorphic encryption: C hallenges and opportunities10.1007/s12083-021-01076-8 ↗
17. Leveraging asynchronous federated learning to predict customers financial distress
18. Ali, A., Pasha, M.F., Ali, J., Fang, O.H., Masud, M., Jurcut, A.D., and Alzain, M.A. (2022). Deep learning based homomorphic secure search-able encryption for keyword search in blockchain healthcare system: A novel approach to cryptography. Sensors, 22.10.3390/s22020528 ↗
19. Differential privacy for deep and federated learning: A survey10.1109/ACCESS.2022.3151670 ↗
20. Sander, T., Stock, P., and Sablayrolles, A. (2023, January 23–29). Tan without a burn: Scaling laws of dp-sgd. Proceedings of the 40th International Conference on Machine Learning, PMLR, Honolulu, HI, USA.
21. Wu, P., Ning, J., Shen, J., Wang, H., and Chang, E.C. (2022, January 24–28). Hybrid Trust Multi-party Computation with Trusted Execution Environment. Proceedings of the Network and Distributed Systems Security (NDSS) Symposium, San Diego, CA, USA.10.14722/ndss.2022.24173 ↗
22. Leveraging zero knowledge proofs for blockchain-based identity sharing: A survey of advancements, challenges and opportunities
23. Privacy-Preserving Recommendation Based on a Shuffled Federated Graph Neural Network10.1109/MIC.2023.3349288 ↗
24. Li, L., Gou, J., Yu, B., Du, L., and Tao, Z.Y.D. (2024). Federated distillation: A survey. arXiv.
25. A survey on federated learning: Challenges and applications10.1007/s13042-022-01647-y ↗
26. Kanchan, S., Jang, J.W., Yoon, J.Y., and Choi, B.J. (2024). GSFedSec: Group Signature-Based Secure Aggregation for Privacy Preservation in Federated Learning. Appl. Sci., 14.10.3390/app14177993 ↗
27. Li, Q., Ren, J., Zhang, Y., Song, C., Liao, Y., and Zhang, Y. (2023, January 9–13). Privacy-Preserving DNN Training with Prefetched Meta-Keys on Heterogeneous Neural Network Accelerators. Proceedings of the 2023 60th ACM/IEEE Design Automation Conference (DAC), San Francisco, CA, USA.10.1109/DAC56929.2023.10247964 ↗
28. Byrd, D., and Polychroniadou, A. (2020, January 15–16). Differentially private secure multi-party computation for federated learning in financial applications. Proceedings of the First ACM International Conference on AI in Finance, New York, NY, USA.10.1145/3383455.3422562 ↗
29. Liu, X., Liu, X., Zhang, R., Luo, D., Xu, G., and Chen, X. (2022). Securely Computing the Manhattan Distance under the Malicious Model and Its Applications. Appl. Sci., 12.10.3390/app122211705 ↗
30. Secure Multi-Party Computation for Machine Learning: A Survey10.1109/ACCESS.2024.3388992 ↗
31. Dhiman, S., Nayak, S., Mahato, G.K., Ram, A., and Chakraborty, S.K. (2023, January 16–18). Homomorphic encryption based federated learning for financial data security. Proceedings of the 2023 4th International Conference on Computing and Communication Systems (I3CS), Shillong, India.10.1109/I3CS58314.2023.10127502 ↗
32. A survey on homomorphic encryption schemes: Theory and implementation
33. Fan, J., and Vercauteren, F. (2025, March 27). Somewhat Practical Fully Homomorphic Encryption. Cryptology ePrint Archive. 2012; p. 144. Available online: https://eprint.iacr.org/2012/144.
34. Damgård, I., Pastro, V., Smart, N., and Zakarias, S. (2012). Multiparty computation from somewhat homomorphic encryption. Advances in Cryptology—CRYPTO 2012, Springer.10.1007/978-3-642-32009-5_38 ↗
35. Optimization of homomorphic comparison algorithm on rns-ckks scheme10.1109/ACCESS.2022.3155882 ↗
36. Zhang, Y., Yin, Z., Li, Y., Yin, G., Yan, J., Shao, J., and Liu, Z. (2020, January 23–28). Celeba-spoof: Large-scale face anti-spoofing dataset with rich annotations. Proceedings of the Computer Vision—ECCV 2020: 16th European Conference, Glasgow, UK. Part XII 16.10.1007/978-3-030-58610-2_5 ↗
37. ARIMA models to predict next-day electricity prices10.1109/TPWRS.2002.804943 ↗
38. LSTM: A search space odyssey10.1109/TNNLS.2016.2582924 ↗
39. Beltagy, I., Peters, M.E., and Cohan, A. (2020). Longformer: The long-document transformer. arXiv.
40. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗
41. Big bird: Transformers for longer sequences
42. Advances and open problems in federated learning10.1561/2200000083 ↗
43. A pragmatic introduction to secure multi-party computation10.1561/3300000019 ↗
44. Naehrig, M., Lauter, K., and Vaikuntanathan, V. (2011, January 21). Can homomorphic encryption be practical?. Proceedings of the 3rd ACM Workshop on Cloud Computing Security Workshop, Chicago, IL, USA.10.1145/2046660.2046682 ↗
45. Sabt, M., Achemlal, M., and Bouabdallah, A. (2015, January 20–22). Trusted execution environment: What it is, and what it is not. Proceedings of the 2015 IEEE Trustcom/BigDataSE/ISPA, Helsinki, Finland.10.1109/Trustcom.2015.357 ↗
46. Yang, Z., Li, P., Bao, Y., and Huang, X. (2020, January 12–14). Speeding Up Multivariate Time Series Segmentation Using Feature Extraction. Proceedings of the 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chongqing, China.10.1109/ITNEC48623.2020.9085218 ↗
47. Zhou, N., Zheng, Z., and Zhou, J. (2023, January 7–9). Prediction of the RUL of PEMFC based on multivariate time series forecasting model. Proceedings of the 2023 3rd International Symposium on Computer Technology and Information Science (ISCTIS), Chengdu, China.10.1109/ISCTIS58954.2023.10213070 ↗
48. Hybrid learning strategies for multivariate time series forecasting of network quality metrics10.1016/j.comnet.2024.110286 ↗
49. Saits: Self-attention-based imputation for time series10.1016/j.eswa.2023.119619 ↗
50. Forecasting gold price using a novel hybrid model with ICEEMDAN and LSTM-CNN-CBAM10.1016/j.eswa.2022.117847 ↗
51. Ramachandran, P., Parmar, N., Vaswani, A., Bello, I., Levskaya, A., and Shlens, J. (2019). Stand-alone self-attention in vision models. Advances in Neural Information Processing Systems, Curran Associates Inc.
52. 3DTCN-CBAM-LSTM short-term power multi-step prediction model for offshore wind power based on data space and multi-field cluster spatio-temporal correlation10.1016/j.apenergy.2024.124169 ↗