journal article·2025Open access

A Dynamic Deceptive Defense Framework for Zero-Day Attacks in IIoT: Integrating Stackelberg Game and Multi-Agent Distributed Deep Deterministic Policy Gradient

Shigen Shen, Xiaojun Ji, Yimeng Liu

Computers, Materials & Continua· Volume 85· Issue 2

Abstract

The Industrial Internet of Things (IIoT) is increasingly vulnerable to sophisticated cyber threats, particularly zero-day attacks that exploit unknown vulnerabilities and evade traditional security measures. To address this critical challenge, this paper proposes a dynamic defense framework named Zero-day-aware Stackelberg Game-based Multi-Agent Distributed Deep Deterministic Policy Gradient (ZSG-MAD3PG). The framework integrates Stackelberg game modeling with the Multi-Agent Distributed Deep Deterministic Policy Gradient (MAD3PG) algorithm and incorporates defensive deception (DD) strategies to achieve adaptive and efficient protection. While conventional methods typically incur considerable resource overhead and exhibit higher latency due to static or rigid defensive mechanisms, the proposed ZSG-MAD3PG framework mitigates these limitations through multi-stage game modeling and adaptive learning, enabling more efficient resource utilization and faster response times. The Stackelberg-based architecture allows defenders to dynamically optimize packet sampling strategies, while attackers adjust their tactics to reach rapid equilibrium. Furthermore, dynamic deception techniques reduce the time required for the concealment of attacks and the overall system burden. A lightweight behavioral fingerprinting detection mechanism further enhances real-time zero-day attack identification within industrial device clusters. ZSG-MAD3PG demonstrates higher true positive rates (TPR) and lower false alarm rates (FAR) compared to existing methods, while also achieving improved latency, resource efficiency, and stealth adaptability in IIoT zero-day defense scenarios.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Network Security and Intrusion Detection · Smart Grid Security and Resilience · Information and Cyber Security

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (57)

Show source-provided references
1. Anomaly detection of zero-day attacks based on CNN and regularization techniques10.3390/electronics12030573 ↗
2. Deep Q-network-based heuristic intrusion detection against edge-based SIoT zero-day attacks10.1016/j.asoc.2023.111080 ↗
3. A framework for detecting zero-day exploits in network flows10.1016/j.comnet.2024.110476 ↗
4. Joint mean-field game and multiagent asynchronous advantage actor-critic for edge intelligence-based IoT malware propagation defense10.1109/TDSC.2025.3542104 ↗
5. RT-A3C: real-time asynchronous advantage actor–critic for optimally defending malicious attacks in edge-enabled Industrial Internet of Things
6. A novel intrusion detection framework for industrial IoT: GCN-GRU architecture optimized with ant colony optimization10.1016/j.compeleceng.2025.110541 ↗
7. Resilient formation tracking for networked swarm systems under malicious data deception attacks10.1002/rnc.7777 ↗
8. Tight incentive analysis of Sybil attacks against the market equilibrium of resource exchange over general networks10.1016/j.geb.2024.10.009 ↗
9. CPS-IoT-PPDNN: a new explainable privacy preserving DNN for resilient anomaly detection in Cyber-Physical Systems-enabled IoT networks10.1016/j.chaos.2024.115939 ↗
10. Defending data poisoning attacks in DP-based crowdsensing: a game-theoretic approach10.1109/TMC.2024.3486689 ↗
11. Dealing with uncertainty in cybersecurity decision support10.1016/j.cose.2024.104153 ↗
12. Enabling intrinsic intelligence, ubiquitous learning and blockchain empowerment for trust and reliability in 6G network evolution10.1016/j.jksuci.2024.102041 ↗
13. A Contrastive-enhanced ensemble framework for efficient multi-agent reinforcement learning10.1016/j.eswa.2024.123158 ↗
14. Joint differential game and double deep Q-networks for suppressing malware spread in industrial Internet of Things10.1109/TIFS.2023.3307956 ↗
15. Multiagent deep deterministic policy gradient-based computation offloading and resource allocation for ISAC-aided 6G V2X networks10.1109/JIOT.2024.3432728 ↗
16. Deep Q-network-based open-set intrusion detection solution for Industrial Internet of Things10.1109/JIOT.2023.3333903 ↗
17. SGD3QN: joint stochastic games and dueling double deep Q-networks for defending malware propagation in edge intelligence-enabled Internet of Things10.1109/TIFS.2024.3420233 ↗
18. Deep learning for zero-day malware detection and classification: a survey10.1145/3605775 ↗
19. Zero-Ran Sniff: a zero-day ransomware early detection method based on zero-shot learning10.1016/j.cose.2024.103849 ↗
20. CPS-IIoT-P2Attention: explainable privacy-preserving with scaled dot-product attention in Cyber-Physical System-Industrial IoT network10.1109/ACCESS.2025.3566980 ↗
21. SIHQR model with time delay for worm spread analysis in IIoT-enabled PLC network10.1016/j.adhoc.2024.103504 ↗
22. SCIRD: revealing infection of malicious software in edge computing-enabled IoT networks
23. Novel intrusion detection strategies with optimal hyper parameters for industrial Internet of Things based on stochastic games and double deep Q-networks10.1109/JIOT.2024.3406386 ↗
24. Adversarial machine learning attacks and defences in multi-agent reinforcement learning10.1145/3708320 ↗
25. MFGD3QN: enhancing edge intelligence defense against DDoS with mean-field games and dueling double deep Q-network10.1109/JIOT.2024.3387090 ↗
26. Cyber-security and reinforcement learning—a brief survey10.1016/j.engappai.2022.105116 ↗
27. Resilience enhancement of multi-agent reinforcement learning-based demand response against adversarial attacks10.1016/j.apenergy.2022.119688 ↗
28. Multi-agent distributed deep learning algorithm to detect cyber-attacks in distance relays10.1109/ACCESS.2023.3239684 ↗
29. Enhancing cyber-resilience in electric vehicle charging stations: a multi-agent deep reinforcement learning approach10.1109/TITS.2024.3408238 ↗
30. Zero-day attack detection: a systematic literature review10.1007/s10462-023-10437-z ↗
31. A review of machine learning-based zero-day attack detection: challenges and future directions10.1016/j.comcom.2022.11.001 ↗
32. Comparative evaluation of AI-based techniques for zero-day attacks detection10.3390/electronics11233934 ↗
33. A systematic literature review on AI-based methods and challenges in detecting zero-day attacks10.1109/ACCESS.2024.3455410 ↗
34. From zero-shot machine learning to zero-day attack detection10.1007/s10207-023-00676-0 ↗
35. Zero-day guardian: a dual model enabled federated learning framework for handling zero-day attacks in 5G enabled IIoT10.1109/TCE.2023.3335385 ↗
36. NERO: neural algorithmic reasoning for zeRO-day attack detection in the IoT: a hybrid approach10.1016/j.cose.2024.103898 ↗
37. An adaptable deep learning-based intrusion detection system to zero-day attacks
38. An asset-based approach to mitigate zero-day ransomware attacks
39. Zero-X: a blockchain-enabled open-set federated learning framework for zero-day attack detection in IoV10.1109/TVT.2024.3385916 ↗
40. Stackelberg-game-based computation offloading method in cloud–edge computing networks10.1109/JIOT.2022.3153089 ↗
41. A Stackelberg game model for large-scale group decision making based on cooperative incentives10.1016/j.inffus.2023.03.013 ↗
42. Resource allocation in cognitive radio networks using Stackelberg game: a survey10.1007/s11277-021-08926-x ↗
43. Incentive mechanism for mobile crowdsensing with two-stage Stackelberg game
44. Stackelberg game-based resource allocation with blockchain for cold-chain logistics system
45. Optimal DoS attack strategy for cyber-physical systems: a Stackelberg game-theoretical approach10.1016/j.ins.2023.119134 ↗
46. UAV-aided computation offloading in mobile-edge computing networks: a Stackelberg game approach10.1109/JIOT.2022.3197155 ↗
47. Prescribed performance robust approximate optimal tracking control via Stackelberg game10.1109/TASE.2025.3549114 ↗
48. No-regret learning in dynamic Stackelberg games10.1109/TAC.2023.3330797 ↗
49. A policy gradient algorithm to alleviate the multi-agent value overestimation problem in complex environments10.3390/s23239520 ↗
50. Multiagent DRL-based consensus mechanism for blockchain-based collaborative computing in UAV-assisted 6G Networks10.1109/JIOT.2024.3484005 ↗
51. Joint Task Partitioning and resource allocation in RAV-enabled vehicular edge computing based on deep reinforcement learning10.1109/JIOT.2025.3527929 ↗
52. Advancing security and trust in WSNs: a federated multi-agent deep reinforcement learning approach10.1109/TCE.2024.3440178 ↗
53. Secure offloading with adversarial multi-agent reinforcement learning against intelligent eavesdroppers in UAV-enabled mobile edge computing10.1109/TMC.2024.3439016 ↗
54. Reputation-aware multi-agent DRL for secure hierarchical federated learning in IoT10.1109/OJCOMS.2023.3280359 ↗
55. Incentivizing proof-of-stake blockchain for secured data collection in UAV-assisted IoT: a multi-agent reinforcement learning approach10.1109/JSAC.2022.3213360 ↗
56. Applications of multi-agent reinforcement learning in future internet: a comprehensive survey10.1109/COMST.2022.3160697 ↗
57. Multi-agent reinforcement learning for privacy-aware distributed CNN in heterogeneous IoT surveillance systems10.1016/j.jnca.2024.103933 ↗