journal article·2025-08-18Open access

CurriculumPT: LLM-Based Multi-Agent Autonomous Penetration Testing with Curriculum-Guided Task Scheduling

Xingyu Wu, Yunzhe Tian, Yuanwan Chen, Ping Ye, Xiaoshu Cui, Jingqi Jia, Shouyang Li, Jiqiang Liu, Wenjia Niu

Applied Sciences· Volume 15· Issue 16

Abstract

While autonomous driving systems and intelligent transportation infrastructures become increasingly software-defined and network-connected, ensuring their cybersecurity has become a critical component of traffic safety. Large language models (LLMs) have recently shown promise in automating aspects of penetration testing, yet most existing approaches remain limited to simple, single-step exploits. They struggle to handle complex, multi-stage vulnerabilities that demand precise coordination, contextual reasoning, and knowledge reuse. This is particularly problematic in safety-critical domains, such as autonomous vehicles, where subtle software flaws can cascade across interdependent subsystems. In this work, we present CurriculumPT, a novel LLM-based penetration testing framework specifically designed for the security of intelligent systems. CurriculumPT combines curriculum learning and a multi-agent system to enable LLM agents to progressively acquire and apply exploitation skills across common vulnerabilities and exposures-based tasks. Through a structured progression from simple to complex vulnerabilities, agents build and refine an experience knowledge base that supports generalization to new attack surfaces without requiring model fine-tuning. We evaluate CurriculumPT on 15 real-world vulnerabilities scenarios and demonstrate that it outperforms three state-of-the-art baselines by up to 18 percentage points in exploit success rate, while achieving superior efficiency in execution time and resource usage. Our results confirm that CurriculumPT is capable of autonomous, scalable penetration testing and knowledge transfer, laying the groundwork for intelligent security auditing of modern autonomous driving systems and other cyberphysical transportation platforms.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Software Engineering Research · Software Testing and Debugging Techniques · Software Reliability and Analysis Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Beijing Key Laboratory of Security and Privacy in Intelligent Transportation, Beijing Jiaotong University, Beijing 100044, China

School of Cyberspace Science and Techonology, Beijing Jiaotong University, Beijing 100044, China

School of Computer Science and Technology, Beijing Jiaotong University, Beijing 100044, China

Construction Department, China Railway Qinghai Tibet Group Co., Ltd., Xining 810000, China

Funding

the Central Funds Guiding the Local Science and Technology Development · Fundamental Research Funds for the Central Universities · the National Natural Science Foundation of China

References (49)

Show source-provided references
1. Software penetration testing10.1109/MSP.2005.23 ↗
2. About penetration testing10.1109/MSP.2007.159 ↗
3. Vulnerability assessment and penetration testing
4. Abu-Dabaseh, F., and Alshammari, E. (2018, January 28–29). Automated penetration testing: An overview. Proceedings of the 4th International Conference on Natural Language Computing, Dubai, UAE.10.5121/csit.2018.80610 ↗
5. Bilge, L., and Dumitraş, T. (2012, January 16–18). Before we knew it: An empirical study of zero-day attacks in the real world. Proceedings of the 2012 ACM Conference on Computer and Communications Security, Raleigh, NC, USA.10.1145/2382196.2382284 ↗
6. Wang, X., Sun, K., Batcheller, A., and Jajodia, S. (2019, January 24–27). Detecting “0-day” vulnerability: An empirical study of secret security patch in oss. Proceedings of the 2019 49th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Portland, OR, USA.10.1109/DSN.2019.00056 ↗
7. Tudosi, A.D., Graur, A., Balan, D.G., and Potorac, A.D. (2023). Research on security weakness using penetration testing in a distributed firewall. Sensors, 23.10.3390/s23052683 ↗
8. Chowdhary, A., Jha, K., and Zhao, M. (2023). Generative adversarial network (gan)-based autonomous penetration testing for web applications. Sensors, 23.10.3390/s23188014 ↗
9. Berenguer, A., Morejón, A., Tomás, D., and Mazón, J.N. (2024). Large language models to enhance the reusability of sensor data. Sensors, 24.10.3390/s24020347 ↗
10. Fu, M., Tantithamthavorn, C.K., Nguyen, V., and Le, T. (2023, January 4–7). ChatGPT for vulnerability detection, classification, and repair: How far are we?. Proceedings of the 2023 30th Asia-Pacific Software Engineering Conference (APSEC), Seoul, Republic of Korea.10.1109/APSEC60848.2023.00085 ↗
11. Happe, A., and Cito, J. (2023, January 3–9). Getting pwn’d by ai: Penetration testing with large language models. Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, San Francisco, CA, USA.10.1145/3611643.3613083 ↗
12. Deng, G., Liu, Y., Mayoral-Vilches, V., Liu, P., Li, Y., Xu, Y., Zhang, T., Liu, Y., Pinzger, M., and Rass, S. (2024, January 14–16). PentestGPT: Evaluating and harnessing large language models for automated penetration testing. Proceedings of the 33rd USENIX Security Symposium (USENIX Security 24), Philadelphia, PA, USA.
13. What if GPT4 became autonomous: The Auto-GPT project and use cases
14. Xu, J., Stokes, J.W., McDonald, G., Bai, X., Marshall, D., Wang, S., Swaminathan, A., and Li, Z. (2024). Autoattacker: A large language model guided system to implement automatic cyber-attacks. arXiv.
15. Wu, B., Chen, G., Chen, K., Shang, X., Han, J., He, Y., Zhang, W., and Yu, N. (2024). Autopt: How far are we from the end2end automated web penetration testing?. arXiv.
16. Kong, H., Hu, D., Ge, J., Li, L., Li, T., and Wu, B. (2025). VulnBot: Autonomous penetration testing for a multi-agent collaborative framework. arXiv.
17. Gao, L., Liu, Y., Chen, H., Liu, D., Zhang, Y., and Sun, J. (2025, January 15). Exploring traffic simulation and cybersecurity strategies using large language models. Proceedings of the 2025 IEEE Security and Privacy Workshops (SPW), San Francisco, CA, USA.10.1109/SPW67851.2025.00048 ↗
18. Shen, X., Wang, L., Li, Z., Chen, Y., Zhao, W., Sun, D., Wang, J., and Ruan, W. (2024). PentestAgent: Incorporating llm agents to automated penetration testing. arXiv.10.1145/3708821.3733882 ↗
19. Faillon, M.-A., Bout, B., Francq, J., Neal, C., Boulahia-Cuppens, N., Cuppens, F., and Yaich, R. (2024, January 16–20). How to better fit reinforcement Learning for pentesting: A new hierarchical approach. Proceedings of the European Symposium on Research in Computer Security, Bydgoszcz, Poland.10.1007/978-3-031-70903-6_16 ↗
20. Li, Q., Zhang, M., Shen, Y., Wang, R., Hu, M., Li, Y., and Hao, H. (2023). A hierarchical deep reinforcement learning model with expert prior knowledge for intelligent penetration testing. Comput. Secur., 132.10.1016/j.cose.2023.103358 ↗
21. Chen, J., Hu, S., Zheng, H., Xing, C., and Zhang, G. (2023). GAIL-PT: An intelligent penetration testing framework with generative adversarial imitation learning. Comput. Secur., 126.10.1016/j.cose.2022.103055 ↗
22. Schwartz, J. (2025, May 15). Network Attack Simulator. Available online: https://github.com/Jjschwartz/NetworkAttackSimulator.
23. Standen, M., Lucas, M., Bowman, D., Richer, T.J., Kim, J., and Marriott, D. (2021). Cyborg: A gym for the development of autonomous cyber agents. arXiv.
24. Hazell, J. (2023). Large language models can be used to effectively scale spear phishing campaigns. arXiv.
25. Generative ai for pentesting: The good, the bad, the ugly10.1007/s10207-024-00835-x ↗
26. Wang, L., Wang, J., Jung, K., Thiagarajan, K., Wei, E., Shen, X., Chen, Y., and Li, Z. (2024). From sands to mansions: Enabling automatic full-life-cycle cyberattack construction with llm. arXiv.
27. Muzsai, L., Imolai, D., and Lukács, A. (2024). HackSynth: Llm agent and evaluation framework for autonomous penetration testing. arXiv.
28. Bianou, S.G., and Batogna, R.G. (2024, January 2–4). PENTEST-AI, an llm-powered multi-agents framework for penetration testing automation leveraging mitre attack. Proceedings of the 2024 IEEE International Conference on Cyber Security and Resilience (CSR), London, UK.10.1109/CSR61664.2024.10679480 ↗
29. Udeshi, M., Shao, M., Xi, H., Rani, N., Milner, K., Sai Charan Putrevu, V., and Shafique, M. (2025). D-CIPHER: Dynamic collaborative intelligent agents with planning and heterogeneous execution for enhanced reasoning in offensive security. arXiv.
30. Nakatani, S. (2025). RapidPen: Fully automated ip-to-shell penetration testing with llm-based agents. arXiv.
31. Bengio, Y., Louradour, J., Collobert, R., and Weston, J. (2009, January 14–18). Curriculum learning. Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, QC, Canada.10.1145/1553374.1553380 ↗
32. Du, Q., Kun, W., Kuang, X., Li, X., and Zhao, G. (2023, January 10–14). Automated software vulnerability detection via curriculum learning. Proceedings of the 2023 IEEE International Conference on Multimedia and Expo (ICME), Brisbane, Australia.10.1109/ICME55011.2023.00485 ↗
33. Shi, T., Wu, Y., Song, L., Zhou, T., and Zhao, J. (2025). Efficient reinforcement finetuning via adaptive curriculum learning. arXiv.
34. Vu, D.A., Nguyen, C.-D., Wu, X., Hoang, N., Du, M., Nguyen, T., and Luu, A.T. (April, January 31). Curriculum demonstration selection for in-context learning. Proceedings of the 40th ACM/SIGAPP Symposium on Applied Computing, Sicily, Italy.
35. Ma, X., Jiang, W., and Huang, H. (2025). Problem-Solving logic guided curriculum in-context learning for llms complex reasoning. arXiv.10.18653/v1/2025.findings-acl.440 ↗
36. Zhang, E., Yan, X., Lin, W., Zhang, T., and Lu, Q. (2025). Learning like humans: Advancing llm reasoning capabilities via adaptive difficulty curriculum learning and expert-guided self-reformulation. arXiv.
37. Mell, P., Spring, J., and Dugal, D. (2022). Measuring the Common Vulnerability Scoring System Base Score Equation, National Institute of Standards and Technology.10.6028/NIST.IR.8409.ipd ↗
38. OffSec (2025, August 04). Exploit Database-Exploits, Shellcode, and Security Papers. Available online: https://www.exploit-db.com/.
39. Wang, Y., Wu, W., Zhang, C., Xing, X., Gong, X., and Zou, W. (2019). From proof-of-concept to exploitable: (One step towards automatic exploitability assessment). Cybersecurity, 2.10.1186/s42400-019-0028-9 ↗
40. Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., Altman, S., and Anadkat, S. (2023). Gpt-4 technical report. arXiv.
41. Model Context Protocol (2025, May 15). Introduction to Model Context Protocol (mcp). Available online: https://modelcontextprotocol.io/introduction.
42. Nmap (2025, May 15). Nmap-The Network Mapper. Available online: https://nmap.org/.
43. Rapid7 (2025, May 15). Metasploit Framework. Available online: https://www.metasploit.com/.
44. Sqlmapproject (2025, May 15). Sqlmap: Automatic SQL Injection and Database Takeover Tool. Available online: https://sqlmap.org/.
45. Sullo (2025, May 15). Nikto. Available online: https://github.com/sullo/nikto.
46. vulhub (2025, May 15). Vulhub: Pre-Built Vulnerable Environments Based on Docker-Compose. Available online: https://vulhub.org/.
47. Retrieval-augmented generation for knowledge-intensive nlp tasks
48. Honeypots: The need of network security
49. Survey of hallucination in natural language generation10.1145/3571730 ↗