journal article·2026-06-27Open access

Dynamic Closed-Loop Steering for Adaptive and Geometry-Preserving System-2 Reasoning

Deyu Meng, Tongchuan Xia, Yuanxin Cai

Applied Sciences· Volume 16· Issue 13

Abstract

Large language models (LLMs) are undergoing a paradigm shift from fast generation to deliberate System-2 reasoning, where scaling test-time compute is critical for unlocking complex reasoning capabilities. Yet, more computation does not guarantee better reasoning: under unconstrained test-time scaling, models frequently fall into “overthinking” traps, repeatedly elaborating on incorrect trajectories while wasting token budgets. We propose Dynamic Closed-Loop Steering, a training-free framework that treats reasoning as a monitored control process rather than a static decoding run. The framework follows a sense–decide–act design: lightweight latent signals sense trajectory divergence, a feedback regulator determines adaptive intervention timing and intensity, and a geometry-preserving actuation step redirects hidden states while maintaining their norm structure. This design emphasizes adaptive control and macro-level trajectory observability over static hidden-state addition. Across mathematical and reasoning benchmarks, Dynamic Closed-Loop Steering improves final-answer accuracy while curbing excess token consumption, yielding Pareto-favorable trade-offs across the large majority of evaluated configurations, with graceful degradation near the model’s capability floor. Trajectory analysis confirms the method effectively suppresses repetitive self-justification and accelerates recovery from erroneous episodes. These results establish closed-loop, geometry-preserving intervention as a practical foundation for robust System-2 reasoning.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Multimodal Machine Learning Applications · Explainable Artificial Intelligence (XAI)

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information Communication Engineering, Beijing Information Science and Technology University, No. 55 Taihanglu, Changping, Beijing 102206, China

School of Computer Science (National Pilot Software Engineering School), BUPT, Beijing University of Posts and Telecommunications, Xitucheng Road 10, Haidian District, Beijing 100876, China

Funding

Beijing Municipal High-Level Overseas Talent Funding

References (46)

Show source-provided references
1. Chen, X., Xu, J., Liang, T., He, Z., Pang, J., Yu, D., Song, L., Liu, Q., Zhou, M., and Zhang, Z. (2025). Do NOT think that much for 2+3=? On the overthinking of o1-like LLMs. arXiv.
2. Ghosal, S.S., Chakraborty, S., Reddy, A., Lu, Y., Wang, M., Manocha, D., Huang, F., Ghavamzadeh, M., and Bedi, A.S. (2025). Does thinking more always help? Mirage of test-time scaling in reasoning models. arXiv.
3. Muennighoff, N., Yang, Z., Shi, W., Li, X.L., Fei-Fei, L., Hajishirzi, H., Zettlemoyer, L., Liang, P., Candès, E., and Hashimoto, T. (2025). s1: Simple test-time scaling. arXiv.10.18653/v1/2025.emnlp-main.1025 ↗
4. Oh, M., Song, S., Lee, S., Jo, S., and Jo, Y. (2025). ThinkBrake: Efficient Reasoning via Log-Probability Margin Guided Decoding. arXiv.10.18653/v1/2026.findings-acl.1095 ↗
5. Inference-time intervention: Eliciting truthful answers from a language model
6. Turner, A.M., Thiergart, L., Leech, G., Udell, D., Vazquez, J.J., Mini, U., and MacDiarmid, M. (2024). Steering language models with activation engineering. arXiv.
7. Rimsky, N., Gabrieli, N., Schulz, J., Tong, M., Hubinger, E., and Turner, A.M. (2024, January 11–16). Steering Llama 2 via contrastive activation addition. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, Bangkok, Thailand.10.18653/v1/2024.acl-long.828 ↗
8. Zou, A., Phan, L., Chen, S., Campbell, J., Guo, P., Ren, R., Pan, A., Yin, X., Mazeika, M., and Dombrowski, A.-K. (2023). Representation engineering: A top-down approach to AI transparency. arXiv.
9. OpenAI (2024). Learning to Reason with LLMs, OpenAI.
10. Guo, D., Yang, D., Zhang, H., Song, J., Wang, P., Zhu, Q., Xu, R., Zhang, R., and Ma, S. (2025). DeepSeek-R1: Incentivizing reasoning capability in LLMs via reinforcement learning. arXiv.
11. Ji, Y., Li, J., Xiang, Y., Ye, H., Wu, K., Yao, K., Xu, J., Mo, L., and Zhang, M. (2025). A survey of test-time compute: From intuitive inference to deliberate reasoning. arXiv.10.1162/COLI.a.629 ↗
12. From system 1 to system 2: A survey of reasoning large language models10.1109/TPAMI.2025.3637037 ↗
13. Chain-of-thought prompting elicits reasoning in large language models10.52202/068431-1800 ↗
14. Chain of preference optimization: Improving chain-of-thought reasoning in llms10.52202/079017-0011 ↗
15. Lightman, H., Kosaraju, V., Burda, Y., Edwards, H., Baker, B., Lee, T., Leike, J., Schulman, J., Sutskever, I., and Cobbe, K. (2023). Let’s Verify Step by Step. arXiv.
16. Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., and Zhou, D. (2022). Self-consistency improves chain of thought reasoning in language models. arXiv.
17. Tree of Thoughts: Deliberate problem solving with large language models10.52202/075280-0517 ↗
18. Towards thinking-optimal scaling of test-time compute for llm reasoning
19. Brown, B., Juravsky, J., Ehrlich, R., Clark, R., Le, Q.V., Ré, C., and Mirhoseini, A. (2024). Large language monkeys: Scaling inference compute with repeated sampling. arXiv.
20. Sofroniew, N., Kauvar, I., Saunders, W., Chen, R., Henighan, T., Hydrie, S., Citro, C., Pearce, A., Tarng, J., and Gurnee, W. (2026). Emotion concepts and their function in a large language model. arXiv.
21. Kim, B., Wattenberg, M., Gilmer, J., Cai, C., Wexler, J., Viegas, F., and Sayres, R. (2018, January 10–15). Interpretability beyond feature attribution: Quantitative testing with concept activation vectors (tcav). Proceedings of the International Conference on Machine Learning, Stockholm Sweden.
22. Schnoor, E., Tiomoko, M., Said, J., Jung, A., and Samek, W. (2026, January 4–8). Concept activation vectors: A unifying view and adversarial attacks. Proceedings of the ICASSP 2026–2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP55912.2026.11464861 ↗
23. Wang, T., Ma, Y., Liao, K., Yang, C., Zhang, Z., Wang, J., and Liu, X. (2025, January 4–9). Token-Aware Editing of internal activations for large language model alignment. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, Suzhou, China.10.18653/v1/2025.emnlp-main.480 ↗
24. Statistical exploration of the manifold hypothesis10.1093/jrsssb/qkag055 ↗
25. Diffusion models and the manifold hypothesis: Log-domain smoothing is geometry adaptive
26. Loshchilov, I., Hsieh, C.P., Sun, S., and Ginsburg, B. (2025, January 24–28). ngpt: Normalized transformer with representation learning on the hypersphere. Proceedings of the International Conference on Learning Representations, Singapore.
27. Geometry of decision making in language models
28. Gupta, A., Ozdemir, A., Gong, C., and Anumanchipalli, G. (2026, January 24–29). Geometric interpretation of layer normalization and a comparative analysis with rmsnorm. Proceedings of the Findings of the Association for Computational Linguistics: EACL 2026, Rabat, Morocco.10.18653/v1/2026.findings-eacl.20 ↗
29. Survey of hallucination in natural language generation10.1145/3571730 ↗
30. Holtzman, A., Buys, J., Du, L., Forbes, M., and Choi, Y. (2019). The curious case of neural text degeneration. arXiv.
31. Welleck, S., Kulikov, I., Roller, S., Dinan, E., Cho, K., and Weston, J. (2019). Neural text generation with unlikelihood training. arXiv.
32. A contrastive framework for neural text generation10.52202/068431-1566 ↗
33. Gallifant, J., Fiske, A., Levites Strekalova, Y.A., Osorio-Valencia, J.S., Parke, R., Mwavu, R., Martinez, N., Gichoya, J.W., Ghassemi, M., and Demner-Fushman, D. (2024). Peer review of GPT-4 technical report and systems card. PLoS Digit. Health, 3.10.1371/journal.pdig.0000417 ↗
34. Hao, Z., Wang, H., Liu, H., Luo, J., Yu, J., Dong, H., Lin, Q., Wang, C., and Chen, J. (2025). Rethinking entropy interventions in rlvr: An entropy change perspective. arXiv.10.18653/v1/2026.acl-long.1436 ↗
35. Hendrycks, D., Burns, C., Kadavath, S., Arora, A., Basart, S., Tang, E., Song, D., and Steinhardt, J. (2021). Measuring mathematical problem solving with the MATH dataset. arXiv.
36. Mathematical Association of America (2026, June 16). American Invitational Mathematics Examination 2024. Available online: https://maa.org/maa-invitational-competitions/.
37. Mathematical Association of America (2026, June 16). American Invitational Mathematics Examination 2025. Available online: https://maa.org/maa-invitational-competitions/.
38. Yang, A., Li, A., Yang, B., Zhang, B., Hui, B., Zheng, B., Yu, B., Gao, C., Huang, C., and Lv, C. (2025). Qwen3 technical report. arXiv.
39. Huang, Y., Chen, H., Ruan, S., Zhang, Y., Wei, X., and Dong, Y. (2025). Mitigating Overthinking in Large Reasoning Models via Manifold Steering. arXiv.
40. You, Z., Deng, C., and Chen, H. (2026). Spherical Steering: Geometry-Aware Activation Rotation for Language Models. arXiv.
41. Chen, R., Zhang, Z., Hong, J., Kundu, S., and Wang, Z. (2025). SEAL: Steerable Reasoning Calibration of Large Language Models for Free. arXiv.
42. Yang, W., Yue, X., Chaudhary, V., and Han, X. (2025). Speculative thinking: Enhancing small-model reasoning with large model guidance at inference time. arXiv.
43. Wang, Y., Luo, H., Yao, H., Huang, T., He, H., Liu, R., Tan, N., Huang, J., Cao, X., and Tao, D. (2025). R1-compress: Long chain-of-thought compression via chunk compression and search. arXiv.
44. MIMIC-EYE: A secure and explainable multi-modal deep learning framework for clinical decision support
45. Enhancing stock market forecasting through deep learning and decentralized data integrity: A blockchain-integrated framework
46. Verifiable coded computation of multiple functions10.1109/TIFS.2024.3450288 ↗