journal article·2025-10-06Open access

Hybrid Rule-Based and Reinforcement Learning for Urban Signal Control in Developing Cities: A Systematic Literature Review and Practice Recommendations for Indonesia

Freddy Kurniawan, Harliyus Agustian, Denny Dermawan, Riani Nurdin, Nurfi Ahmadi, Okto Dinaryanto

Applied Sciences· Volume 15· Issue 19

Abstract

Hybrid rule-based and reinforcement-learning (RL) signal control is gaining traction for urban coordination by pairing interpretable cycles, splits, and offsets with adaptive, data-driven updates. However, systematic evidence on their architectures, safeguards, and deployment prerequisites remains scarce, motivating this review that maps current hybrid controller designs under corridor coordination. Searches across major databases and arXiv (2000–2025) followed PRISMA guidance; screening is reported in the flow diagram. Eighteen studies were included, nine with quantitative comparisons, spanning simulation and early field pilots. Designs commonly use rule shields, action masking, and bounded adjustments of offsets or splits; effectiveness is assessed via arrivals on green, Purdue Coordination diagrams, delay, and travel time. Across the 18 studies, the majority reported improvements in arrivals on green, delay, travel time, or related coordination metrics compared to fixed-time or actuated baselines, while only a few showed neutral or mixed effects and very few indicated deterioration. These results indicate that hybrid safeguards are generally associated with positive operational gains, especially under heterogeneous traffic conditions. Evidence specific to Indonesia remains limited; this review addresses that gap and offers guidance transferable to other developing-country contexts with similar sensing, connectivity, and institutional constraints. Practical guidance synthesizes sensing choices and fallbacks, controller interfaces, audit trails, and safety interlocks into a deployment checklist, with a staged roadmap for corridor roll-outs. This paper is not only a systematic review but also develops a practice-oriented framework tailored to Indonesian corridors, ensuring that evidence synthesis and practical recommendations are clearly distinguished.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Traffic Prediction and Management Techniques · Traffic control and management · Smart Parking Systems Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical Engineering, Institut Teknologi Dirgantara Adisutjipto, Yogyakarta 55198, Indonesia

Department of Informatics, Institut Teknologi Dirgantara Adisutjipto, Yogyakarta 55198, Indonesia

Department of Industrial Engineering, Institut Teknologi Dirgantara Adisutjipto, Yogyakarta 55198, Indonesia

Department of Mechanical Engineering, Institut Teknologi Dirgantara Adisutjipto, Yogyakarta 55198, Indonesia

Funding

Ministry of Higher Education, Science and Technology (Kemdiktisaintek, Indonesia) through Higher Education Service Institution Region V

References (100+)

Show source-provided references
1. Majstorović, Ž., Tišljarić, L., Ivanjko, E., and Carić, T. (2023). Urban Traffic Signal Control under Mixed Traffic Flows: Literature Review. Appl. Sci., 13.10.3390/app13074484 ↗
2. Michailidis, P., Michailidis, I., Lazaridis, C.R., and Kosmatopoulos, E. (2025). Traffic Signal Control via Reinforcement Learning: A Review on Applications and Innovations. Infrastructures, 10.10.3390/infrastructures10050114 ↗
3. Sugiarto, S., Saleh, S.M., Darma, Y., Rusdi, M., A’yUni, Q., Fazila, T.S., and Rahma, R. (2024). Base saturation flow rate (BSFR) and its effect on performance of pretimed signalized intersection with non-lane based urban heterogeneous traffic. PLoS ONE, 19.10.1371/journal.pone.0306112 ↗
4. Reinforcement learning in urban network traffic signal control: A systematic literature review10.1016/j.eswa.2022.116830 ↗
5. Advances in reinforcement learning for traffic signal control: A review of recent progress
6. Wei, H., Xu, N., Zhang, H., Zheng, G., Zang, X., Chen, C., Zhang, W., Zhu, Y., Xu, K., and Li, Z. (2019, January 3–7). CoLight. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China.10.1145/3357384.3357902 ↗
7. Kushwaha, A., Ravish, K., Lamba, P., and Kumar, P. (2025). A Survey of Safe Reinforcement Learning and Constrained MDPs: A Technical Survey on Single-Agent and Multi-Agent Safety. arXiv.
8. Müller, A., and Sabatelli, M. (2022). Safe and Psychologically Pleasant Traffic Signal Control with Reinforcement Learning using Action Masking. arXiv.10.1109/ITSC55140.2022.9922306 ↗
9. Alshiekh, M., Bloem, R., Ehlers, U., Könighofer, B., Niekum, S., and Topcu, U. (2025, August 17). Safe Reinforcement Learning via Shielding. [Online]. Available online: https://www.aaai.org.
10. Pri-DDQN: Learning adaptive traffic signal control strategy through a hybrid agent10.1007/s40747-024-01651-5 ↗
11. Leveraging reinforcement learning for dynamic traffic control: A survey and challenges for field implementation10.1016/j.commtr.2023.100104 ↗
12. A review of reinforcement learning applications in adaptive traffic signal control10.1049/itr2.12208 ↗
13. Nasution, S.M., Husni, E., Kuspriyanto, K., and Yusuf, R. (2023). Heterogeneous Traffic Condition Dataset Collection for Creating Road Capacity Value. Big Data Cogn. Comput., 7.10.3390/bdcc7010040 ↗
14. Chen, R., Fang, F., and Sadeh, N. (2022). The Real Deal: A Review of Challenges and Opportunities in Moving Reinforcement Learning-Based Traffic Signal Control Systems Towards Reality. arXiv.
15. (2025, August 17). A Joint Standard of AASHTO, ITE, and NEMA NTCIP 1202 v03A National Transportation Communications for ITS Protocol Object Definitions for Actuated Signal Controllers (ASC) Interface (Including FYA Errata). [Online]. Available online: https://www.ntcip.org.
16. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews10.1136/bmj.n71 ↗
17. A comparison of two assessment tools used in overviews of systematic reviews: ROBIS versus AMSTAR-210.1186/s13643-021-01819-x ↗
18. Assessing the methodological quality and risk of bias of systematic reviews: Primer for authors of overviews of systematic reviews10.1136/bmjmed-2023-000604 ↗
19. A comprehensive assessment of arterial signal coordination through a case study
20. Effect of Signal Coordination on the Traffic Operation of Urban Corridor10.25130/tjes.30.1.2 ↗
21. Determination of Significant Critical Movements to Generate Traffic Scenarios for Large Arterial Networks10.3141/2128-21 ↗
22. Development of platoon-based actuated signal control systems to coordinated intersections: Application in corridors in Houston10.1049/iet-its.2019.0289 ↗
23. Evaluation of Actuated, Coordinated, and Adaptive Signal Control Systems: A Case Study10.1061/JTEPBS.0000068 ↗
24. SCOOT Real-Time Adaptive Control in a CORSIM Simulation Environment10.3141/1727-04 ↗
25. Arterial Performance Evaluation on an Adaptive Traffic Signal Control System10.1016/j.sbspro.2011.04.445 ↗
26. Anaheim Advanced Traffic Control System Field Operations Test: A Technical Evaluation of SCOOT10.1080/03081060500515622 ↗
27. Empirical analysis of heterogeneous traffic flow and calibration of porous flow model10.1016/j.trc.2014.09.017 ↗
28. The influence of motorcycle behavior on saturation flow rate at signalized intersections with and without exclusive stopping space for motorcycle (ESSM)10.1088/1755-1315/673/1/012020 ↗
29. Effect of Traffic Flow, Proportion of Motorcycle, Speed, Lane Width, and the Availabilities of Median and Shoulder on Motorcycle Accidents at Urban Roads in Indonesia10.2174/1874447801812010001 ↗
30. Ministry of Transportation of Indonesia (2025, August 17). Alat Pemberi Isyarat Lalu-Lintas [Traffic Signal Devices]. Legislation. [Online]. Available online: https://peraturan.bpk.go.id/Details/103764/permenhub-no-49-tahun-2014?utm_source=chatgpt.com.
31. Traffic Congestion Detection Using YOLOv8 Algorithm With CCTV Data10.33558/piksel.v12i2.9953 ↗
32. Adaptive Traffic Light Signal Control Using Fuzzy Logic Based on Real-Time Vehicle Detection from Video Surveillance10.26555/jiteki.v10i2.28712 ↗
33. SCATS (Sydney Coordinated Adaptive Traffic System) as A Solution to Overcome Traffic Congestion in Big Cities10.34010/injuratech.v3i1.7875 ↗
34. (2025, August 17). Federal Highway Administration. Automated Traffic Signal Performance Measures. Federal Highway Administration: Washington, DC, USA, 2020. [Online]. Available online: https://www.flickr.com/photos/sounderbruce/22448121975.
35. Tanaka, A., Schroeder, P.B., Trask, P.L., and Chase, T. (2019). Automated Traffic Signal Performance Measures, Kittelson & Associates, Inc.
36. Yulianto, B. (2017, January 13–14). Detector technology for demand responsive traffic signal control under mixed traffic conditions. Proceedings of the 4th International Conference on Engineering, Technology, and Industrial Application (ICETIA), Surakarta, Indonesia.
37. A Review of Sensing Techniques for Real-time Traffic Surveillance10.3923/jas.2011.192.198 ↗
38. Deriving Operational Traffic Signal Performance Measures from Vehicle Trajectory Data10.1177/03611981211006725 ↗
39. Day, C.M., and Bullock, D.M. (2020). Optimization of Traffic Signal Offsets with High Resolution Event Data. J. Transp. Eng. Part A Syst., 146.10.1061/JTEPBS.0000309 ↗
40. Schultz, G.G., Macfarlane, G.S., Wang, B., Graduate, E., Assistant, R., and Mccuen, S. (2025, August 17). Evaluating the Quality of Signal Operations Using Signal Performance Measures. [Online], Available online: https://www.udot.utah.gov/go/research.
41. Evaluating the impact of urban traffic patterns on air pollution emissions in Dublin: A regression model using google project air view data and traffic data10.1186/s12544-024-00671-z ↗
42. Zhao, P., Yuan, Y., and Guo, T. (2022). Extensible Hierarchical Multi-Agent Reinforcement-Learning Algorithm in Traffic Signal Control. Appl. Sci., 12.10.3390/app122412783 ↗
43. Ma, J., and Wu, F. (2025, August 17). Feudal Multi-Agent Deep Reinforcement Learning for Traffic Signal Control. [Online]. Available online: https://www.ifaamas.org.
44. Signal adaptive cooperative control of two adjacent traffic intersections using a two-stage algorithm10.1016/j.eswa.2021.114746 ↗
45. A Dynamic Optimization Model for Adjacent Signalized Intersection Control Systems Based on the Stratified Sequencing Method10.1061/JHTRCQ.0000490 ↗
46. Development of Coordinated Control of Vehicle Traffic Flow at Adjacent Intersection
47. Alam, H., Kurniawan, F., and Widya, H. (2025, January 23–24). Hardware-Implemented Multi-Agent Coordination for Adaptive Traffic Control in Developing Regions: A Low-Cost Microcontroller Approach. Proceedings of the 2nd International Conference on Science and Technology UISU (ICST), Online.10.30743/176pwd25 ↗
48. Connected Vehicle-Based Traffic Signal Coordination10.1016/j.eng.2020.10.009 ↗
49. Dynamic Offset Tuning Procedure Using Travel Time Data10.3141/1683-11 ↗
50. Experimentally Validated Extended Kalman Filter for UAV State Estimation Using Low-Cost Sensors
51. Pre-Timed and Coordinated Traffic Controller Systems Based on AVR Microcontroller10.12928/telkomnika.v12i4.497 ↗
52. Adaptive Traffic Controller Based On Pre-Timed System10.12928/telkomnika.v14i1.2798 ↗
53. Design of a Time Synchronization System Based on GPS and IEEE 1588 for Transmission Substations10.1109/TPWRD.2016.2600759 ↗
54. Day, C.M., Smaglik, E.J., Bullock, D.M., and Sturdevant, J.R. (2025, August 21). FHWA/IN/JTRP-2008/9 Final Report Real-Time Arterial Traffic Signal Performance Measures. [Online], Available online: https://www.fhwa.dot.gov/publications/research/operations/06083/index.cfm?utm_source=chatgpt.com.10.5703/1288284313439 ↗
55. (2025, August 18). NTCIP 1202 v04 Actuated Signal Control (ASC). Institute of Transportation Engineers. [Online]. Available online: https://www.ite.org/technical-resources/topics/standards/ntcip-1202-v04-actuated-signal-control-asc/?utm_source=chatgpt.com.
56. Federal Highway Administration (2008). ACS Lite, Federal Highway Administration Research and Technology.
57. Adaptive traffic light cycle time controller using microcontrollers and crowdsource data of google apis for developing countries
58. Diaz, K.A., Dailisan, D., Sharaf, U., Santos, C., Gan, Q., Uy, F.A., Lim, M.T., and Bayen, A.M. (2022). Adaptive Coordination Offsets for Signalized Arterial Intersections using Deep Reinforcement Learning. arXiv.
59. Kim, H., Tak, H., Yu, H., and Yeo, H. (2025, August 17). Hierarchical Traffic Signal Coordination with Priority-based Optimization via Deep Reinforcement Learning. Available online: https://trc-30.epfl.ch/wp-content/uploads/2024/09/TRC-30_paper_205.pdf.
60. Park, S., Han, E., Park, S., Jeong, H., and Yun, I. (2021). Deep Q-network-based traffic signal control models. PLoS ONE, 16.10.1371/journal.pone.0256405 ↗
61. Gu, J., Lee, M., Jun, C., Han, Y., Kim, Y., and Kim, J. (2021). Traffic Signal Optimization for Multiple Intersections Based on Reinforcement Learning. Appl. Sci., 11.10.3390/app112210688 ↗
62. Kolat, M., Kővári, B., Bécsi, T., and Aradi, S. (2023). Multi-Agent Reinforcement Learning for Traffic Signal Control: A Cooperative Approach. Sustainability, 15.10.3390/su15043479 ↗
63. Jiang, Q., Qin, M., Shi, S., Sun, W., and Zheng, B. (2025, August 17). Multi-Agent Reinforcement Learning for Traffic Signal Control Through Universal Communication Method. [Online]. Available online: https://github.com/.
64. First steps towards real-world traffic signal control optimisation by reinforcement learning10.1080/17477778.2024.2364715 ↗
65. A comprehensive review on applications of Raspberry Pi10.1016/j.cosrev.2024.100636 ↗
66. Bouktif, S., Cheniki, A., and Ouni, A. (2021). Traffic Signal Control Using Hybrid Action Space Deep Reinforcement Learning. Sensors, 21.10.3390/s21072302 ↗
67. Bi, Y., Ding, Q., Du, Y., Liu, D., and Ren, S. (2024). Intelligent Traffic Control Decision-Making Based on Type-2 Fuzzy and Reinforcement Learning. Electronics, 13.10.3390/electronics13193894 ↗
68. Li, J., Lin, S., Shi, T., Tian, C., Mei, Y., Song, J., Zhan, X., and Li, R. (2022). A Fully Data-Driven Approach for Realistic Traffic Signal Control Using Offline Reinforcement Learning. arXiv.
69. Adaptive traffic signal control algorithms based on probe vehicle data10.1080/15472450.2020.1750384 ↗
70. A survey of reinforcement and deep reinforcement learning for coordination in intelligent traffic light control10.1186/s40537-025-01104-x ↗
71. Li, M., Pan, X., Liu, C., and Li, Z. (2025). Federated deep reinforcement learning-based urban traffic signal optimal control. Sci. Rep., 15.10.1038/s41598-025-91966-1 ↗
72. Multimodal adaptive traffic signal control: A decentralized multiagent reinforcement learning approach10.1016/j.multra.2025.100190 ↗
73. Satheesh, A., and Powell, K. (2025). A Constrained Multi-Agent Reinforcement Learning Approach to Autonomous Traffic Signal Control. arXiv.10.1145/3769308 ↗
74. Huang, X., Wu, D., Jenkin, M., and Boulet, B. (2021). ModelLight: Model-Based Meta-Reinforcement Learning for Traffic Signal Control. arXiv, 1–8.
75. Multi-agent Deep Reinforcement Learning collaborative Traffic Signal Control method considering intersection heterogeneity10.1016/j.trc.2024.104663 ↗
76. Jia, W., and Ji, M. (2025). Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control with Spatio-Temporal Attention Mechanism. Appl. Sci., 15.10.3390/app15158605 ↗
77. Towards fair lights: A multi-agent masked deep reinforcement learning for efficient corridor-level traffic signal control10.1016/j.commtr.2025.100203 ↗
78. Design of a Hybrid Intelligent Traffic Signal Control System Using Nearest Neighbor Algorithm and Deep Reinforcement Learning with SUMO Simulator
79. Muller, A., Rangras, V., Ferfers, T., Hufen, F., Schreckenberg, L., Jasperneite, J., Schnittker, G., Waldmann, M., Friesen, M., and Wiering, M. (2021, January 13–16). Towards Real-World Deployment of Reinforcement Learning for Traffic Signal Control. Proceedings of the 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA), Pasadena, CA, USA.10.1109/ICMLA52953.2021.00085 ↗
80. (2025, August 18). Flir Helps Indonesia Start Tackling Congestion. ITS International. [Online]. Available online: https://www.itsinternational.com/its4/feature/flir-helps-indonesia-start-tackling-congestion#:~:text=Extensive%20TrafiCam%20site.
81. (2025, August 18). Intelligent Transport Systems. A Singapore Government Agency. [Online], Available online: https://www.lta.gov.sg/content/ltagov/en/getting_around/driving_in_singapore/intelligent_transport_systems.html#:~:text=Collectively%20called%20the%20Intelligent%20Transport,to%20maximise%20road%20network%20efficiency.
82. (2025, August 18). TOPIS: Seoul’s Intelligent Traffic System (ITS). Seoul Solution. [Online]. Available online: https://seoulsolution.kr/en/content/2595#:~:text=The%20Seoul%20Metropolitan%20Government%20discloses,Twitter%2C%20etc.
83. (2025, August 18). The Brazilian City of Curitiba Awards Indra Its Largest Intelligent Urban Transport and Mobility Project for €15 Million. IndraCompany. [Online]. Available online: https://www.indracompany.com/en/noticia/brazilian-city-curitiba-awards-indra-largest-intelligent-urban-transport-mobility-project#:~:text=The%20project%20includes%20new%20Intelligent,model%20based%20on%20predictive%20algorithms.
84. (2025, August 18). Intelligent Transport Systems Intelligent Transport Systems. Kenya Urban Roads Authority. [Online]. Available online: https://kura.go.ke/news/intelligent-transport-systems/13363/#:~:text=The%20Authority%20has%20continued%20to,located%20at%20the%20KURA%20headquarters.
85. Counting Mixed Traffic Volumes at Motorcycle-Dominated Intersections by Using Computer Vision
86. From lane-less to lane-free: Implications in the era of automated vehicles10.1016/j.trc.2024.104898 ↗
87. Simulation of Signalized Intersection with Non-Lane-Based Heterogeneous Traffic Conditions Using Cellular Automata10.1177/03611981231211317 ↗
88. The effectiveness of atcs use policy in improving traffic smoothness and safety in banjarbaru city10.46799/jss.v6i1.965 ↗
89. Integration of Public Transportation in Smart Transportation System (Smart Transportation System) in Jakarta10.33258/konfrontasi2.v9i2.223 ↗
90. Tania, N., and Rachmawati, R. (2022, January 14–16). Area Traffic Control System (ATCS) for Supporting Urban Traffic Management in DKI Jakarta. Proceedings of the 2022 7th International Conference on Electric Vehicular Technology (ICEVT), Bali, Indonesia.10.1109/ICEVT55516.2022.9924924 ↗
91. Syah, A.F., Aminudin, M.S., Salsabila, N., and Rizqi, D.I. Leveraging Artificial Intelligence for Smart City Development: Social and Governance Impacts in Jakarta. Proceedings of the Internasional Seminar on Arts, Artificial Intelligence & Society, Available online: https://www.google.com.hk/url?sa=t&source=web&rct=j&opi=89978449&url=https://proceeding.ikj.ac.id/index.php/UXA/article/download/118/111/385&ved=2ahUKEwjDqP6x04eQAxWcBdsEHeFHFNYQFnoECBkQAQ&usg=AOvVaw3Vvxu6ndjkCHDESqCinoro.
92. Review of urban traffic management and the impacts of new vehicle technologies10.1049/iet-its.2009.0046 ↗
93. Otto, T., Partzsch, I., Holfeld, J., Klöppel-Gersdorf, M., and Ivanitzki, V. (2023). Designing a C-ITS Communication Infrastructure for Traffic Signal Priority of Public Transport. Appl. Sci., 13.10.3390/app13137650 ↗
94. Handoko, C., and Zhang, X. (2021). Case Study on The Palapa Ring Project: Prospects for Sub-National Competitiveness, Asia Competitiveness Institute.
95. (2025, August 17). Roadmaps for Awarding 5G Spectrum: A Focus on Indonesia. [Online]. Available online: www.gsma.com.
96. Investigating Impacts of Communication Loss on Signal Performance with Use of Event-Based Data10.3141/2645-05 ↗
97. Espinosa, J.E., Velastin, S.A., and Branch, J.W. (2018, January 22–24). Motorcycle detection and classification in urban Scenarios using a model based on Faster R-CNN. Proceedings of the 9th International Conference on Pattern Recognition Systems (ICPRS 2018), Valparaíso, Chile.10.1049/cp.2018.1292 ↗
98. Urban traffic monitoring based on deep learning on an embedded GPU10.1016/j.eswa.2025.126847 ↗
99. Detection of Motorcycles in Urban Traffic Using Video Analysis: A Review10.1109/TITS.2020.2997084 ↗
100. Espinosa, J.E., Velastin, S.A., and Branch, J.W. (2019). Detection and Tracking of Motorcycles in Congested Urban Environments Using Deep Learning and Markov Decision Processes. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer Verlag.10.1007/978-3-030-21077-9_13 ↗