Adaptive Scheduling in Cognitive IoT Sensors for Optimizing Network Performance Using Reinforcement Learning
Source abstract
Abstract
Cognitive sensors are embedded in home appliances and other surrounding devices to create a connected, intelligent environment for providing pervasive and ubiquitous services. These sensors frequently create massive amounts of data with many redundant and repeating bit values. Cognitive sensors are always restricted in resources, and if careful strategy is not applied at the time of deployment, the sensors become disconnected, degrading the system’s performance in terms of energy, reconfiguration, delay, latency, and packet loss. To address these challenges and to establish a connected network, there is always a need for a system to evaluate the contents of detected data values and dynamically switch sensor states based on their function. Here in this article, we propose a reinforcement learning-based mechanism called “Adaptive Scheduling in Cognitive IoT Sensors for Optimizing Network Performance using Reinforcement Learning (ASC-RL)”. For reinforcement learning, the proposed scheme uses three types of parameters: internal parameters (states), environmental parameters (sensing values), and history parameters (energy levels, roles, number of switching states) and derives a function for the state-changing policy. Based on this policy, sensors adjust and adapt to different energy states. These states minimize extensive sensing, reduce costly processing, and lessen frequent communication. The proposed scheme reduces network traffic and optimizes network performance in terms of network energy. The main factors evaluated are joint Gaussian distributions and event correlations, with derived results of signal strengths, noise, prediction accuracy, and energy efficiency with a combined reward score. Through comparative analysis, ASC-RL enhances the overall system’s performance by 3.5% in detection and transition probabilities. The false alarm probabilities are reduced to 25.7%, the transmission success rate is increased by 6.25%, and the energy efficiency and reliability threshold are increased by 35%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Cognitive Radio Networks and Spectrum Sensing · IoT and Edge/Fog Computing · Smart Grid Energy Management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Smart Security, Gachon University, Seongnam-si 13120, Gyeonggi-do, Republic of Korea
Department of Computer Engineering, Gachon University, Seongnam-si 13120, Gyeonggi-do, Republic of Korea
Funding
Nuclear Safety and Security Commission (NSSC) of the Republic of Korea
References (48)
Show source-provided references
1. A review of IoT applications in healthcare10.1016/j.neucom.2023.127017 ↗
2. Gkagkas, G., Vergados, D.J., Michalas, A., and Dossis, M. (2024). The Advantage of the 5G Network for Enhancing the Internet of Things and the Evolution of the 6G Network. Sensors, 24.10.3390/s24082455 ↗
3. An energy efficient adaptive scheduling scheme (EASS) for mesh grid wireless sensor networks10.1016/j.jpdc.2020.08.007 ↗
4. Integration of data science with the intelligent IoT (IIoT): Current challenges and future perspectives10.1016/j.dcan.2024.02.007 ↗
5. Casillo, M., Cecere, L., Colace, F., Lorusso, A., and Santaniello, D. (2024). Integrating the internet of things (IoT) in SPA medicine: Innovations and challenges in digital wellness. Computers, 13.10.3390/computers13030067 ↗
6. A comprehensive survey on communication techniques for the realization of intelligent transportation systems in IoT based smart cities10.1007/s12083-024-01627-9 ↗
7. To enhance customer (or patient) experience based on IoT analytical study through technology (IT) transformation for E-healthcare10.1016/j.measen.2024.101087 ↗
8. IoT-based agriculture management techniques for sustainable farming: A comprehensive review10.1016/j.compag.2024.108851 ↗
9. Contribution of Internet of Things (IoT) in improving agricultural systems10.1007/s13762-023-05162-7 ↗
10. Internet of things (IoT) of smart homes: Privacy and security
11. Nassereddine, M., and Khang, A. (2024). Applications of Internet of Things (IoT) in smart cities. Advanced IoT Technologies and Applications in the Industry 4.0 Digital Economy, CRC Press.10.1201/9781003434269-6 ↗
12. Energy-efficient dynamic and adaptive state-based scheduling (EDASS) scheme for wireless sensor networks10.1109/JSEN.2022.3174050 ↗
13. Optimizing Resource Management for IoT Devices in Constrained Environments10.4236/jcc.2024.128005 ↗
14. Poyyamozhi, M., Murugesan, B., Rajamanickam, N., Shorfuzzaman, M., and Aboelmagd, Y. (2024). IoT—A Promising Solution to Energy Management in Smart Buildings: A Systematic Review, Applications, Barriers, and Future Scope. Buildings, 14.10.3390/buildings14113446 ↗
15. Recent Lightweight cryptography (LWC) based security advances for resource-constrained IoT networks10.1007/s11276-024-03714-4 ↗
16. Sun, Y., and Jung, H. (2024). Machine Learning (ML) Modeling, IoT, and Optimizing Organizational Operations through Integrated Strategies: The Role of Technology and Human Resource Management. Sustainability, 16.10.3390/su16166751 ↗
17. IoT in energy: A comprehensive review of technologies, applications, and future directions10.1007/s12083-024-01725-8 ↗
18. Enabling Trust in Automotive IoT: Lightweight Mutual Authentication Scheme for Electronic Connected Devices in Internet of Things10.1109/TCE.2024.3410300 ↗
19. Self-adaptive and content-based scheduling for reducing idle listening and overhearing in securing quantum IoT sensors10.1016/j.iot.2024.101312 ↗
20. Automated data processing and feature engineering for deep learning and big data applications: A survey
21. Deep learning image feature recognition algorithm for judgment on the rationality of landscape planning and design10.1155/2021/9921095 ↗
22. Rajawat, A.S., Goyal, S., Chauhan, C., Bedi, P., Prasad, M., and Jan, T. (2023). Cognitive adaptive systems for industrial internet of things using reinforcement algorithm. Electronics, 12.10.3390/electronics12010217 ↗
23. Enhancing ASD detection accuracy: A combined approach of machine learning and deep learning models with natural language processing10.1007/s13755-024-00281-y ↗
24. A review of spectrum sensing in modern cognitive radio networks10.1007/s11235-023-01079-1 ↗
25. RIS-assisted cooperative spectrum sensing for cognitive radio networks10.1109/TWC.2024.3393516 ↗
26. Wang, J., Wang, Z., and Zhang, L. (2024). A simultaneous wireless information and power transfer-based multi-hop uneven clustering routing protocol for EH-cognitive radio sensor networks. Big Data Cogn. Comput., 8.10.3390/bdcc8020015 ↗
27. On predicting sensor readings with sequence modeling and reinforcement learning for energy-efficient IoT applications10.1109/TSMC.2021.3116141 ↗
28. Attention enhanced multi-agent reinforcement learning for cooperative spectrum sensing in cognitive radio networks10.1109/TVT.2024.3384393 ↗
29. RL-IoT: Reinforcement learning-based routing approach for cognitive radio-enabled IoT communications10.1109/JIOT.2022.3210703 ↗
30. Spectrum access in cognitive IoT using reinforcement learning10.1007/s10586-021-03306-3 ↗
31. Reinforcement-learning-based dynamic spectrum access for software-defined cognitive industrial internet of things10.1109/TII.2021.3113949 ↗
32. Cooperative multi-agent reinforcement-learning-based distributed dynamic spectrum access in cognitive radio networks10.1109/JIOT.2022.3168296 ↗
33. Hemelatha, S., Kumar, A., Manchanda, M., Manashree, K.G., and Kulkarni, O.S. (2024, January 25–26). Cognitive Radio-Enabled Internet of Things Communications: A Reinforcement Learning-Based Routing Method. Proceedings of the 2024 Global Conference on Communications and Information Technologies (GCCIT), Bangalore, India.10.1109/GCCIT63234.2024.10862746 ↗
34. Multi-agent reinforcement learning based optimal energy sensing threshold control in distributed cognitive radio networks with directional antenna10.1016/j.icte.2024.01.001 ↗
35. Multi-objective intelligent clustering routing schema for internet of things enabled wireless sensor networks using deep reinforcement learning10.1007/s10586-023-04218-0 ↗
36. Cognitive intelligence in industrial robots and manufacturing10.1016/j.cie.2024.110106 ↗
37. Dvir, E., Shifrin, M., and Gurewitz, O. (2024). Cooperative Multi-Agent Reinforcement Learning for Data Gathering in Energy-Harvesting Wireless Sensor Networks. Mathematics, 12.10.3390/math12132102 ↗
38. Matei, A., and Cocoșatu, M. (2024). Artificial Internet of Things, sensor-based digital twin urban computing vision algorithms, and blockchain cloud networks in sustainable smart city administration. Sustainability, 16.10.3390/su16166749 ↗
39. Context-Aware Prediction with Secure and Lightweight Cognitive Decision Model in Smart Cities10.1007/s12559-025-10403-7 ↗
40. Sultan, S.M., Waleed, M., Pyun, J.Y., and Um, T.W. (2021). Energy conservation for internet of things tracking applications using deep reinforcement learning. Sensors, 21.10.3390/s21093261 ↗
41. Bai, W., Zheng, G., Xia, W., Mu, Y., and Xue, Y. (2025). Multi-User Opportunistic Spectrum Access for Cognitive Radio Networks Based on Multi-Head Self-Attention and Multi-Agent Deep Reinforcement Learning. Sensors, 25.10.3390/s25072025 ↗
42. Reinforcement learning for optimizing real-time interventions and personalized feedback using wearable sensors10.1016/j.measen.2024.101151 ↗
43. Intelligent data routing strategy based on federated deep reinforcement learning for IOT-enabled wireless sensor networks10.1016/j.measen.2023.101012 ↗
44. Chen, J., Zhang, Z., Fan, D., Hou, C., Zhang, Y., Hou, T., Zou, X., and Zhao, J. (2025). Distributed Decision Making for Electromagnetic Radiation Source Localization Using Multi-Agent Deep Reinforcement Learning. Drones, 9.10.3390/drones9030216 ↗
45. Deep reinforcement learning for cognitive radar spectrum sharing: A continuous control approach10.1109/TRS.2024.3353112 ↗
46. Mei, R., and Wang, Z. (2024). Multi-Agent Deep Reinforcement Learning-Based Resource Allocation for Cognitive Radio Networks. IEEE Trans. Veh. Technol.10.1109/TVT.2024.3486156 ↗
47. Canese, L., Cardarilli, G.C., Dehghan Pir, M.M., Di Nunzio, L., and Spanò, S. (2024). Design and Development of Multi-Agent Reinforcement Learning Intelligence on the Robotarium Platform for Embedded System Applications. Electronics, 13.10.3390/electronics13101819 ↗
48. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal policy optimization algorithms. arXiv.