journal article·2026-06-12Open access

Resilient Edge-IVA: Perception-Aware Adaptive Control for Stable Real-Time Analytics on Resource-Constrained Devices

Hansol Jung, Byoungkug Kim

Applied Sciences· Volume 16· Issue 12

Abstract

This paper presents Resilient Edge-IVA (Intelligent Video Analytics), an integrated framework designed to ensure real-time inference stability and high-speed embedding-based similarity search in resource-constrained edge computing environments. Conventional systems often face Quality of Experience (QoE) degradation caused by computational overhead and hardware-level bottlenecks. To address these challenges, this study proposes a “Whole-cycle” methodology employing a perception-driven, three-tier adaptive control algorithm. This algorithm dynamically modulates encoding parameters, such as resolution and bitrate, by utilizing real-time inference latency and CPU utilization as feedback signals. Furthermore, the framework incorporates an event-density-based Data Diet mechanism. This mechanism selectively adjusts video quality based on object detection results, preserving high-fidelity imagery for critical events while significantly reducing data volume during static intervals. The backend implements a hybrid storage architecture combining the Milvus vector database for CLIP-based high-dimensional visual embeddings with a PostgreSQL relational database for structured metadata. These systems are linked via a deterministic hash key to ensure data atomicity and facilitate high-speed, multi-dimensional embedding-based retrieval. Experimental evaluations conducted on a Raspberry Pi 5 and Hailo-8 NPU demonstrate that the proposed framework maintains a frame drop rate below 0.3% even under extreme workloads, providing a 13-fold improvement in operational stability over static configurations. The results also confirm a 54.2% reduction in total storage occupancy and a Hash Mapping Consistency (HMC) score of 0.89. These findings validate the framework’s effectiveness in reconciling real-time processing stability with storage efficiency. Building upon this baseline, future research will extend the framework to multi-class environments, targeting applications such as Intelligent Transport Systems (ITS).
Source: crossref · Quality: baseline

Research context

OpenAlex topics: IoT and Edge/Fog Computing · Image and Video Quality Assessment · Video Surveillance and Tracking Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, Sahmyook University, Seoul 01795, Republic of Korea

References (31)

Show source-provided references
1. Redmon, J., and Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv.
2. Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing10.1109/JPROC.2019.2918951 ↗
3. Edge Video Analytics: A Survey on Applications, Systems and Enabling Techniques10.1109/COMST.2023.3323091 ↗
4. ByteTrack: Multi-Object Tracking by Associating Every Detection Box
5. Wojke, N., Bewley, A., and Paulus, D. (2017, January 17–20). Simple Online and Realtime Tracking with a Deep Association Metric. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.10.1109/ICIP.2017.8296962 ↗
6. Aharon, N., Orfaig, R., and Bobrovsky, B.Z. (2022). BoT-SORT: Robust Associations Multi-Pedestrian Tracking. arXiv.
7. Zheng, L., Yang, Y., and Hauptmann, A.G. (2016). Person Re-Identification: Past, Present and Future. arXiv.
8. Efficient Processing of Deep Neural Networks: A Tutorial and Survey10.1109/JPROC.2017.2761740 ↗
9. Deep Learning With Edge Computing: A Review10.1109/JPROC.2019.2921977 ↗
10. Shen, Y., Ding, P., and Zhang, Z. (2023, January 14–16). An Adaptive Video Streaming Delivery Structure based on Mobile Edge Intelligent. Proceedings of the 2023 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Beijing, China.10.1109/BMSB58369.2023.10211148 ↗
11. Thermal-Aware Scheduling for Deep Learning on Mobile Devices With NPU10.1109/TMC.2024.3379501 ↗
12. Surantha, N., and Sutisna, N. (2025). Key Considerations for Real-Time Object Recognition on Edge Computing Devices. Appl. Sci., 15.10.3390/app15137533 ↗
13. Survey of vector database management systems10.1007/s00778-024-00864-x ↗
14. Zhang, B., Jin, X., Ratnasamy, S., Wawrzynek, J., and Lee, E.A. (2018, January 20–25). AWStream: Adaptive Wide-Area Streaming Analytics. Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM ’18), Budapest, Hungary.10.1145/3230543.3230554 ↗
15. Jiang, J., Ananthanarayanan, G., Bodik, P., Sen, S., and Stoica, I. (2018, January 20–25). Chameleon: Scalable Adaptation of Video Analytics. Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM ’18), Budapest, Hungary.10.1145/3230543.3230574 ↗
16. Wang, X., Zhao, Z., Min, G., Wang, Z., and Wang, Z. (2025). Edge AI Enabled Real-Time Video Analytics: A Full-Lifecycle Perspective. TechRxiv, TechRxiv:175744961.11927967/v1.10.36227/techrxiv.175744961.11927967/v1 ↗
17. Zhou, X., Ke, R., Yang, H., and Liu, C. (2021). When Intelligent Transportation Systems Sensing Meets Edge Computing: Vision and Challenges. Appl. Sci., 11.10.3390/app11209680 ↗
18. MEC-Enabled Video Streaming in Device-to-Device Networks10.1049/iet-com.2019.1198 ↗
19. Yavuz, B.Ç. (2026). Scale-Dependent Performance Analysis of YOLO26 and YOLOv11 for PPE Detection. Electronics, 15.10.3390/electronics15061146 ↗
20. Wang, J., Yi, X., Guo, R., Jin, H., Xu, P., Li, S., Wang, X., Guo, X., Li, C., and Xu, X. (2021, January 20–25). Milvus: A Purpose-Built Vector Data Management System. Proceedings of the 2021 International Conference on Management of Data (SIGMOD ’21), Virtual Event, China.10.1145/3448016.3457550 ↗
21. Efficient and Robust Approximate Nearest Neighbor Search Using Hierarchical Navigable Small World Graphs10.1109/TPAMI.2018.2889473 ↗
22. Park, T., Lee, H., Na, Y., and Kim, W.H. (2025). ON-NSW: Accelerating High-Dimensional Vector Search on Edge Devices with GPU-Optimized NSW. Sensors, 25.10.3390/s25206461 ↗
23. Ham, M., Moon, J., Lim, G., Jung, J., Ahn, H., and Song, W. (2021, January 25–28). NNStreamer: Efficient and Agile Development of On-Device AI Systems. Proceedings of the 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), Madrid, Spain.10.1109/ICSE-SEIP52600.2021.00029 ↗
24. GaussDB-Vector: A Large-Scale Persistent Real-Time Vector Database for LLM Applications10.14778/3750601.3750619 ↗
25. Yao, Z., Tang, Z., Lou, J., Shen, P., and Jia, W. (2024, January 7–13). VELO: A Vector Database-Assisted Cloud-Edge Collaborative LLM QoS Optimization Framework. Proceedings of the 2024 IEEE International Conference on Web Services (ICWS), Shenzhen, China.10.1109/ICWS62655.2024.00105 ↗
26. A Proposal of Data Diet System in CCTV Controlling System Using AI
27. Reuther, A., Michaleas, P., Jones, M., Gadepally, V., Samsi, S., and Kepner, J. (2019, January 24–26). Survey and Benchmarking of Machine Learning Accelerators. Proceedings of the 2019 IEEE High Performance Extreme Computing Conference (HPEC), Waltham, MA, USA.10.1109/HPEC.2019.8916327 ↗
28. Hailo Technologies (2023). Hailo-8 AI Processor: Product Brief, Hailo Technologies Ltd.. Available online: https://hailo.ai/products/ai-accelerators/hailo-8/.
29. Node.js: Using JavaScript to Build High-Performance Network Programs10.1109/MIC.2010.145 ↗
30. Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., and Clark, J. (2021, January 18–24). Learning transferable visual models from natural language supervision. Proceedings of the 38th International Conference on Machine Learning (ICML), Virtual.
31. Liang, S., and Wu, H. (2022). Edge YOLO: Real-Time Intelligent Object Detection System Based on Edge-Cloud Cooperation in Autonomous Vehicles. arXiv.10.1109/TITS.2022.3158253 ↗