journal article·2024Open access

Optimized Binary Neural Networks for Road Anomaly Detection: A TinyML Approach on Edge Devices

Weixing Wang, Asad Ullah, Limin Li, Mengfei Wang

Computers, Materials & Continua· Volume 80· Issue 1

Abstract

Integrating Tiny Machine Learning (TinyML) with edge computing in remotely sensed images enhances the capabilities of road anomaly detection on a broader level. Constrained devices efficiently implement a Binary Neural Network (BNN) for road feature extraction, utilizing quantization and compression through a pruning strategy. The modifications resulted in a 28-fold decrease in memory usage and a 25% enhancement in inference speed while only experiencing a 2.5% decrease in accuracy. It showcases its superiority over conventional detection algorithms in different road image scenarios. Although constrained by computer resources and training datasets, our results indicate opportunities for future research, demonstrating that quantization and focused optimization can significantly improve machine learning models’ accuracy and operational efficiency. ARM Cortex-M0 gives practical feasibility and substantial benefits while deploying our optimized BNN model on this low-power device: Advanced machine learning in edge computing. The analysis work delves into the educational significance of TinyML and its essential function in analyzing road networks using remote sensing, suggesting ways to improve smart city frameworks in road network assessment, traffic management, and autonomous vehicle navigation systems by emphasizing the importance of new technologies for maintaining and safeguarding road networks.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Automated Road and Building Extraction · Advanced Neural Network Applications · Remote Sensing and LiDAR Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (41)

Show source-provided references
1. TinyML meets IoT: A comprehensive survey10.1016/j.iot.2021.100461 ↗
2. Intelligent and efficient IoT through the cooperation of TinyML and edge computing10.15388/22-INFOR505 ↗
3. TinyML: Enabling of inference deep learning models on ultra-low-power IoT edge devices for AI applications10.3390/mi13060851 ↗
4. TinyML algorithms for big data management in large-scale iot systems10.3390/fi16020042 ↗
5. ChatGPT: Vision and challenges10.1016/j.iotcps.2023.05.004 ↗
6. A comprehensive study of anomaly detection schemes in iot networks using machine learning algorithms10.3390/s21248320 ↗
7. DDD TinyML: A TinyML-Based driver drowsiness detection model using deep learning10.3390/s23125696 ↗
8. An unsupervised tinyML approach applied for pavement anomalies detection under the internet of intelligent vehicles
9. An ultra-low power tinyml system for real-time visual processing at edge
10. LogUAD: Log unsupervised anomaly detection based on word2vec10.32604/csse.2022.022365 ↗
11. T. Li, “Curvilinear structure detection in images by Connected-tube marked point process and anomaly detection in time series,” Ph.D. dissertation, Purdue Univ., West Lafayette, Indiana, USA, 2023.
12. An 8-bit single perceptron processing unit for tiny machine learning applications10.1109/ACCESS.2023.3327517 ↗
13. Comparative analysis of alexnet, resnet18 and squeezenet with diverse modification and arduous implementation10.1007/s13369-021-06182-6 ↗
14. Gray-level image transformation of paved road cracks with metaphorical and computational analysis
15. Simultaneous road surface and centerline extraction from large-scale remote sensing images using CNN-based segmentation and tracing10.1109/TGRS.2020.2991733 ↗
16. Accurate seat belt detection in road surveillance images based on CNN and SVM10.1016/j.neucom.2016.06.098 ↗
17. Road extraction methods in high-resolution remote sensing images: A comprehensive review10.1109/JSTARS.2020.3023549 ↗
18. Highly curved lane detection algorithms based on Kalman filter10.3390/app10072372 ↗
19. Experimental and numerical research of paved microcrack using histogram equalization for detection and segmentation
20. Hyperspectral anomaly detection using deep learning: A review10.3390/rs14091973 ↗
21. L. González Navarro, “Design of a tiny machine learning system for UWB radar based multi-target detection,” M.S. thesis, Dept. Señales, Sistemas y Radiocomunicaciones, E.T.S.I. Telecomunicación, Univ. Politécnica de Madrid, Madrid, Spain, Oct. 2022.
22. P. Rajendra, “TinyML for gait stride classification,” M.S. thesis, Dept. of Electrical and Computer Engineering Univ. of Nevada, Las Vegas, NV, USA, 2021.
23. TinyML: A systematic review and synthesis of existing research
24. A review of point clouds segmentation and classification algorithms
25. Mixed script identification using automated DNN hyperparameter optimization10.1155/2021/8415333 ↗
26. C. R. Banbury et al., “Benchmarking TinyML systems: Challenges and direction,” Mar. 2020. doi: 10.48550/arXiv.2003.04821.
27. On Network embedding for machine learning on road networks: A case study on the danish road network
28. Elements of TinyML on constrained resource hardware
29. A comprehensive survey on TinyML10.1109/ACCESS.2023.3294111 ↗
30. URLLC-awared resource allocation for heterogeneous vehicular edge computing
31. A low-power analog processor-in-memory-based convolutional neural network for biosensor applications10.3390/s22124555 ↗
32. A 0.57 mW@1 FPS in-column analog CNN processor integrated into CMOS image sensor10.1109/ACCESS.2023.3286544 ↗
33. Unlocking edge intelligence through tiny machine learning (TinyML)10.1109/ACCESS.2022.3207200 ↗
34. H-CNN: Spatial hashing based CNN for 3D shape analysis10.1109/TVCG.2018.2887262 ↗
35. Deep convolutional neural network for inverse problems in imaging10.1109/TIP.2017.2713099 ↗
36. TinyRadar: MmWave radar based human activity classification for edge computing
37. TinyRadar for fitness: A contactless framework for edge computing10.1109/TBCAS.2023.3244240 ↗
38. Soft error reliability assessment of neural networks on resource-constrained iot devices
39. A novel framework for the deployment of CNN models using post-training quantization on microcontroller10.1016/j.micpro.2022.104634 ↗
40. How to generate image dataset based on 3D model and deep learning method10.14419/ijet.v7i3.34.18969 ↗
41. A dynamic reconfigurable architecture for hybrid spiking and convolutional FPGA-based neural network designs10.3390/jlpea11030032 ↗