journal article·2025-09-16Open access

VoteSim: Voting-Based Binary Code Similarity Detection for Vulnerability Identification in IoT Firmware

Keda Sun, Shize Zhou, Yuwei Meng, Wei Ruan, Liang Chen

Applied Sciences· Volume 15· Issue 18

Abstract

The widespread integration of third-party components (TPCs) in Internet of Things (IoT) firmware significantly increases the risk of software vulnerabilities, especially in resource-constrained devices deployed in sensitive environments. Binary Code Similarity Detection (BCSD) techniques, particularly those based on deep neural networks, have emerged as powerful tools for identifying vulnerable functions without access to source code. However, individual models, such as Graph Neural Networks (GNNs), Convolutional Neural Networks (CNNs), and Transformer-based methods, often exhibit limitations due to their differing focus on structural, spatial, or semantic features. To address this, we propose VoteSim, a novel ensemble framework that integrates multiple BCSD models using an inverse average rank voting mechanism. VoteSim combines the strengths of individual models while reducing the impact of model-specific false positives, leading to more stable and accurate vulnerability detection. We evaluate VoteSim on a large-scale real-world IoT firmware dataset comprising over 800,000 binary functions and 10 high-risk CVEs. Experimental results show that VoteSim consistently outperforms state-of-the-art BCSD models in both Recall@10 and Mean Reciprocal Rank (MRR), achieving improvements of up to 14.7% in recall. Our findings highlight the importance of model diversity and rank-aware aggregation for robust binary-level vulnerability detection in heterogeneous IoT firmware.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Malware Detection Techniques · Software Engineering Research · Network Security and Intrusion Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Zhejiang Provincial Energy Group Company Ltd., Hangzhou 310007, China

College of Control Science and Engineering, Zhejiang University, Hangzhou 310007, China

References (36)

Show source-provided references
1. Mehdipour, F. (2020, January 14–15). A Review of IoT Security Challenges and Solutions. Proceedings of the 2020 8th International Japan-Africa Conference on Electronics, Communications, and Computations (JAC-ECC), Online.10.1109/JAC-ECC51597.2020.9355854 ↗
2. Luo, Z., Wang, P., Xie, W., Zhou, X., and Wang, B. (2023). IoTSim: Internet of things-oriented binary code similarity detection with multiple block relations. Sensors, 23.10.3390/s23187789 ↗
3. A Survey on Security and Privacy Issues in Internet-of-Things10.1109/JIOT.2017.2694844 ↗
4. Detecting vulnerability on IoT device firmware: A survey10.1109/JAS.2022.105860 ↗
5. Wu, Y., Wang, J., Wang, Y., Zhai, S., Li, Z., He, Y., Sun, K., Li, Q., and Zhang, N. (2024, January 14–16). Your firmware has arrived: A study of firmware update vulnerabilities. Proceedings of the 33rd USENIX Security Symposium (USENIX Security 24), Philadelphia, PA, USA.
6. Sun, H., Zhou, W., and Fei, M. (2020, January 17–19). A Survey On Graph Matching in Computer Vision. Proceedings of the 2020 13th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), IEEE, Chengdu, China.10.1109/CISP-BMEI51763.2020.9263681 ↗
7. Gao, D., Reiter, M.K., and Song, D.X. (2008, January 20–22). BinHunt: Automatically finding semantic differences in binary programs. Proceedings of the 10th International Conference on Information and Communications Security (ICICS), Birmingham, UK.10.1007/978-3-540-88625-9_16 ↗
8. Dullien, T., and Rolles, R. (2005, January 7–11). BinDiff: Finding similarities in binary code. Proceedings of the Conference on Reverse Engineering, Pittsburgh, PA, USA.
9. Rabin, M.O., and Broder, A.Z. (2001, January 9–13). Hashing for Similarity Search: An Empirical Evaluation. Proceedings of the International Conference on Research and Development in Information Retrieval (SIGIR), New Orleans, LA, USA.
10. Focus: Function clone identification on cross-platform10.1002/int.22752 ↗
11. Gao, J., Yang, X., Fu, Y., Jiang, Y., and Sun, J. (2018, January 3–7). VulSeeker: A Semantic Learning Based Vulnerability Seeker for Cross-Platform Binary. Proceedings of the 2018 33rd IEEE/ACM International Conference on Automated Software Engineering (ASE), Montpellier, France.10.1145/3238147.3240480 ↗
12. Multilevel graph matching networks for deep graph similarity learning10.1109/TNNLS.2021.3102234 ↗
13. Massarelli, L., Di Luna, G.A., Petroni, F., Querzoni, L., and Baldoni, R. (2019, January 24). Investigating graph embedding neural networks with unsupervised features extraction for binary analysis. Proceedings of the 2nd Workshop on Binary Analysis Research (BAR), San Diego, CA, USA.10.14722/bar.2019.23020 ↗
14. Codee: A tensor embedding scheme for binary code search10.1109/TSE.2021.3056139 ↗
15. Liu, B., Huo, W., Zhang, C., Li, W., Li, F., Piao, A., and Zou, W. (2018, January 3–7). αDiff: Cross-version binary code similarity detection with DNN. Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering, Montpellier, France.10.1145/3238147.3238199 ↗
16. Yu, Z., Cao, R., Tang, Q., Nie, S., Huang, J., and Wu, S. (2020, January 7–12). Order matters: Semantic-aware neural networks for binary code similarity detection. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i01.5466 ↗
17. Wang, H., Qu, W., Katz, G., Zhu, W., Gao, Z., Qiu, H., Zhuge, J., and Zhang, C. (2022). jTrans: Jump-Aware Transformer for Binary Code Similarity. arXiv.10.1145/3533767.3534367 ↗
18. Wang, H., Gao, Z., Zhang, C., Sha, Z., Sun, M., Zhou, Y., Zhu, W., Sun, W., Qiu, H., and Xiao, X. (2024, January 16–20). CLAP: Learning Transferable Binary Code Representations with Natural Language Supervision. Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2024), Vienna, Austria.10.1145/3650212.3652145 ↗
19. Wang, H., Gao, Z., Zhang, C., Sun, M., Zhou, Y., Qiu, H., and Xiao, X. (2024). CEBin: A Cost-Effective Framework for Large-Scale Binary Code Similarity Detection. arXiv.10.1145/3650212.3652117 ↗
20. Zhou, S., Fu, L., Liu, P., and Wang, W. (2025, January 4–7). BinEGA: Enhancing DNN-based Binary Code Similarity Detection through Efficient Graph Alignment. Proceedings of the 2025 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), Montreal, QC, Canada.10.1109/SANER64311.2025.00052 ↗
21. Fu, L., Liu, P., Meng, W., Lu, K., Zhou, S., Zhang, X., Chen, W., and Ji, S. (2024). Understanding the AI-powered Binary Code Similarity Detection. arXiv.
22. Dwork, C., Kumar, R., Naor, M., and Sivakumar, D. (2001, January 1–5). Rank aggregation methods for the web. Proceedings of the 10th International Conference on World Wide Web, Hong Kong, China.10.1145/371920.372165 ↗
23. Rank aggregation methods10.1002/wics.111 ↗
24. Dietterich, T.G. (2000, January 21–23). Ensemble methods in machine learning. Proceedings of the International Workshop on Multiple Classifier Systems, Cagliari, Italy.10.1007/3-540-45014-9_1 ↗
25. Enhancing DNN-Based Binary Code Function Search with Low-Cost Equivalence Checking10.1109/TSE.2022.3149240 ↗
26. BINCODEX: A comprehensive and multi-level dataset for evaluating binary code similarity detection techniques10.1016/j.tbench.2024.100163 ↗
27. Xu, X., Liu, C., Feng, Q., Yin, H., Song, L., and Song, D. (November, January 30). Neural Network-based Graph Embedding for Cross-Platform Binary Code Similarity Detection. Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security, CCS’17, Dallas, TX, USA.10.1145/3133956.3134018 ↗
28. Schoonaert, B., Kim, H.J., and Paek, Y.H. (2024, January 16–18). A Study on Binary Code Similarity Detection. Proceedings of the Annual Conference of KIPS. Korea Information Processing Society, Jeju, Republic of Korea.
29. Yang, S., Cheng, L., Zeng, Y., Lang, Z., Zhu, H., and Shi, Z. (2021, January 21–24). Asteria: Deep learning-based AST-encoding for cross-platform binary code similarity detection. Proceedings of the 2021 51st Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Taipei, Taiwan.10.1109/DSN48987.2021.00036 ↗
30. Halder, A., Dalal, A., Gharami, S., Wozniak, M., Ijaz, M.F., and Singh, P.K. (2025). A fuzzy rank-based deep ensemble methodology for multi-class skin cancer classification. Sci. Rep., 15.10.1038/s41598-025-90423-3 ↗
31. Reviews research on applying machine learning techniques to reduce false positives for network intrusion detection systems10.58496/BJML/2023/005 ↗
32. False Positive Identification in Intrusion Detection Using XAI10.1109/TLA.2023.10172140 ↗
33. The use of voting ensembles to improve the accuracy of deep neural networks as a non-invasive method to predict embryo ploidy status10.1007/s10815-022-02707-6 ↗
34. Modified Metaheuristics with Weighted Majority Voting Ensemble Deep Learning Model for Intrusion Detection System10.32604/csse.2023.041446 ↗
35. Effective Voting-Based Ensemble Learning for Segregated Load Forecasting with Low Sampling Data10.1109/ACCESS.2024.3413679 ↗
36. Re-ranking and TOPSIS-based ensemble feature selection with multi-stage aggregation for text categorization10.1016/j.patrec.2023.02.027 ↗