Detecting Duplicates in Bug Tracking Systems with Artificial Intelligence: A Combined Retrieval and Classification Approach
Source abstract
Abstract
Duplicate bug reports increase the workload of software engineering teams and delay the resolution of critical issues, making automated detection essential. This paper presents a two-stage approach that combines transformer-based semantic retrieval with classical machine-learning classification. First, text features of the defect are vectorised using transformer models such as BERT (Bidirectional Encoder Representations from Transformers, google-bert/bert-base-uncased), MiniLM (Miniature Language Model, sentence-transformers/all-MiniLM-L6-v2) or MPNet (Masked and Permuted Pre-training for Language Understanding, sentence-transformers/all-mpnet-base-v2) to identify semantically similar reports and narrow the candidate search space. Second, the filtered pairs are classified using algorithms such as XGBoost (eXtreme Gradient Boosting), SVM (Support Vector Machines) or logistic regression to determine true duplicates. This hybrid method improves accuracy while substantially lowering computational cost. Experimental results validate the proposed approach, demonstrating robust accuracy and consistent performance in identifying duplicate defect reports.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Software Engineering Research · Academic integrity and plagiarism · Advanced Malware Detection Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Virtual Reality Systems, Institute of Computer Science and Information Technologies, Lviv Polytechnic National University, 79013 Lviv, Ukraine
Department of Automated Control Systems, Institute of Computer Science and Information Technologies, Lviv Polytechnic National University, 79013 Lviv, Ukraine
Department of Computer Technologies in Publishing and Printing Processes, Institute of Printing Art and Media Technologies, Lviv Polytechnic National University, 79013 Lviv, Ukraine
References (46)
Show source-provided references
1. Guo, P.J., Zimmermann, T., Nagappan, N., and Murphy, B. (2010, January 1–8). Characterizing and predicting which bugs get fixed: An empirical study of Microsoft Windows. Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering (ICSE 2010), Cape Town, South Africa.10.1145/1806799.1806871 ↗
2. Studying the needed effort for identifying duplicate issues10.1007/s10664-015-9404-6 ↗
3. Bettenburg, N., Premraj, R., Zimmermann, T., and Kim, S. (October, January 28). Duplicate bug reports considered harmful… really?. Proceedings of the IEEE International Conference on Software Maintenance (ICSM 2008), Beijing, China.10.1109/ICSM.2008.4658082 ↗
4. Herzig, K., Just, S., and Zeller, A. (2013, January 18–26). It’s not a bug, it’s a feature: How misclassification impacts bug prediction. Proceedings of the 35th International Conference on Software Engineering (ICSE 2013), San Francisco, CA, USA.10.1109/ICSE.2013.6606585 ↗
5. Runeson, P., Alexandersson, M., and Nyholm, O. (2007, January 20–26). Detection of duplicate defect reports using natural language processing. Proceedings of the 29th International Conference on Software Engineering (ICSE 2007), Minneapolis, MN, USA.10.1109/ICSE.2007.32 ↗
6. Wang, X., Zhang, L., Xie, T., Anvik, J., and Sun, J. (2008, January 10–18). An approach to detecting duplicate bug reports using natural language and execution information. Proceedings of the 30th International Conference on Software Engineering (ICSE 2008), Leipzig, Germany.
7. The bug report duplication problem: An exploratory study10.1007/s11219-011-9164-5 ↗
8. Lazar, A., Ritchey, S., and Sharif, B. (June, January 31). Generating duplicate bug datasets. Proceedings of the 11th Working Conference on Mining Software Repositories (MSR 2014), Hyderabad, India.10.1145/2597073.2597128 ↗
9. Duplicate bug report detection: How far are we?
10. Sun, C., Lo, D., Khoo, S.-C., and Jiang, J. (2011, January 6–10). Towards more accurate retrieval of duplicate bug reports. Proceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011), Lawrence, KS, USA.10.1109/ASE.2011.6100061 ↗
11. Nguyen, A.T., Nguyen, T.T., Nguyen, T.N., Lo, D., and Sun, C. (2012, January 3–7). Duplicate bug report detection with a combination of information retrieval and topic modeling. Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering (ASE 2012), Essen, Germany.10.1145/2351676.2351687 ↗
12. Identifying duplicate bug records using Word2Vec prediction with software risk analysis10.12785/ijcds/110162 ↗
13. He, J., Xu, L., Yan, M., Xia, X., and Lei, Y. (2020, January 13–15). Duplicate bug report detection using dual-channel convolutional neural networks. Proceedings of the 28th International Conference on Program Comprehension (ICPC 2020), Seoul, Republic of Korea.10.1145/3387904.3389263 ↗
14. SiameseQAT: A semantic context-based duplicate bug report detection using replicated cluster information10.1109/ACCESS.2021.3066283 ↗
15. Xiao, G., Du, X., Sui, Y., and Yue, T. (2020, January 12–15). HINDBR: Heterogeneous information network-based duplicate bug report prediction. Proceedings of the 31st IEEE International Symposium on Software Reliability Engineering (ISSRE 2020), Red Hook, NY, USA.10.1109/ISSRE5003.2020.00027 ↗
16. An HMM-based approach for automatic detection and classification of duplicate bug reports10.1016/j.infsof.2019.05.007 ↗
17. Using bug descriptions to reformulate queries during text-retrieval-based bug localization10.1007/s10664-018-9672-z ↗
18. On the relationship between bug reports and queries for text retrieval-based bug localization10.1007/s10664-020-09823-w ↗
19. Senkivskyy, V., Pikh, I., Senkivska, N., Hileta, I., Lytovchenko, O., and Petyak, Y. (2020). Forecasting assessment of printing process quality. Advances in Intelligent Systems and Computing Lecture Notes in Computational Intelligence and Decision Making, Springer.10.1007/978-3-030-54215-3_30 ↗
20. Senkivskyy, V., Babichev, S., Pikh, I., Kudriashova, A., Senkivska, N., and Kalynii, I. (2021, January 16–17). Forecasting the reader’s demand level based on factors of interest in the book. Proceedings of the CIT-Risk’2021: 2nd International Workshop on Computational & Information Technologies for Risk-Informed Systems, Kherson, Ukraine. Available online: https://ceur-ws.org/Vol-3101/Paper12.pdf.
21. Models of factors of the design process of reference and encyclopedic book editions
22. Senkivskyi, V., Kudriashova, A., Pikh, I., Hileta, I., and Lytovchenko, O. (2019, January 23–25). Models of postpress processes designing. Proceedings of the 1st International Workshop on Digital Content & Smart Multimedia (DCSMart 2019), Lviv, Ukraine. Available online: https://ceur-ws.org/Vol-2533/paper24.pdf.
23. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019, January 2–7). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019), Volume 1 (Long and Short Papers), Minneapolis, MN, USA.
24. Reimers, N., and Gurevych, I. (2019, January 3–7). Sentence-BERT: Sentence embeddings using Siamese BERT-networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.10.18653/v1/D19-1410 ↗
25. MiniLM: Deep self-attention distillation for task-agnostic compression of pre-trained transformers
26. MPNet: Masked and permuted pre-training for language understanding
27. Yang, X., Lo, D., Xia, X., Bao, L., and Sun, J. (2016, January 23–27). Combining word embedding with information retrieval to recommend similar bug reports. Proceedings of the IEEE 27th International Symposium on Software Reliability Engineering, Ottawa, ON, Canada.10.1109/ISSRE.2016.33 ↗
28. A contextual approach towards more accurate duplicate bug report detection and ranking10.1007/s10664-015-9387-3 ↗
29. Revisiting the performance evaluation of automated approaches for the retrieval of duplicate issue reports10.1109/TSE.2017.2755005 ↗
30. Deshmukh, J., Annervaz, K.M., Podder, S., Sengupta, S., and Dubash, N. (2017, January 17–23). Towards accurate duplicate bug retrieval using deep learning techniques. Proceedings of the IEEE International Conference on Software Maintenance and Evolution, Shanghai, China.10.1109/ICSME.2017.69 ↗
31. Xie, Q., Wen, Z., Zhu, J., Gao, C., and Zheng, Z. (2018, January 4–7). Detecting duplicate bug reports with convolutional neural networks. Proceedings of the 25th Asia-Pacific Software Engineering Conference, Nara, Japan.10.1109/APSEC.2018.00056 ↗
32. Duplicate bug report detection using an attention-based neural language model10.1109/TR.2022.3193645 ↗
33. Duplicate bug report detection by using sentence embedding and Faiss
34. Yang, H., Xu, Y., Li, Y., and Choi, H.-D. (2020, January 12–15). K-Detector: Identifying duplicate crash failures in large-scale software delivery. Proceedings of the IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW 2020), Coimbra, Portugal.10.1109/ISSREW51248.2020.00028 ↗
35. Meng, Q., Zhang, X., Ramackers, G., and Visser, J. (2023, January 13–17). Combining retrieval and classification: Balancing efficiency and accuracy in duplicate bug report detection. Proceedings of the Eighteenth International Conference on Software Engineering Advances, ICSEA 2023, Valencia, Spain. Available online: http://personales.upv.es/thinkmind/dl/conferences/icsea/icsea_2023/icsea_2023_1_120_10057.pdf.
36. Amalgamation of classical and large language models for duplicate bug detection: A comparative study
37. Jahan, S., and Rahman, M.M. (2023, January 21–24). Towards understanding the impacts of textual dissimilarity on duplicate bug report detection. Proceedings of the IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2023), Taipa, Macao.10.1109/SANER56733.2023.00013 ↗
38. Isotani, H., Washizaki, H., Fukazawa, Y., Nomoto, T., Ouji, S., and Saito, S. (2023). Sentence embedding and fine-tuning to automatically identify duplicate bugs. Front. Comput. Sci., 4.10.3389/fcomp.2022.1032452 ↗
39. Muennighoff, N., Tazi, N., Magne, L., and Reimers, N. (2023, January 2–6). MTEB: Massive text embedding benchmark. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, Dubrovnik, Croatia.10.18653/v1/2023.eacl-main.148 ↗
40. A comprehensive survey and experimental comparison of graph-based approximate nearest neighbor search10.14778/3476249.3476255 ↗
41. Manning, C.D., Raghavan, P., and Schutze, H. (2008). Introduction to Information Retrieval, Cambridge University Press.10.1017/CBO9780511809071 ↗
42. Bishop, C.M., and Nasrabadi, N.M. (2006). Pattern Recognition and Machine Learning, Springer. Available online: https://link.springer.com/9780387310732.
43. Cryptographic information protection algorithm selection optimization for electronic governance IT project management by the analytic hierarchy process based on nonlinear conclusion criteria
44. Babichev, S., Durnyak, B., Zhydetskyy, V., Pikh, I., and Senkivskyy, V. (2019, January 19). Techniques of DNA microarray data pre-processing based on the complex use of bioconductor tools and Shannon entropy. Proceedings of the Second International Workshop on Computer Modeling and Intelligent Systems (CMIS-2019), Zaporizhzhia, Ukraine. Available online: https://ceur-ws.org/Vol-2353/paper29.pdf.10.32782/cmis/2353-29 ↗
45. Prognostic assessment of COVID-19 vaccination levels
46. Bidyuk, P., Gozhyj, A., Szymanski, Z., Kalinina, I., and Beglytsia, V. (2018, January 21–25). The methods bayesian analysis of the threshold stochastic volatility model. Proceedings of the 2018 IEEE Second International Conference on Data Stream Mining & Processing (DSMP), Lviv, Ukraine.10.1109/DSMP.2018.8478474 ↗