Cross-Project Software Defect Prediction Based on SMOTE and Deep Canonical Correlation Analysis
Source abstract
Abstract
Cross-Project Defect Prediction (CPDP) is a method that utilizes historical data from other source projects to train predictive models for defect prediction in the target project. However, existing CPDP methods only consider linear correlations between features (indicators) of the source and target projects. These models are not capable of evaluating non-linear correlations between features when they exist, for example, when there are differences in data distributions between the source and target projects. As a result, the performance of such CPDP models is compromised. In this paper, this paper proposes a novel CPDP method based on Synthetic Minority Oversampling Technique (SMOTE) and Deep Canonical Correlation Analysis (DCCA), referred to as S-DCCA. Canonical Correlation Analysis (CCA) is employed to address the issue of non-linear correlations between features of the source and target projects. S-DCCA extends CCA by incorporating the MlpNet model for feature extraction from the dataset. The redundant features are then eliminated by maximizing the correlated feature subset using the CCA loss function. Finally, cross-project defect prediction is achieved through the application of the SMOTE data sampling technique. Area Under Curve (AUC) and F1 scores (F1) are used as evaluation metrics. This paper conducted experiments on 27 projects from four public datasets to validate the proposed method. The results demonstrate that, on average, our method outperforms all baseline approaches by at least 1.2% in AUC and 5.5% in F1 score. This indicates that the proposed method exhibits favorable performance characteristics.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Software Engineering Research · Software Reliability and Analysis Research · Advanced Decision-Making Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (50)
Show source-provided references
1. On the value of oversampling for deep learning in software defect prediction10.1109/TSE.2021.3079841 ↗
2. On the relative value of cross-company and within-company data for defect prediction10.1007/s10664-008-9103-7 ↗
3. Heterogeneous defect prediction10.1109/TSE.2017.2720603 ↗
4. Cross-project defect prediction: A large scale experiment on data vs. domain vs. process
5. Cross project defect prediction using class distribution estimation and oversampling10.1016/j.infsof.2018.04.001 ↗
6. Deep semantic feature learning for software defect prediction10.1109/TSE.2018.2877612 ↗
7. Revisiting supervised and unsupervised methods for effort-aware cross-project defect prediction
8. An improved SDA based defect prediction framework for both within-project and cross-project class-imbalance problems10.1109/TSE.2016.2597849 ↗
9. A novel class-imbalance learning approach for both within-project and cross-project defect prediction
10. Transfer defect learning
11. Value-cognitive boosting with a support vector machine for cross-project defect prediction10.1007/s10664-014-9346-4 ↗
12. Heterogeneous cross-company defect prediction by unified metric representation and CCA-based transfer learning
13. Correlation feature and instance weights transfer learning for cross project software defect prediction10.1049/sfw2.12012 ↗
14. An improved method for training data selection for cross-project defect prediction10.1007/s13369-021-06088-3 ↗
15. Joint feature representation learning and progressive distribution matching for cross-project defect prediction10.1016/j.infsof.2021.106588 ↗
16. Cross-project defect prediction considering multiple data distribution simultaneously10.3390/sym14020401 ↗
17. An empirical study on combining source selection and transfer learning for cross-project defect prediction
18. A two-phase transfer learning model for cross-project defect prediction10.1016/j.infsof.2018.11.005 ↗
19. Using bandit algorithms for project selection in cross-project defect prediction
20. Joint distribution matching model for distribution-adaptation-based cross-project defect prediction10.1049/iet-sen.2018.5131 ↗
21. Understanding the automated parameter optimization on transfer learning for cross-project defect prediction: An empirical study
22. Feature extraction to heterogeneous cross project defect prediction
23. Isolation forest filter to simplify training data for cross-project defect prediction
24. An empirical study on the effectiveness of feature selection for cross-project defect prediction10.1109/ACCESS.2019.2895614 ↗
25. Better cross company defect prediction
26. An improved method for cross-project defect prediction by simplifying training data10.1155/2018/2650415 ↗
27. ALTRA: Cross-project software defect prediction via active learning and tradaboost10.1109/ACCESS.2020.2972644 ↗
28. Cross project defect prediction via balanced distribution adaptation based transfer learning10.1007/s11390-019-1959-z ↗
29. Deep canonical correlation analysis
30. Relations between two sets of variates10.1007/978-1-4612-4380-9_14 ↗
31. Cost-sensitive transfer kernel canonical correlation analysis for heterogeneous defect prediction10.1007/s10515-017-0220-7 ↗
32. W. Liu, J. L. Qiu, W. L. Zheng and B. L. Lu, “Multimodal emotion recognition using deep canonical correlation analysis,” arXiv:1908.05349, 2019.
33. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
34. Cross-project defect prediction using data sampling for class imbalance learning: An empirical study10.1080/17445760.2019.1650039 ↗
35. Grouped SMOTE with noise filtering mechanism for classifying imbalanced data10.1109/ACCESS.2019.2955086 ↗
36. On the relative value of data resampling approaches for software defect prediction10.1007/s10664-018-9633-6 ↗
37. Adaptive decision threshold-based extreme learning machine for classifying imbalanced multi-label data10.1007/s11063-020-10343-3 ↗
38. The PROMISE repository of empirical software engineering data
39. Evaluating defect prediction approaches: A benchmark and an extensive comparison10.1007/s10664-011-9173-9 ↗
40. Relink: Recovering links between bugs and changes
41. A data transfer and relevant metrics matching based approach for heterogeneous defect prediction10.1109/TSE.2022.3173678 ↗
42. Cross-project defect prediction method based on manifold feature transformation10.3390/fi13080216 ↗
43. CFPS: Collaborative filtering based source projects selection for cross-project defect prediction10.1016/j.asoc.2020.106940 ↗
44. ADASYN: Adaptive synthetic sampling approach for imbalanced learning
45. An empirical comparison of model validation techniques for defect prediction models10.1109/TSE.2016.2584050 ↗
46. On the multiple sources and privacy preservation issues for heterogeneous defect prediction10.1109/TSE.2017.2780222 ↗
47. How far we have progressed in the journey? An examination of cross-project defect prediction10.1145/3183339 ↗
48. Transfer feature learning with joint distribution adaptation
49. Balanced distribution adaptation for transfer learning
50. Transfer learning with dynamic distribution adaptation