A Machine Learning Method with Hybrid Feature Selection for Improved Credit Card Fraud Detection
Source abstract
Abstract
With the rapid developments in electronic commerce and digital payment technologies, credit card transactions have increased significantly. Machine learning (ML) has been vital in analyzing customer data to detect and prevent fraud. However, the presence of redundant and irrelevant features in most real-world credit card data degrades the performance of ML classifiers. This study proposes a hybrid feature-selection technique consisting of filter and wrapper feature-selection steps to ensure that only the most relevant features are used for machine learning. The proposed method uses the information gain (IG) technique to rank the features, and the top-ranked features are fed to a genetic algorithm (GA) wrapper, which uses the extreme learning machine (ELM) as the learning algorithm. Meanwhile, the proposed GA wrapper is optimized for imbalanced classification using the geometric mean (G-mean) as the fitness function instead of the conventional accuracy metric. The proposed approach achieved a sensitivity and specificity of 0.997 and 0.994, respectively, outperforming other baseline techniques and methods in the recent literature.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Learning and ELM · Imbalanced Data Classification Techniques · Vehicle License Plate Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical and Electronic Engineering Science, University of Johannesburg, Johannesburg 2006, South Africa
Funding
South African National Research Foundation · South African National Research Foundation Incentive
References (89)
Show source-provided references
1. Autonomous credit card fraud detection using machine learning approach10.1016/j.compeleceng.2022.108132 ↗
2. Alharbi, A., Alshammari, M., Okon, O.D., Alabrah, A., Rauf, H.T., Alyami, H., and Meraj, T. (2022). A Novel text2IMG Mechanism of Credit Card Fraud Detection: A Deep Learning Approach. Electronics, 11.10.3390/electronics11050756 ↗
3. Review of Machine Learning Approach on Credit Card Fraud Detection10.1007/s44230-022-00004-0 ↗
4. Credit card fraud detection strategies with consumer incentives10.1016/j.omega.2018.07.001 ↗
5. Nandi, A.K., Randhawa, K.K., Chua, H.S., Seera, M., and Lim, C.P. (2022). Credit card fraud detection using a hierarchical behavior-knowledge space model. PLoS ONE, 17.10.1371/journal.pone.0260579 ↗
6. Performance Evaluation of Machine Learning Methods for Credit Card Fraud Detection Using SMOTE and AdaBoost10.1109/ACCESS.2021.3134330 ↗
7. Enhanced credit card fraud detection based on SVM-recursive feature elimination and hyper-parameters optimization
8. An efficient predictive analytics system for high dimensional big data
9. Assisting mental accounting using smartphones: Increasing the salience of credit card transactions helps consumer reduce their spending10.1016/j.chb.2020.106504 ↗
10. A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction10.3389/fbinf.2022.927312 ↗
11. de-la-Bandera, I., Palacios, D., Mendoza, J., and Barco, R. (2020). Feature Extraction for Dimensionality Reduction in Cellular Networks Performance Analysis. Sensors, 20.10.3390/s20236944 ↗
12. Bouaguel, W. (2016). Intelligent and Evolutionary Systems, Springer.
13. A survey on feature selection methods10.1016/j.compeleceng.2013.11.024 ↗
14. A Novel Feature Selection Method for Classification of Medical Data Using Filters, Wrappers, and Embedded Approaches10.1155/2022/8190814 ↗
15. Rumour detection using deep learning and filter-wrapper feature selection in benchmark twitter dataset10.1007/s11042-021-11340-x ↗
16. Household profile identification for behavioral demand response: A semi-supervised learning approach using smart meter data10.1016/j.energy.2021.121728 ↗
17. Wang, Z., Gao, S., Zhou, M., Sato, S., Cheng, J., and Wang, J. (2022). Information-Theory-based Nondominated Sorting Ant Colony Optimization for Multiobjective Feature Selection in Classification. IEEE Trans. Cybern., 1–14.10.1109/TCYB.2022.3185554 ↗
18. GAWA–A Feature Selection Method for Hybrid Sentiment Classification10.1109/ACCESS.2020.3030642 ↗
19. A machine learning based credit card fraud detection using the GA algorithm for feature selection10.1186/s40537-022-00573-8 ↗
20. Al-Ahmad, B., Al-Zoubi, A.M., Abu Khurma, R., and Aljarah, I. (2021). An Evolutionary Fake News Detection Method for COVID-19 Pandemic Information. Symmetry, 13.10.3390/sym13061091 ↗
21. The detection of Parkinson disease using the genetic algorithm and SVM classifier10.1016/j.apacoust.2020.107528 ↗
22. Huang, G.-B., Zhu, Q.-Y., and Siew, C.-K. (2004, January 25–29). Extreme learning machine: A new learning scheme of feedforward neural networks. Proceedings of the 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541), Budapest, Hungary.
23. Competition-Driven Multimodal Multiobjective Optimization and Its Application to Feature Selection for Credit Card Fraud Detection10.1109/TSMC.2022.3171549 ↗
24. Malik, E.F., Khaw, K.W., Belaton, B., Wong, W.P., and Chew, X. (2022). Credit Card Fraud Detection Using a New Hybrid Machine Learning Architecture. Mathematics, 10.10.3390/math10091480 ↗
25. Credit card fraud detection using a deep learning multistage model10.1007/s11227-022-04465-9 ↗
26. Credit Card Fraud Detection Using State-of-the-Art Machine Learning and Deep Learning Algorithms10.1109/ACCESS.2022.3166891 ↗
27. Inductive Graph Representation Learning for fraud detection10.1016/j.eswa.2021.116463 ↗
28. A Neural Network Ensemble with Feature Engineering for Improved Credit Card Fraud Detection10.1109/ACCESS.2022.3148298 ↗
29. The Optimized Anomaly Detection Models Based on an Approach of Dealing with Imbalanced Dataset for Credit Card Fraud Detection
30. A deep learning model for behavioural credit scoring in banks10.1007/s00521-021-06695-z ↗
31. Integrating data augmentation and hybrid feature selection for small sample credit risk assessment with high dimensionality10.1016/j.cor.2022.105937 ↗
32. IPMOD: An efficient outlier detection model for high-dimensional medical data streams10.1016/j.eswa.2021.116212 ↗
33. Chaquet-Ulldemolins, J., Gimeno-Blanes, F.-J., Moral-Rubio, S., Muñoz-Romero, S., and Rojo Álvarez, J.-L. (2022). On the Black-Box Challenge for Fraud Detection Using Machine Learning (I): Linear Models and Informative Feature Selection. Appl. Sci., 12.10.3390/app12073328 ↗
34. Wrapper feature selection method based differential evolution and extreme learning machine for intrusion detection system10.1016/j.patcog.2022.108912 ↗
35. BMPA-TVSinV: A Binary Marine Predators Algorithm using time-varying sine and V-shaped transfer functions for wrapper-based feature selection10.1016/j.knosys.2022.109446 ↗
36. Optimal Feature Selection Based on Evolutionary Algorithm for Intrusion Detection10.1007/s42979-022-01325-4 ↗
37. A novel ensemble-based wrapper method for feature selection using extreme learning machine and genetic algorithm10.1007/s10115-017-1131-4 ↗
38. Salazar, A., Safont, G., Rodriguez, A., and Vergara, L. (2016, January 12–14). Combination of multiple detectors for credit card fraud detection. Proceedings of the 2016 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Limassol, Cyprus.10.1109/ISSPIT.2016.7886023 ↗
39. Vergara, L., Salazar, A., Belda, J., Safont, G., Moral, S., and Iglesias, S. (2017, January 23–26). Signal processing on graphs for improving automatic credit card fraud detection. Proceedings of the 2017 International Carnahan Conference on Security Technology (ICCST), Madrid, Spain.10.1109/CCST.2017.8167820 ↗
40. A Deep Learning Ensemble With Data Resampling for Credit Card Fraud Detection10.1109/ACCESS.2023.3262020 ↗
41. Gkikas, D.C., Theodoridis, P.K., and Beligiannis, G.N. (2022). Enhanced Marketing Decision Making for Consumer Behaviour Classification Using Binary Decision Trees and a Genetic Algorithm Wrapper. Informatics, 9.10.3390/informatics9020045 ↗
42. GIS-based landslide susceptibility assessment and mapping in Ajloun and Jerash governorates in Jordan using genetic algorithm-based ensemble models10.1007/s11600-022-00767-x ↗
43. An Improved Intrusion Detection Algorithm Based on GA and SVM10.1109/ACCESS.2018.2810198 ↗
44. An Advanced Intrusion Detection System for IIoT Based on GA and Tree Based Algorithms10.1109/ACCESS.2021.3104113 ↗
45. (2021, October 26). Credit Card Fraud Detection. Available online: https://kaggle.com/mlg-ulb/creditcardfraud.
46. Lin, T.-H., and Jiang, J.-R. (2021). Credit Card Fraud Detection with Autoencoder and Probabilistic Random Forest. Mathematics, 9.10.3390/math9212683 ↗
47. Mienye, I.D., Obaido, G., Aruleba, K., and Dada, O.A. (2022). Intelligent Systems Design and Applications, Springer.
48. Alhaj, T.A., Siraj, M.M., Zainal, A., Elshoush, H.T., and Elhaj, F. (2016). Feature Selection Using Information Gain for Improved Structural-Based Alert Correlation. PLoS ONE, 11.10.1371/journal.pone.0166017 ↗
49. Ebiaredoh-Mienye, S.A., Swart, T.G., Esenogho, E., and Mienye, I.D. (2022). A Machine Learning Method with Filter-Based Feature Selection for Improved Prediction of Chronic Kidney Disease. Bioengineering, 9.10.3390/bioengineering9080350 ↗
50. A review on genetic algorithm: Past, present, and future10.1007/s11042-020-10139-6 ↗
51. Genetic Algorithm for Feature Selection in Lower Limb Pattern Recognition10.3389/frobt.2021.710806 ↗
52. Optimizing frequencies of skew composite laminates with metaheuristic algorithms10.1007/s00366-019-00728-x ↗
53. Jovanovic, D., Antonijevic, M., Stankovic, M., Zivkovic, M., Tanaskovic, M., and Bacanin, N. (2022). Tuning Machine Learning Models Using a Group Search Firefly Algorithm for Credit Card Fraud Detection. Mathematics, 10.10.3390/math10132272 ↗
54. Determining threshold value on information gain feature selection to increase speed and prediction accuracy of random forest10.1186/s40537-021-00472-4 ↗
55. The Unsupervised Feature Selection Algorithms Based on Standard Deviation and Cosine Similarity for Genomic Data Analysis10.3389/fgene.2021.684100 ↗
56. Threshold-based feature selection techniques for high-dimensional bioinformatics data10.1007/s13721-012-0006-6 ↗
57. Theodoridis, P.K., and Gkikas, D.C. (2020). Strategic Innovative Marketing and Tourism, Springer.
58. A novel fitness function in genetic programming for medical data classification10.1016/j.jbi.2020.103623 ↗
59. Mienye, I.D., and Sun, Y. (2022). Pan-African Artificial Intelligence and Smart Systems, Springer.
60. A systematic review of genetic algorithm-based multi-objective optimisation for building retrofitting strategies towards energy efficiency10.1016/j.enbuild.2019.109690 ↗
61. An approach for optimizing multi-objective problems using hybrid genetic algorithms10.1007/s00500-020-05149-3 ↗
62. Blank, J., and Deb, K. (2020, January 19–24). A Running Performance Metric and Termination Criterion for Evaluating Evolutionary Multi- and Many-objective Optimization Algorithms. Proceedings of the 2020 IEEE Congress on Evolutionary Computation (CEC), Glasgow, UK.10.1109/CEC48606.2020.9185546 ↗
63. Scikit-learn: Machine Learning in Python
64. A brief introduction to boosting
65. Cramer, J.S. (2002). Social Science Research Network, SSRN. SSRN Scholarly Paper ID 360300.
66. Random Forests10.1023/A:1010933404324 ↗
67. Support-vector networks10.1007/BF00994018 ↗
68. Classification and regression trees10.1038/nmeth.4370 ↗
69. SKCV: Stratified K-fold cross-validation on ML classifiers for predicting cervical cancer10.3389/fnano.2022.972421 ↗
70. Sensitivity, Specificity, and Predictive Values: Foundations, Pliabilities, and Pitfalls in Research and Practice10.3389/fpubh.2017.00307 ↗
71. A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects10.1109/ACCESS.2022.3207287 ↗
72. Obaido, G., Ogbuokiri, B., Swart, T.G., Ayawei, N., Kasongo, S.M., Aruleba, K., Mienye, I.D., Aruleba, I., Chukwu, W., and Osaye, F. (2022). An Interpretable Machine Learning Approach for Hepatitis B Diagnosis. Appl. Sci., 12.10.3390/app122111127 ↗
73. Improved Predictive Sparse Decomposition Method with Densenet for Prediction of Lung Cancer10.47839/ijc.19.4.1986 ↗
74. Application of GA to optimize cutting conditions for minimizing surface roughness in end milling machining process10.1016/j.eswa.2009.12.043 ↗
75. Mirjalili, S. (2019). Evolutionary Algorithms and Neural Networks: Theory and Applications, Springer International Publishing.
76. Mienye, I.D., Kenneth Ainah, P., Emmanuel, I.D., and Esenogho, E. (2021, January 10–11). Sparse noise minimization in image classification using Genetic Algorithm and DenseNet. Proceedings of the 2021 Conference on Information Communications Technology and Society (ICTAS), Durban, South Africa.10.1109/ICTAS50802.2021.9395014 ↗
77. Optimizing Weighted Extreme Learning Machines for imbalanced classification and application to credit card fraud detection10.1016/j.neucom.2020.04.078 ↗
78. Alkhatib, K.I., Al-Aiad, A.I., Almahmoud, M.H., and Elayan, O.N. (2021, January 24–26). Credit Card Fraud Detection Based on Deep Neural Network Approach. Proceedings of the 2021 12th International Conference on Information and Communication Systems (ICICS), Valencia, Spain.10.1109/ICICS52457.2021.9464555 ↗
79. A Novel Method for Credit Scoring Based on Cost-Sensitive Neural Network Ensemble10.1109/ACCESS.2021.3083490 ↗
80. A Multiple Classifiers System for Anomaly Detection in Credit Card Data With Unbalanced and Overlapped Classes10.1109/ACCESS.2020.2972009 ↗
81. Mrozek, P., Panneerselvam, J., and Bagdasar, O. (2020, January 7–10). Efficient Resampling for Fraud Detection During Anonymised Credit Card Transactions with Unbalanced Datasets. Proceedings of the 2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC), Leicester, UK.10.1109/UCC48980.2020.00067 ↗
82. Credit scoring by leveraging an ensemble stochastic criterion in a transformed feature space10.1007/s13748-021-00246-2 ↗
83. A Heterogeneous Ensemble Learning Model Based on Data Distribution for Credit Card Fraud Detection10.1155/2021/2531210 ↗
84. Saheed, Y.K., Hambali, M.A., Arowolo, M.O., and Olasupo, Y.A. (2020, January 8–9). Application of GA Feature Selection on Naive Bayes, Random Forest and SVM for Credit Card Fraud Detection. Proceedings of the 2020 International Conference on Decision Aid Sciences and Application (DASA), Sakheer, Bahrain.10.1109/DASA51403.2020.9317228 ↗
85. Verma, B.P., Verma, V., and Badholia, A. (2022, January 20–22). Hyper-Tuned Ensemble Machine Learning Model for Credit Card Fraud Detection. Proceedings of the 2022 International Conference on Inventive Computation Technologies (ICICT), Lalitpur, Nepal.10.1109/ICICT54344.2022.9850940 ↗
86. Padhi, B.K., Chakravarty, S., Naik, B., Pattanayak, R.M., and Das, H. (2022). RHSOFS: Feature Selection Using the Rock Hyrax Swarm Optimization Algorithm for Credit Card Fraud Detection System. Sensors, 22.10.3390/s22239321 ↗
87. Shuffled shepherd political optimization-based deep learning method for credit card fraud detection10.1002/cpe.7666 ↗
88. (2022, December 05). UCI Machine Learning Repository: Statlog (German Credit Data) Data Set. Available online: https://archive.ics.uci.edu/ml/datasets/statlog+(german+credit+data).
89. (2022, December 05). UCI Machine Learning Repository: Default of credit card clients Data Set. Available online: https://archive.ics.uci.edu/ml/datasets/default+of+credit+card+clients.