journal article·2021-10-03Open access

Phishing Webpage Classification via Deep Learning-Based Algorithms: An Empirical Study

Nguyet Quang Do, Ali Selamat, Ondrej Krejcar, Takeru Yokoi, Hamido Fujita

Applied Sciences· Volume 11· Issue 19

Abstract

Phishing detection with high-performance accuracy and low computational complexity has always been a topic of great interest. New technologies have been developed to improve the phishing detection rate and reduce computational constraints in recent years. However, one solution is insufficient to address all problems caused by attackers in cyberspace. Therefore, the primary objective of this paper is to analyze the performance of various deep learning algorithms in detecting phishing activities. This analysis will help organizations or individuals select and adopt the proper solution according to their technological needs and specific applications’ requirements to fight against phishing attacks. In this regard, an empirical study was conducted using four different deep learning algorithms, including deep neural network (DNN), convolutional neural network (CNN), Long Short-Term Memory (LSTM), and gated recurrent unit (GRU). To analyze the behaviors of these deep learning architectures, extensive experiments were carried out to examine the impact of parameter tuning on the performance accuracy of the deep learning models. In addition, various performance metrics were measured to evaluate the effectiveness and feasibility of DL models in detecting phishing activities. The results obtained from the experiments showed that no single DL algorithm achieved the best measures across all performance metrics. The empirical findings from this paper also manifest several issues and suggest future research directions related to deep learning in the phishing detection domain.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Spam and Phishing Detection · Network Security and Intrusion Detection · Sentiment Analysis and Opinion Mining

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Malaysia-Japan International Institute of Technology (MJIIT), Universiti Teknologi Malaysia Kuala Lumpur, Jalan Sultan Yahya Petra, Kuala Lumpur 54100, Malaysia

School of Computing, Faculty of Engineering, Universiti Teknologi Malaysia, Johor Bahru 80000, Johor, Malaysia

Media and Games Center of Excellence (MagicX), Universiti Teknologi Malaysia, Skudai, Johor Bahru 81310, Johor, Malaysia

Center for Basic and Applied Research, Faculty of Informatics and Management, University of Hradec Kralove, Rokitanskeho 62, 500 03 Hradec Kralove, Czech Republic

Tokyo Metropolitan College of Industrial Technology, Tokyo 140-0011, Japan

Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, 18001 Granada, Spain

i-SOMET Incorporated Association, Morioka 020-0000, Japan

Regional Research Center, Iwate Prefectural University, Iwate 028-4211, Japan

Funding

Ministry of Higher Education under the Fundamental Research · Universiti Teknologi Malaysia (UTM) · Malaysia Re-search University Network (MRUN) · Faculty of Informatics and Management, University of Hradec Kralove, SPEV project

References (65)

Show source-provided references
1. Machine learning approaches to IoT security: A systematic literature review10.1016/j.iot.2021.100365 ↗
2. Deep learning and big data technologies for IoT security10.1016/j.comcom.2020.01.016 ↗
3. Liu, H., and Lang, B. (2019). Machine Learning and Deep Learning Methods for Intrusion Detection Systems: A Survey. Appl. Sci., 9.10.3390/app9204396 ↗
4. Asharf, J., Moustafa, N., Khurshid, H., Debie, E., Haider, W., and Wahab, A. (2020). A Review of Intrusion Detection Systems Using Machine and Deep Learning in Internet of Things: Challenges, Solutions and Future Directions. Electronics, 9.10.3390/electronics9071177 ↗
5. Detecting ransomware attacks using intelligent algorithms: Recent development and next direction from deep learning and big data perspectives10.1007/s12652-020-02630-7 ↗
6. Al-Ahmadi, S. (2020). PDMLP: Phishing Detection Using Multilayer Perceptron. Int. J. Netw. Secur. Its Appl., 12, Available online: https://papers.ssrn.com/abstract=3624621.10.2139/ssrn.3922446 ↗
7. Aljofey, A., Jiang, Q., Qu, Q., Huang, M., and Niyigena, J.-P. (2020). An Effective Phishing Detection Model Based on Character Level Convolutional Neural Network from URL. Electronics, 9.10.3390/electronics9091514 ↗
8. Al-Milli, N., and Hammo, B.H. (2020, January 7–9). A Convolutional Neural Network Model to Detect Illegitimate URLs. Proceedings of the 2020 11th International Conference on Information and Communication Systems (ICICS), Irbid, Jordan.10.1109/ICICS49469.2020.239536 ↗
9. Feng, J., Zou, L., and Nan, T. (2019). A Phishing Webpage Detection Method Based on Stacked Autoencoder and Correlation Coefficients. J. Comput. Inf. Technol., 27.10.20532/cit.2019.1004702 ↗
10. Web2Vec: Phishing Webpage Detection Method Based on Multidimensional Features Driven by Deep Learning10.1109/ACCESS.2020.3043188 ↗
11. Huang, Y., Yang, Q., Qin, J., and Wen, W. (2019, January 5–8). Phishing URL Detection via CNN and Attention-Based Hierarchical RNN. Proceedings of the 2019 18th IEEE International Conference on Trust, Security and Privacy in Computing and Communications/13th IEEE International Conference on Big Data Science And Engineering (TrustCom/BigDataSE), Rotorua, New Zealand.10.1109/TrustCom/BigDataSE.2019.00024 ↗
12. Chen, Z. (2020, January 1–2). Deep Learning for Cybersecurity: A Review. Proceedings of the 2020 International Conference on Computing and Data Science (CDS), Stanford, CA, USA.10.1109/CDS49703.2020.00009 ↗
13. Naway, A., and LI, Y. (2018). A Review on The Use of Deep Learning in Android Malware Detection. arXiv, Available online: http://arxiv.org/abs/1812.10360.
14. Deep Cybersecurity: A Comprehensive Overview from Neural Network and Deep Learning Perspective10.1007/s42979-021-00535-6 ↗
15. Fujita, H., Selamat, A., Lin, J.C.-W., and Ali, M. (2021). Recent Research on Phishing Detection Through Machine Learning Algorithm. Advances and Trends in Artificial Intelligence. Artificial Intelligence Practices, Springer International Publishing.
16. Network Attacks Detection Methods Based on Deep Learning Techniques: A Survey10.1155/2020/8872923 ↗
17. Application of deep learning to cybersecurity: A survey10.1016/j.neucom.2019.02.056 ↗
18. DeNNeS: Deep embedded neural network expert system for detecting cyber attacks10.1007/s00521-020-04830-w ↗
19. Sahingoz, O.K., Işılay Baykal, S., and Bulut, D. (2018). Phishing detection from urls by using neural networks. Computer Science & Information Technology (CS & IT), AIRCC Publishing Corporation.10.5121/csit.2018.81705 ↗
20. Detection of Phishing Websites Using Deep Learning Techniques
21. Shandilya, S.K., Wagner, N., and Nagar, A.K. (2020). Dynamic Recognition of Phishing URLs Using Deep Learning Techniques. Advances in Cyber Security Analytics and Decision Systems, Springer International Publishing.10.1007/978-3-030-19353-9 ↗
22. Deep belief network based detection and categorization of malicious URLs10.1080/19393555.2018.1456577 ↗
23. Deep learning approaches for anomaly-based intrusion detection systems: A survey, taxonomy, and open issues10.1016/j.knosys.2019.105124 ↗
24. Accurate and fast URL phishing detector: A convolutional neural network approach10.1016/j.comnet.2020.107275 ↗
25. Liu, D., Lee, J.-H., Wang, W., and Wang, Y. (September, January 30). Malicious Websites Detection via CNN based Screenshot Recognition. Proceedings of the 2019 International Conference on Intelligent Computing and its Emerging Applications (ICEA), Tainan, Taiwan.10.1109/ICEA.2019.8858300 ↗
26. Phoka, T., and Suthaphan, P. (2019, January 23–26). Image Based Phishing Detection Using Transfer Learning. Proceedings of the 2019 11th International Conference on Knowledge and Smart Technology (KST), Phuket, Thailand.10.1109/KST.2019.8687615 ↗
27. CNN–MHSA: A Convolutional Neural Network and multi-head self-attention combined approach for detecting phishing websites10.1016/j.neunet.2020.02.013 ↗
28. Yerima, S.Y., and Alzaylaee, M.K. (2020, January 19–21). High Accuracy Phishing Detection Based on Convolutional Neural Networks. Proceedings of the 2020 3rd International Conference on Computer Applications Information Security (ICCAIS), Riyadh, Saudi Arabia.10.1109/ICCAIS48893.2020.9096869 ↗
29. Bidirectional LSTM Malicious webpages detection algorithm based on convolutional neural network and independent recurrent neural network10.1007/s10489-019-01433-4 ↗
30. Detection of phishing URLs by using deep learning approach and multiple features combinations
31. Stamp, M., Alazab, M., and Shalaginov, A. (2021). DURLD: Malicious URL Detection Using Deep Learning-Based Character Level Representations. Malware Analysis Using Artificial Intelligence and Deep Learning, Springer International Publishing.10.1007/978-3-030-62582-5 ↗
32. PDRCNN: Precise Phishing Detection with Recurrent Convolutional Neural Networks10.1155/2019/2595794 ↗
33. Phishing Website Detection Based on Multidimensional Features Driven by Deep Learning10.1109/ACCESS.2019.2892066 ↗
34. Detecting Malicious URLs via a Keyword-Based Convolutional Gated-Recurrent-Unit Neural Network10.1109/ACCESS.2019.2895751 ↗
35. M, Y.V., Janet, B., and Reddy, S. (2020, January 6–8). Anti-phishing System using LSTM and CNN. Proceedings of the 2020 IEEE International Conference for Innovation in Technology (INOCON), Bangluru, India.10.1109/INOCON50539.2020.9298298 ↗
36. (2021, September 18). jaysinha. Available online: https://jaysinha.me/files/phishx_preprint.pdf.
37. Al-Ahmadi, S. (2020). A Deep Learning Technique for Web Phishing Detection Combined URL Features and Visual Similarity. Soc. Sci. Res. Netw., Available online: https://papers.ssrn.com/abstract=3716033.10.5121/ijcnc.2020.12503 ↗
38. Research on phishing webpage detection technology based on CNN-BiLSTM algorithm10.1088/1742-6596/1738/1/012131 ↗
39. Cyber security in smart cities: A review of deep learning-based applications and case studies10.1016/j.scs.2020.102655 ↗
40. Elnagar, S., and Thomas, M. (August, January 30). A Cognitive Framework for Detecting Phishing Websites. Proceedings of the International Conference on Advances on Applied Cognitive Computing (ACC 2018), Las Vegas, NV, USA.
41. Feng, T., and Yue, C. (2020, January 10–12). Visualizing and Interpreting RNN Models in URL-based Phishing Detection. Proceedings of the 25th ACM Symposium on Access Control Models and Technologies, Barcelona, Spain.10.1145/3381991.3395602 ↗
42. Efficient deep learning techniques for the detection of phishing websites10.1007/s12046-020-01392-4 ↗
43. Su, Y. (2020, January 12–14). Research on Website Phishing Detection Based on LSTM RNN. Proceedings of the 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chongqing, China.10.1109/ITNEC48623.2020.9084799 ↗
44. Torroledo, I., Camacho, L.D., and Bahnsen, A.C. (2018). Hunting Malicious TLS Certificates with Deep Neural Networks. Proceedings of the 11th ACM Workshop on Artificial Intelligence and Security, Association for Computing Machinery.10.1145/3270101.3270105 ↗
45. URLdeepDetect: A Deep Learning Approach for Detecting Malicious URLs Using Semantic Vector Models10.1007/s10922-021-09587-8 ↗
46. PhishDump: A multi-model ensemble based technique for the detection of phishing sites in mobile devices10.1016/j.pmcj.2019.101084 ↗
47. Deep Learning-Based Efficient Model Development for Phishing Detection Using Random Forest and BLSTM Classifiers
48. Zhou, J., Luo, X., Shen, Q., and Xu, Z. (2020). A Character-Level BiGRU-Attention for Phishing Classification. Information and Communications Security, Springer International Publishing.10.1007/978-3-030-41579-2 ↗
49. Web Phishing Detection Using a Deep Learning Framework10.1155/2018/4678746 ↗
50. Robic-Butez, P., and Win, T.Y. (2019, January 9–12). Detection of Phishing websites using Generative Adversarial Network. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.10.1109/BigData47090.2019.9006352 ↗
51. Deep belief network based intrusion detection techniques: A survey10.1016/j.eswa.2020.114170 ↗
52. Alotaibi, R., Al-Turaiki, I., and Alakeel, F. (2020, January 19–21). Mitigating Email Phishing Attacks using Convolutional Neural Networks. Proceedings of the 2020 3rd International Conference on Computer Applications Information Security (ICCAIS), Riyadh, Saudi Arabia.10.1109/ICCAIS48893.2020.9096821 ↗
53. Phishing Email Detection Using Improved RCNN Model With Multilevel Vectors and Attention Mechanism10.1109/ACCESS.2019.2913705 ↗
54. Berman, D.S., Buczak, A.L., Chavis, J.S., and Corbett, C.L. (2019). A Survey of Deep Learning Methods for Cyber Security. Information, 10.10.3390/info10040122 ↗
55. Chatterjee, M., and Namin, A.-S. (2019, January 15–19). Detecting Phishing Websites through Deep Reinforcement Learning. Proceedings of the 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC), Milwaukee, WI, USA.10.1109/COMPSAC.2019.10211 ↗
56. Odeh, A., Keshta, I., and Abdelfattah, E. (2021, March 10). Efficient Detection of Phishing Websites Using Multilayer Perceptron International Association of Online Engineering. Available online: https://www.learntechlib.org/p/217754/.
57. Saha, I., Sarma, D., Chakma, R.J., Alam, M.N., Sultana, A., and Hossain, S. (2020, January 20–22). Phishing Attacks Detection using Deep Learning Approach. Proceedings of the 2020 Third International Conference on Smart Systems and Inventive Technology (ICSSIT), Tirunelveli, India.10.1109/ICSSIT48917.2020.9214132 ↗
58. Ya, J., Liu, T., Zhang, P., Shi, J., Guo, L., and Gu, Z. (2019, January 14–19). NeuralAS: Deep Word-Based Spoofed URLs Detection AgaIInst Strong Similar Samples. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.10.1109/IJCNN.2019.8852416 ↗
59. Adebowale, M.A., Lwin, K.T., and Hossain, M.A. (2019, January 26–28). Deep Learning with Convolutional Neural Network and Long Short-Term Memory for Phishing Detection. Proceedings of the 2019 13th International Conference on Software, Knowledge, Information Management and Applications (SKIMA), Island of Ulkulhas, Maldives.10.1109/SKIMA47702.2019.8982427 ↗
60. Detection of Phishing Website Based on Deep Learning
61. Pooja, A.S.S.V.L., and Sridhar, M. (2020, January 5–7). Analysis of Phishing Website Detection Using CNN and Bidirectional LSTM. Proceedings of the 2020 4th International Conference on Electronics, Communication and Aerospace Technology (ICECA), Coimbatore, India.10.1109/ICECA49313.2020.9297395 ↗
62. (2021, April 12). Kaggle. Available online: https://www.kaggle.com/isatish/phishing-dataset-uci-ml-csv.
63. (2021, September 21). Github. Available online: https://github.com/quangdn83/WebsitePhishingDetection.
64. Parameter Setting for Deep Neural Networks Using Swarm Intelligence on Phishing Websites Classification10.1142/S021821301960008X ↗
65. Chen, S., Fan, L., Chen, C., Xue, M., Liu, Y., and Xu, L. GUI-Squatting Attack: Automated Generation of Android Phishing Apps. IEEE Trans. Dependable Secure Comput., accepted.