Comparison of the Performance of Machine Learning Classification Algorithms on Phishing URL Detection
Abstract
The development of internet technology has increased the intensity of digital activities, but it has also been followed by an increase in cybersecurity threats, one of which is phishing attacks through malicious URLs. Phishing is a fraudulent method that is carried out by manipulating users through fake websites that resemble official websites to obtain sensitive information, such as usernames, passwords, and financial data. Conventional blacklist-based detection methods are considered less effective in recognizing new phishing URLs that continue to develop dynamically. Therefore, this study aims to analyze and compare the performance of various machine learning and deep learning algorithms in accurately detecting phishing URLs. The dataset used was obtained from Kaggle with a total of 11,054 data points and 31 features that represent the characteristics of phishing and legitimate URLs. The methods used include Logistic Regression, K-Nearest Neighbor, Support Vector Machine, Naive Bayes, Decision Tree, Random Forest, Gradient Boosting, CatBoost, Extreme Gradient Boosting, and Multilayer Perceptron. The research stages include data preprocessing, exploratory data analysis, data visualization, separation of training and testing data, model training, and performance evaluation using accuracy, precision, recall, and F1-score. The results showed that the Gradient Boosting algorithm provided the best performance with an accuracy of 0.974, an F1-score of 0.977, a recall of 0.994, and a precision of 0.986. The results show that the ensemble learning method is able to detect phishing URLs effectively and can be used to improve artificial intelligence-based cybersecurity systems.
Downloads
References
A. Karim, M. Shahroz, K. Mustofa, S. B. Belhaouari, and S. R. K. Joga, “Phishing Detection System Through Hybrid Machine Learning Based on URL,” IEEE Access, vol. 11, no. March, pp. 36805–36822, 2023, doi: 10.1109/ACCESS.2023.3252366.
M. U. Javeed, S. M. Aslam, H. A. Sadiqa, A. Raza, M. M. Iqbal, and M. Akram, “Phishing Website URL Detection Using a Hybrid Machine Learning Approach,” J. Comput. Biomed. Informatics, vol. 9, no. 1, 2025.
I. Kara, M. Ok, and A. Ozaday, “Characteristics of Understanding URLs and Domain Names Features: The Detection of Phishing Websites with Machine Learning Methods,” IEEE Access, vol. 10, no. December, pp. 124420–124428, 2022, doi: 10.1109/ACCESS.2022.3223111.
S. Ariyadasa, S. Fernando, and S. Fernando, “Combining Long-Term Recurrent Convolutional and Graph Convolutional Networks to Detect Phishing Sites Using URL and HTML,” IEEE Access, vol. 10, 2022, doi: 10.1109/ACCESS.2022.3196018.
S. H. Ahammad et al., “Phishing URL detection using machine learning methods,” Adv. Eng. Softw., vol. 173, no. August, p. 103288, 2022, doi: 10.1016/j.advengsoft.2022.103288.
M. M. Alani and H. Tawfik, “PhishNot: A Cloud-Based Machine-Learning Approach to Phishing URL Detection,” Comput. Networks, vol. 218, no. January, p. 109407, 2022, doi: 10.1016/j.comnet.2022.109407.
S. R. Abdul Samad et al., “Analysis of the Performance Impact of Fine-Tuned Machine Learning Model for Phishing URL Detection,” Electron., vol. 12, no. 7, 2023, doi: 10.3390/electronics12071642.
R. Alazaidah et al., “Website Phishing Detection Using Machine Learning Techniques,” J. Stat. Appl. Probab., vol. 13, no. 1, pp. 119–129, 2024, doi: 10.18576/jsap/130108.
S. Alnemari, “Detecting Phishing Domains Using Machine Learning,” Early Writings on India, pp. 124–134, 2018, doi: 10.4324/9781315232140-14.
S. Asiri, Y. Xiao, S. Alzahrani, and T. Li, “PhishingRTDS: A real-time detection system for phishing attacks using a Deep Learning model,” Comput. Secur., vol. 141, p. 103843, 2024, doi: https://doi.org/10.1016/j.cose.2024.103843.
P. M. Bhagat, S. Waghmare, M. Waje, R. Patil, K. Joshi, and M. Bakuli, “Feature Classification and Extreme Learning Machine Based Detection of Phishing Websites,” Int. J. Recent Innov. Trends Comput. Commun., vol. 11, 2023, doi: 10.17762/ijritcc.v11i8s.7182.
U. Zara, K. Ayyub, H. Ullah Khan, A. Daud, T. Alsahfi, and S. Gulzar Ahmad, “Phishing Website Detection Using Deep Learning Models,” IEEE Access, vol. 12, no. November, pp. 167072–167087, 2024, doi: 10.1109/ACCESS.2024.3486462.
Y. Wei and Y. Sekiya, “Sufficiency of Ensemble Machine Learning Methods for Phishing Websites Detection,” IEEE Access, vol. 10, 2022, doi: 10.1109/ACCESS.2022.3224781.
E. A. Aldakheel, M. Zakariah, G. A. Gashgari, F. A. Almarshad, and A. I. A. Alzahrani, “A Deep Learning-Based Innovative Technique for Phishing Detection in Modern Security with Uniform Resource Locators,” Sensors, vol. 23, no. 9, 2023, doi: 10.3390/s23094403.
M. N. Yakubu and A. M. Abubakar, “Applying machine learning approach to predict students’ performance in higher educational institutions,” Kybernetes, vol. 51, no. 2, pp. 916–934, 2021, doi: 10.1108/K-12-2020-0865.
C. Thapa et al., “Evaluation of Federated Learning in Phishing Email Detection,” Sensors, vol. 23, no. 9, 2023, doi: 10.3390/s23094346.
L. Yang, J. Zhang, X. Wang, Z. Li, Z. Li, and Y. He, “An improved ELM-based and data preprocessing integrated approach for phishing detection considering comprehensive features,” Expert Syst. Appl., vol. 165, p. 113863, 2021, doi: https://doi.org/10.1016/j.eswa.2020.113863.
M. K. Prabakaran, P. Meenakshi Sundaram, and A. D. Chandrasekar, “An enhanced deep learning-based phishing detection mechanism to effectively identify malicious URLs using variational autoencoders,” IET Inf. Secur., vol. 17, no. 3, pp. 423–440, 2023, doi: 10.1049/ise2.12106.
F. Nthurima, A. Mutua, and W. Stephen Titus, “Detecting Phishing Emails Using Random Forest and AdaBoost Classifier Model,” Open J. Inf. Technol., vol. 6, no. 2, 2023, doi: 10.32591/coas.ojit.0602.03123n.
M. W. Shaukat, R. Amin, M. M. A. Muslam, A. H. Alshehri, and J. Xie, “A Hybrid Approach for Alluring Ads Phishing Attack Detection Using Machine Learning,” Sensors, vol. 23, no. 19, 2023, doi: 10.3390/s23198070.
Copyright (c) 2026 Ahmad, Sartika Lina Mulani Sitio
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
