journal article·2023-08-11Open access

Marine Vessel Classification and Multivariate Trajectories Forecasting Using Metaheuristics-Optimized eXtreme Gradient Boosting and Recurrent Neural Networks

Aleksandar Petrovic, Robertas Damaševičius, Luka Jovanovic, Ana Toskovic, Vladimir Simic, Nebojsa Bacanin, Miodrag Zivkovic, Petar Spalević

Applied Sciences· Volume 13· Issue 16

Abstract

Maritime vessels provide a wealth of data concerning location, trajectories, and speed. However, while these data are meticulously monitored and logged to maintain course, they can also provide a wealth of meta information. This work explored the potential of data-driven techniques and applied artificial intelligence (AI) to tackle two challenges. First, vessel classification was explored through the use of extreme gradient boosting (XGboost). Second, vessel trajectory time series forecasting was tackled through the use of long-short-term memory (LSTM) networks. Finally, due to the strong dependence of AI model performance on proper hyperparameter selection, a boosted version of the well-known particle swarm optimization (PSO) algorithm was introduced specifically for tuning the hyperparameters of the models used in this study. The introduced methodology was applied to real-world automatic identification system (AIS) data for both marine vessel classification and trajectory forecasting. The performance of the introduced Boosted PSO (BPSO) was compared to contemporary optimizers and showed promising outcomes. The XGBoost model tuned using boosted PSO attained an overall accuracy of 99.72% for the vessel classification problem, while the LSTM model attained a mean square error (MSE) of 0.000098 for the marine trajectory prediction challenge. A rigid statistical analysis of the classification model was performed to validate outcomes, and explainable AI principles were applied to the determined best-performing models, to gain a better understanding of the feature impacts on model decisions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Maritime Navigation and Safety · Maritime Transport Emissions and Efficiency · Ship Hydrodynamics and Maneuverability

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Informatics and Computing, Singidunum University, 11010 Belgrade, Serbia

Department of Applied Informatics, Vytautas Magnus University, 44404 Kaunas, Lithuania

Teacher Education Faculty, University of Pristina in Kosovska Mitrovica, 38220 Kosovska Mitrovica, Serbia

Faculty of Transport and Traffic Engineering, University of Belgrade, Vojvode Stepe 305, 11010 Belgrade, Serbia

Department of Industrial Engineering and Management, College of Engineering, Yuan Ze Univerzity, Yuandong Road, Zhongli District, Taoyuan City 320315, Taiwan

MEU Research Unit, Middle East University, Amman 11831, Jordan

Faculty of Technical Science, University of Pristina in Kosovska Mitrovica, 38220 Kosovska Mitrovica, Serbia

References (80)

Show source-provided references
1. Han, X., Armenakis, C., and Jadidi, M. (2021). Modeling vessel behaviours by clustering ais data using optimized dbscan. Sustainability, 13.10.3390/su13158162 ↗
2. Multiple-aspect analysis of semantic trajectories (MASTER)10.1080/13658816.2020.1870982 ↗
3. Understanding Private Car Aggregation Effect via Spatio-Temporal Analysis of Trajectory Data10.1109/TCYB.2021.3117705 ↗
4. Research on Real-Time Anomaly Detection of Fishing Vessels in a Marine Edge Computing Environment
5. Zheng, Y., Zhang, Y., Qian, L., Zhang, X., Diao, S., Liu, X., Cao, J., and Huang, H. (2023). A lightweight ship target detection model based on improved YOLOv5s algorithm. PLoS ONE, 18.10.1371/journal.pone.0283932 ↗
6. Yang, F., Qiao, Y., Wei, W., Wang, X., Wan, D., Damaševičius, R., and Woźniak, M. (2020). DDTree: A hybrid deep learning model for real-timewaterway depth prediction and smart navigation. Appl. Sci., 10.10.3390/app10082770 ↗
7. Ship classification based on ship behavior clustering from AIS data10.1016/j.oceaneng.2019.02.005 ↗
8. Wang, X., and Xiao, Y. (2023). A Deep Learning Model for Ship Trajectory Prediction Using Automatic Identification System (AIS) Data. Information, 14.10.3390/info14040212 ↗
9. Qian, L., Zheng, Y., Li, L., Ma, Y., Zhou, C., and Zhang, D. (2022). A new method of inland water ship trajectory prediction based on long short-term memory network optimized by genetic algorithm. Appl. Sci., 12.10.3390/app12084073 ↗
10. Zheng, Y., Li, L., Qian, L., Cheng, B., Hou, W., and Zhuang, Y. (2023). Sine-SSA-BP Ship Trajectory Prediction Based on Chaotic Mapping Improved Sparrow Search Algorithm. Sensors, 23.10.3390/s23020704 ↗
11. Finite-time observer based tracking control of uncertain heterogeneous underwater vehicles using adaptive sliding mode approach10.1016/j.neucom.2022.01.038 ↗
12. Xgboost: Extreme gradient boosting
13. Chen, T., and Guestrin, C. (2016, January 13–17). Xgboost: A scalable tree boosting system. Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
14. A New Approach to System Design Optimization of Underwater Gliders10.1109/TMECH.2022.3143125 ↗
15. On the difficulty of training recurrent neural networks
16. Training simple recurrent deep artificial neural network for forecasting using particle swarm optimization10.1007/s41066-021-00274-2 ↗
17. Kennedy, J., and Eberhart, R. (December, January 27). Particle swarm optimization. Proceedings of the ICNN’95-International Conference on Neural Networks, Perth, WA, Australia.
18. Yang, X.S., and Slowik, A. (2020). Swarm Intelligence Algorithms, CRC Press.10.1201/9780429422614-4 ↗
19. Mirjalili, S. (2019). Evolutionary Algorithms and Neural Networks, Springer.10.1007/978-3-319-93025-1 ↗
20. Harris hawks optimization: Algorithm and applications10.1016/j.future.2019.02.028 ↗
21. Artificial bee colony algorithm10.4249/scholarpedia.6915 ↗
22. Bat algorithm: A novel approach for global engineering optimization10.1108/02644401211235834 ↗
23. The whale optimization algorithm10.1016/j.advengsoft.2016.01.008 ↗
24. Chimp optimization algorithm10.1016/j.eswa.2020.113338 ↗
25. Zivkovic, M., Bacanin, N., Tuba, E., Strumberger, I., Bezdan, T., and Tuba, M. (2020, January 15–19). Wireless Sensor Networks Life Time Optimization Based on the Improved Firefly Algorithm. Proceedings of the 2020 International Wireless Communications and Mobile Computing (IWCMC), Limassol, Cyprus.10.1109/IWCMC48107.2020.9148087 ↗
26. Zivkovic, M., Bacanin, N., Zivkovic, T., Strumberger, I., Tuba, E., and Tuba, M. (2020, January 26–27). Enhanced Grey Wolf Algorithm for Energy Efficient Wireless Sensor Networks. Proceedings of the 2020 Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, Serbia.10.1109/ZINC50678.2020.9161788 ↗
27. Bacanin, N., Tuba, E., Zivkovic, M., Strumberger, I., and Tuba, M. (2019, January 10–12). Whale optimization algorithm with exploratory move for wireless sensor networks localization. Proceedings of the International Conference on Hybrid Intelligent Systems, Bhopal, India.10.1007/978-3-030-49336-3_33 ↗
28. Zivkovic, M., Zivkovic, T., Venkatachalam, K., and Bacanin, N. (2021). Data Intelligence and Cognitive Informatics, Springer.
29. Bezdan, T., Zivkovic, M., Tuba, E., Strumberger, I., Bacanin, N., and Tuba, M. (2020, January 19–21). Glioma Brain Tumor Grade Classification from MRI Using Convolutional Neural Networks Designed by Modified FA. Proceedings of the International Conference on Intelligent and Fuzzy Systems, Istanbul, Turkey.10.1007/978-3-030-51156-2_111 ↗
30. Zivkovic, M., Bacanin, N., Antonijevic, M., Nikolic, B., Kvascev, G., Marjanovic, M., and Savanovic, N. (2022). Hybrid CNN and XGBoost Model Tuned by Modified Arithmetic Optimization Algorithm for COVID-19 Early Diagnostics from X-ray Images. Electronics, 11.10.3390/electronics11223798 ↗
31. Jovanovic, D., Antonijevic, M., Stankovic, M., Zivkovic, M., Tanaskovic, M., and Bacanin, N. (2022). Tuning Machine Learning Models Using a Group Search Firefly Algorithm for Credit Card Fraud Detection. Mathematics, 10.10.3390/math10132272 ↗
32. Petrovic, A., Bacanin, N., Zivkovic, M., Marjanovic, M., Antonijevic, M., and Strumberger, I. (2022, January 17–19). The AdaBoost Approach Tuned by Firefly Metaheuristics for Fraud Detection. Proceedings of the 2022 IEEE World Conference on Applied Intelligence and Computing (AIC), Sonbhadra, India.10.1109/AIC55036.2022.9848902 ↗
33. COVID-19 cases prediction by using hybrid machine learning and beetle antennae search approach10.1016/j.scs.2020.102669 ↗
34. Zivkovic, M., Venkatachalam, K., Bacanin, N., Djordjevic, A., Antonijevic, M., Strumberger, I., and Rashid, T.A. (2021, January 28–29). Hybrid Genetic Algorithm and Machine Learning Method for COVID-19 Cases Prediction. Proceedings of the International Conference on Sustainable Expert Systems: ICSES 2020, Lalitpur, Nepal.10.1007/978-981-33-4355-9_14 ↗
35. Bacanin, N., Bezdan, T., Tuba, E., Strumberger, I., Tuba, M., and Zivkovic, M. (2019, January 26–27). Task scheduling in cloud computing environment by grey wolf optimizer. Proceedings of the 2019 27th Telecommunications Forum (TELFOR), Belgrade, Serbia.10.1109/TELFOR48224.2019.8971223 ↗
36. Bezdan, T., Zivkovic, M., Tuba, E., Strumberger, I., Bacanin, N., and Tuba, M. (2020, January 19–21). Multi-objective Task Scheduling in Cloud Computing Environment by Hybridized Bat Algorithm. Proceedings of the International Conference on Intelligent and Fuzzy Systems, Istanbul, Turkey.10.1007/978-3-030-51156-2_83 ↗
37. Bezdan, T., Zivkovic, M., Antonijevic, M., Zivkovic, T., and Bacanin, N. (2020). Machine Learning for Predictive Analysis, Springer.
38. Zivkovic, M., Bezdan, T., Strumberger, I., Bacanin, N., and Venkatachalam, K. (2021). Computer Networks, Big Data and IoT, Springer.
39. Bacanin, N., Zivkovic, M., Stoean, C., Antonijevic, M., Janicijevic, S., Sarac, M., and Strumberger, I. (2022). Application of Natural Language Processing and Machine Learning Boosted with Swarm Intelligence for Spam Email Filtering. Mathematics, 10.10.3390/math10224173 ↗
40. Stankovic, M., Antonijevic, M., Bacanin, N., Zivkovic, M., Tanaskovic, M., and Jovanovic, D. (2022, January 13–15). Feature Selection by Hybrid Artificial Bee Colony Algorithm for Intrusion Detection. Proceedings of the 2022 International Conference on Edge Computing and Applications (ICECAA), Tamilnadu, India.10.1109/ICECAA55415.2022.9936116 ↗
41. Alzaqebah, A., Aljarah, I., Al-Kadi, O., and Damaševičius, R. (2022). A Modified Grey Wolf Optimization Algorithm for an Intrusion Detection System. Mathematics, 10.10.3390/math10060999 ↗
42. Bezdan, T., Cvetnic, D., Gajic, L., Zivkovic, M., Strumberger, I., and Bacanin, N. (2021, January 26–27). Feature Selection by Firefly Algorithm with Improved Initialization Strategy. Proceedings of the 7th Conference on the Engineering of Computer Based Systems, Novi Sad, Serbia.10.1145/3459960.3459974 ↗
43. Quasi-reflection learning arithmetic optimization algorithm firefly search for feature selection10.1016/j.heliyon.2023.e15378 ↗
44. Bacanin, N., Stoean, C., Zivkovic, M., Rakic, M., Strulak-Wójcikiewicz, R., and Stoean, R. (2023). On the benefits of using metaheuristics in the hyperparameter tuning of deep learning models for energy load forecasting. Energies, 16.10.3390/en16031434 ↗
45. Stoean, C., Zivkovic, M., Bozovic, A., Bacanin, N., Strulak-Wójcikiewicz, R., Antonijevic, M., and Stoean, R. (2023). Metaheuristic-Based Hyperparameter Tuning for Recurrent Deep Learning: Application to the Prediction of Solar Energy Generation. Axioms, 12.10.3390/axioms12030266 ↗
46. Multivariate energy forecasting via metaheuristic tuned long-short term memory and gated recurrent unit neural networks10.1016/j.ins.2023.119122 ↗
47. Milosevic, S., Bezdan, T., Zivkovic, M., Bacanin, N., Strumberger, I., and Tuba, M. (2020, January 22–24). Feed-Forward Neural Network Training by Hybrid Bat Algorithm. Proceedings of the Modelling and Development of Intelligent Systems: 7th International Conference, MDIS 2020, Sibiu, Romania. Revised Selected Papers 7.
48. Gajic, L., Cvetnic, D., Zivkovic, M., Bezdan, T., Bacanin, N., and Milosevic, S. (2021). Computational Vision and Bio-Inspired Computing, Springer.
49. Hybridized sine cosine algorithm with convolutional neural networks dropout regularization application10.1038/s41598-022-09744-2 ↗
50. Bacanin, N., Stoean, C., Zivkovic, M., Jovanovic, D., Antonijevic, M., and Mladenovic, D. (2022). Multi-Swarm Algorithm for Extreme Learning Machine Optimization. Sensors, 22.10.3390/s22114204 ↗
51. Jovanovic, L., Jovanovic, D., Bacanin, N., Jovancai Stakic, A., Antonijevic, M., Magd, H., Thirumalaisamy, R., and Zivkovic, M. (2022). Multi-Step Crude Oil Price Prediction Based on LSTM Approach Tuned by Salp Swarm Algorithm with Disputation Operator. Sustainability, 14.10.3390/su142114616 ↗
52. Smart wireless health care system using graph LSTM pollution prediction and dragonfly node localization
53. Jovanovic, L., Jovanovic, G., Perisic, M., Alimpic, F., Stanisic, S., Bacanin, N., Zivkovic, M., and Stojic, A. (2023). The Explainable Potential of Coupling Metaheuristics-Optimized-XGBoost and SHAP in Revealing VOCs’ Environmental Fate. Atmosphere, 14.10.3390/atmos14010109 ↗
54. Jovanovic, G., Perisic, M., Bacanin, N., Zivkovic, M., Stanisic, S., Strumberger, I., Alimpic, F., and Stojic, A. (2023). Potential of Coupling Metaheuristics-Optimized-XGBoost and SHAP in Revealing PAHs Environmental Fate. Toxics, 11.10.3390/toxics11040394 ↗
55. Zhang, Z., Yang, R., and Fang, Y. (2018, January 25–27). LSTM network based on on antlion optimization and its application in flight trajectory prediction. Proceedings of the 2018 2nd IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), Xi’an, China.10.1109/IMCEC.2018.8469476 ↗
56. GOI: A novel design for vehicle positioning and trajectory prediction under urban environments10.1109/JSEN.2018.2826000 ↗
57. Liu, J., Shi, G., and Zhu, K. (2019). Vessel trajectory prediction model based on AIS sensor data and adaptive chaos differential evolution support vector regression (ACDE-SVR). Appl. Sci., 9.10.3390/app9152983 ↗
58. Suo, Y., Chen, W., Claramunt, C., and Yang, S. (2020). A ship trajectory prediction framework based on a recurrent neural network. Sensors, 20.10.3390/s20185133 ↗
59. Cacchiani, V., Ceschia, S., Mignardi, S., and Buratti, C. (2022, January 11–14). Metaheuristic Algorithms for UAV Trajectory Optimization in Mobile Networks. Proceedings of the Metaheuristics: 14th International Conference, MIC 2022, Syracuse, Italy.10.1007/978-3-031-26504-4_3 ↗
60. Rapid low-thrust trajectory optimization in deep space based on convex programming10.2514/1.G005839 ↗
61. Hybrid bat flight optimization algorithm applied to complex wellbore trajectories highlights the relative contributions of metaheuristic components10.1016/j.jngse.2016.04.024 ↗
62. Farzipour, A., Elmi, R., and Nasiri, H. (2023). Detection of Monkeypox Cases Based on Symptoms Using XGBoost and Shapley Additive Explanations Methods. Diagnostics, 13.10.3390/diagnostics13142391 ↗
63. Bhandari, M., Yogarajah, P., Kavitha, M.S., and Condell, J. (2023). Exploring the Capabilities of a Lightweight CNN Model in Accurately Identifying Renal Abnormalities: Cysts, Stones, and Tumors, Using LIME and SHAP. Appl. Sci., 13.10.3390/app13053125 ↗
64. Modeling operational cement rotary kiln variables with explainable artificial intelligence methods–A “conscious lab” development10.1080/02726351.2022.2135470 ↗
65. Addressing Internet of Things security by enhanced sine cosine metaheuristics tuned hybrid machine learning model and results interpretation based on SHAP approach10.7717/peerj-cs.1405 ↗
66. A unified approach to interpreting model predictions
67. Molnar, C. (2020). Interpretable Machine Learning, Lulu. com.
68. From local explanations to global understanding with explainable AI for trees10.1038/s42256-019-0138-9 ↗
69. Explainable extreme gradient boosting tree-based prediction of toluene, ethylbenzene and xylene wet deposition10.1016/j.scitotenv.2018.10.368 ↗
70. Improving Phishing Website Detection Using a Hybrid Two-level Framework for Feature Selection and XGBoost Tuning
71. Mohamed, A.W., Hadi, A.A., Mohamed, A.K., and Awad, N.H. (2020, January 19–24). Evaluating the performance of adaptive gainingsharing knowledge based algorithm on cec 2020 benchmark problems. Proceedings of the 2020 IEEE Congress on Evolutionary Computation (CEC), Glasgow, UK.10.1109/CEC48606.2020.9185901 ↗
72. Parameters identification of photovoltaic models using an improved JAYA optimization algorithm10.1016/j.enconman.2017.08.063 ↗
73. Chechkin, A.V., Metzler, R., Klafter, J., and Gonchar, V.Y. (2008). Anomalous Transport: Foundations and Applications, Wiley-VCH Verlag GmbH & Co. KGaA.
74. Yang, X.S., and Deb, S. (2009, January 9–11). Cuckoo search via Lévy flights. Proceedings of the 2009 World congress on nature & biologically inspired computing (NaBIC), Coimbatore, India.10.1109/NABIC.2009.5393690 ↗
75. Dynamic levy flight chimp optimization10.1016/j.knosys.2021.107625 ↗
76. An efficient modified grey wolf optimizer with Lévy flight for optimization tasks10.1016/j.asoc.2017.06.044 ↗
77. A prescription of methodological guidelines for comparing bio-inspired optimization algorithms10.1016/j.swevo.2021.100973 ↗
78. An approximate analysis of variance test for normality10.1080/01621459.1972.10481232 ↗
79. Wilcoxon, F. (1992). Breakthroughs in Statistics, Springer.
80. Gini-Impurity index analysis10.1109/TIFS.2021.3076932 ↗