journal article·2025-07-24Open access

Deep Learning for Visual Leading of Ships: AI for Human Factor Accident Prevention

Manuel Vázquez Neira, Genaro Cao Feijóo, Blanca Sánchez Fernández, José A. Orosa

Applied Sciences· Volume 15· Issue 15

Abstract

Traditional navigation relies on visual alignment with leading lights, a task typically monitored by bridge officers over extended periods. This process can lead to fatigue-related human factor errors, increasing the risk of maritime accidents and environmental damage. To address this issue, this study explores the use of convolutional neural networks (CNNs), evaluating different training strategies and hyperparameter configurations to assist officers in identifying deviations from proper visual leading. Using video data captured from a navigation simulator, we trained a lightweight CNN capable of advising bridge personnel with an accuracy of 86% during night-time operations. Notably, the model demonstrated robustness against visual interference from other light sources, such as lighthouses or coastal lights. The primary source of classification error was linked to images with low bow deviation, largely influenced by human mislabeling during dataset preparation. Future work will focus on refining the classification scheme to enhance model performance. We (1) propose a lightweight CNN based on SqueezeNet for night-time ship navigation, (2) expand the traditional binary risk classification into six operational categories, and (3) demonstrate improved performance over human judgment in visually ambiguous conditions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Human-Automation Interaction and Safety · Risk and Safety Analysis · Occupational Health and Safety Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Navigation Sciences and Marine Engineering, University of A Coruña, Paseo de Ronda, 51, 15011 A Coruña, Spain

References (15)

Show source-provided references
1. International Maritime Organization (2020). SOLAS: Consolidated Edition 2020: International Convention for the Safety of Life at Sea, 1974, and its Protocol of 1988: Articles, Annexes and Certificates, International Maritime Organization.
2. International Maritime Organization (2022). MARPOL: Consolidated Edition 2022: Articles, Protocols, Annexes, Unified Interpretations of the International Convention for the Prevention of Pollution from Ships, 1973, as Modified by the Protocol of 1978 Relating Thereto, International Maritime Organization.
3. International Maritime Organization (2023). STCW: International Convention on Standards of Training, Certification and Watchkeeping for Seafarers, 1978: Including 2010 Manila Amendments, 2023 Edition, International Maritime Organization.
4. International Maritime Organization (2007). Navi-Trainer Professional 5000: TRANSAS Full-Mission Maritime Simulator, Transas Marine/Wärtsilä.
5. Human factor influences on supervisory control of remotely operated and autonomous vessels10.1016/j.oceaneng.2024.117257 ↗
6. Automation at Sea and Human Factors10.1016/j.ifacol.2024.10.070 ↗
7. Safety at Sea: Human Factors in Shipping10.1016/j.jsr.2006.04.007 ↗
8. Content Analysis of International Standards for Human Factors in Ship Design and Operation10.7225/toms.v10.n02.014 ↗
9. Brcko, T., Pavić, I., Mišković, J., and Androjna, A. (2023). Investigating the Human Factor in Maritime Accidents: A Focus on Compass-Related Incidents. Trans. Marit. Sci., 12.10.7225/toms.v12.n02.w01 ↗
10. Gralak, R., Muczyński, B., and Przywarty, M. (2021). Improving Ship Maneuvering Safety with Augmented Virtuality Navigation Information Displays. Appl. Sci., 11.10.3390/app11167663 ↗
11. The use of a full mission bridge simulator ensuring navigational safety during the Klaipeda seaport development
12. (2020). Class A Standard for the Certification of Maritime Simulators (Standard No. Standard No. 2.14).
13. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2014). Going deeper with convolutions. arXiv.10.1109/CVPR.2015.7298594 ↗
14. Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees
15. Multi-stage stochastic gradient method with momentum acceleration10.1016/j.sigpro.2021.108201 ↗