journal article·2025-11-11Open access

Speech Recognition-Based Analysis of Vessel Traffic Service (VTS) Communications for Estimating Advisory Timing

Sang-Lok Yoo, Kwang-Il Kim, Cho-Young Jung

Applied Sciences· Volume 15· Issue 22

Abstract

Vessel Traffic Service systems play a critical role in maritime safety by providing timely advisories to vessels in congested waterways. However, the optimal timing for VTS operator interventions has remained largely unstudied, relying primarily on subjective operator experience rather than empirical evidence. This study presents the first large-scale empirical analysis of VTS operator intervention timing using automated speech recognition technology applied to actual maritime communication data. VHF radio communications were collected from five major VTS centers in Korea over nine months, comprising 171,175 communication files with a total duration of 334.2 h. The recorded communications were transcribed using the Whisper speech-to-text model and processed through natural language processing techniques to extract encounter situations and advisory distances. A tokenization and keyword framework was developed to handle Maritime English and local-language communications, normalize textual numerical expressions, and facilitate cross-site analysis. Results reveal that VTS operator intervention timing varies by encounter type. In head-on and crossing encounters, advisories are provided at distances, with mean values of 3.1 nm and 2.8 nm, respectively. These quantitative benchmarks provide an empirical foundation for developing standardized VTS operational guidelines and decision support systems, ultimately enhancing maritime safety and operational consistency across jurisdictions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Maritime Navigation and Safety · Human-Automation Interaction and Safety · Marine and Coastal Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Artificial Intelligence, Jeonju University, Jeonju 55069, Republic of Korea

Department of Marine Industry and Maritime Police, Jeju National University, Jeju 63243, Republic of Korea

Department of Public Service in Ocean and Fisheries, Kunsan National University, Gunsan 54150, Republic of Korea

Funding

Jeonju University · Development of voice recognition technology for ship wireless communication equipment to respond to illegal foreign ship · Next-Generation Digital VTS International Standard Service and Equipment Development

References (25)

Show source-provided references
1. The geography of maritime networks: A critical review10.1016/j.jtrangeo.2020.102824 ↗
2. Exploring technical and non-technical competencies of navigators for autonomous shipping10.1080/03088839.2021.1914874 ↗
3. Safety in shipping: The human element10.1016/j.jsr.2006.04.007 ↗
4. Searching for the origins of the myth: 80% human error impact on maritime safety10.1016/j.ress.2021.107942 ↗
5. Human error in marine accidents: Is the crew normally to blame?
6. When is a VTS not a VTS?10.1017/S0373463309005396 ↗
7. Relationship between human factors and a safe performance of vessel traffic service operators: A systematic qualitative-based review in maritime safety10.1016/j.ssci.2022.105892 ↗
8. Modelling Vessel Traffic Service to understand resilience in everyday operations10.1016/j.ress.2015.03.020 ↗
9. How big data enriches maritime research—A critical review of Automatic Identification System (AIS) data applications10.1080/01441647.2019.1649315 ↗
10. Extracting maritime traffic networks from AIS data using evolutionary algorithm10.1007/s12599-020-00661-0 ↗
11. Exploring AIS data for intelligent maritime routes extraction10.1016/j.apor.2020.102271 ↗
12. Forti, N., Millefiori, L.M., and Braca, P. (2019, January 17–20). Unsupervised extraction of maritime patterns of life from Automatic Identification System data. Proceedings of the OCEANS 2019—Marseille, Marseille, France.10.1109/OCEANSE.2019.8867429 ↗
13. The study of ship collision avoidance route planning by ant colony algorithm10.51400/2709-6998.1929 ↗
14. A robust GA/PSO-hybrid algorithm in intelligent shipping route planning systems for maritime traffic networks
15. Lamm, A., and Hahn, A. (2017, January 18). Detecting maneuvers in maritime observation data with CUSUM. Proceedings of the 2017 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Bilbao, Spain.10.1109/ISSPIT.2017.8388628 ↗
16. Data-driven based automatic maritime routing from massive AIS trajectories in the face of disparity10.1016/j.oceaneng.2018.02.060 ↗
17. International Maritime Organization (2010). IMO Model Course 3.17, Maritime English.
18. Deep learning for automatic speech recognition in maritime VHF communication
19. Ship collision candidate detection method: A velocity obstacle approach10.1016/j.oceaneng.2018.10.023 ↗
20. A basic study on the VTS operator’s minimum safe distance10.7837/kosomes.2013.19.5.476 ↗
21. A Basic Study on Development of VTS Control Guideline based on ship’s operator’s Consciousness10.5394/KINPR.2016.40.3.105 ↗
22. International Maritime Organization (1972). Convention on the International Regulations for Preventing Collisions at Sea (COLREG), 1972, IMO.
23. Amodei, D., Ananthanarayanan, S., Anubhai, R., Bai, J., Battenberg, E., Case, C., and Zhu, Z. (2016, January 19–24). Deep speech 2: End-to-end speech recognition in english and mandarin. Proceedings of the International Conference on Machine Learning, New York, NY, USA.
24. wav2vec 2.0: A framework for self-supervised learning of speech representations
25. Radford, A., Kim, J.W., Xu, T., Brockman, G., McLeavey, C., and Sutskever, I. (2023, January 23–29). Robust speech recognition via large-scale weak supervision. Proceedings of the 40th International Conference on Machine Learning, Honolulu, HI, USA.