journal article·2021-12-27Open access

Multi-Task Deep Learning Model with an Attention Mechanism for Ship Accident Sentence Prediction

Ho-Min Park, Jae-Hoon Kim

Applied Sciences· Volume 12· Issue 1

Abstract

The number of ship accidents occurring in the Korean ocean has been steadily increasing year by year. The Korea Maritime Safety Tribunal (KMST) has published verdicts to ensure that the relevant personnel can share judgment on these accidents. As of 2020, there have been 3156 ship accidents; thus, it is difficult for the relevant personnel to study these various accidents by only reading the verdicts. Therefore, in this study, we propose a multi-task deep learning model with an attention mechanism for predicting the sentencing of ship accidents. The tasks are accident types, applied articles, and the sentencing of ship accidents. The proposed model was tested under verdicts published by the KMST between 2010 and 2019. Through experiments, we show that the proposed model can improve the performance of sentence prediction and can assist the relevant personnel to study these accidents.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Artificial Intelligence in Law · Computational and Text Analysis Methods · Marine and Coastal Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Engineering and Interdisciplinary Major of Maritime AI Convergence, Korea Maritime & Ocean University, Busan 49112, Korea

Department of Control & Automation Engineering and Interdisciplinary Major of Maritime AI Convergence, Korea Maritime & Ocean University, Busan 49112, Korea

References (20)

Show source-provided references
1. Park, H.-M., Cheon, M.-A., and Kim, J.-H. (2020, January 15–16). Developing a model for predicting of ships accident using multi-task learning. Proceedings of the 32nd Annual Conference on Human and Cognitive Language Technology 2020, Online.
2. Case instance generation and refinement for case-based criminal summary judgments in Chinese
3. Liu, C.L., and Heish, C.D. (2006, January 27–29). Exploring phrase-based classification of judicial documents for criminal charges in Chinese. Proceedings of the International Symposium on Methodologies for Intelligent Systems 2006, Bari, Italy.10.1007/11875604_75 ↗
4. Exploiting machine learning models for Chinese legal documents labeling, case classification, and sentencing prediction
5. Liu, C.L., and Liao, T.M. (April, January 29). Classifying criminal charges in Chinese for web-based legal services. Proceedings of the Asia-Pacific Web Conference 2005, Shanghai, China.10.1007/978-3-540-31849-1_8 ↗
6. Predicting associated statues for legal problems10.1016/j.ipm.2014.07.003 ↗
7. Luo, B., Feng, Y., Xu, J., Zhang, X., and Zhao, D. (2017, January 7–11). Learning to predict charges for criminal cases with legal basis. Proceedings of the Conference on Empirical Methods in Natural Language Processing 2017, Copenhagen, Denmark.10.18653/v1/D17-1289 ↗
8. Cho, K.H., Merrienboer, B.V., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25–20). Learning phrase representations using RNN encoder-decoder for statistical machine translation. Proceedings of the Conference on Empirical Methods in Natural Language Processing 2014, Doha, Qatar.10.3115/v1/D14-1179 ↗
9. Ruber, S. (2017). An overview of multi-task learning in deep neural networks. arXiv.
10. Wang, J.L., Farooq, H., Zhuang, H., and Ibrahim, A.K. (2020). Segmentation of Intracranial hemorrhage using semi-supervised multi-task attention-based U-net. Appl. Sci., 10.10.3390/app10093297 ↗
11. Devlin, J., Chang, M.W., Lee, K., and Tautanova, K. (2018). BERT: Pre-training of deep bi-directional transformers for language understanding. arXiv.
12. Cer, D., Yang, Y., Kong, S.Y., Hua, N., Limtiaco, N., John, R.S., and Kurzweil, R. (2018). Universal sentence encoder. arXiv.10.18653/v1/D18-2029 ↗
13. Park, H.-M., Cheon, M.-A., NamGoong, Y., Ho, Y., Choi, M.-S., Kim, J.-K., and Kim, J.-H. (2020, January 2–4). Classification of vessel accidents according to word and sentence embedding. Proceedings of the Korean Institute of Information Scientist and Engineers 2020, Daejeon, Korea.
14. Bahdanau, D., Cho, K., and Bengio, Y. (2014, January 14–16). Neural machine translation by jointly learning to align and translate. Proceedings of the International Conference on Learning Representations 2014, Banff, AB, Canada.
15. Multitask learning
16. Duong, L., Cohn, T., Bird, S., and Cook, P. (2015, January 26–31). Low resource dependency parsing: Cross-lingual parameter sharing in a neural network parser. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing 2015, Beijing, China.10.3115/v1/P15-2139 ↗
17. Support-vector networks10.1007/BF00994018 ↗
18. Katz, D.M., Bommarito, M.J., and Blackman, J. (2017). A general approach for predicting the behavior of the supreme court of the United States. PLoS ONE, 12.10.1371/journal.pone.0174698 ↗
19. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
20. A Korean morphological analayzer using a pre-analyzed partial word-phrase dictionary