A Hybrid Model of Conformer and LSTM for Ocean Wave Height Prediction
Source abstract
Abstract
This study proposes a hybrid model (Conformer-LSTM) based on Conformer and Long Short-Term Memory networks (LSTM) to overcome the limitations of existing techniques and enhance the accuracy and generalizability of wave height predictions. The model combines the advantages of self-attention mechanisms and convolutional neural networks. It captures global dependencies through multi-head self-attention and utilizes convolutional layers to extract local features, thereby enhancing the model’s adaptability to dynamic changes in time series. The LSTM component handles long-term dependencies, optimizing the coherence and stability of predictions. Additionally, an adaptive feature fusion weight network is introduced to further improve the model’s recognition and utilization efficiency of key features. Experimental data come from the National Oceanic and Atmospheric Administration buoy data, covering wave height, wind speed, and other data from key maritime areas. Evaluation metrics include Mean Absolute Error (MAE), Root Mean Square Error (RMSE), Mean Absolute Percentage Error (MAPE), and Coefficient of Determination (R2), ensuring a comprehensive assessment of model performance. The results show that the Conformer-LSTM model outperforms traditional LSTM, CNN, and CNN-LSTM models at multiple sites, confirming its potential in wave height prediction.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Hydrological Forecasting Using AI · Ocean Waves and Remote Sensing · Stock Market Forecasting Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Information Technology, Shanghai Ocean University, Shanghai 201306, China
References (31)
Show source-provided references
1. Hyndman, R.J., and Athanasopoulos, G. (2018). Forecasting: Principles and Practice, OTexts.
2. Box, G.E.P., Jenkins, G.M., Reinsel, G.C., and Ljung, G.M. (2015). Time Series Analysis: Forecasting and Control, John Wiley & Sons.
3. A hybrid EMD-SVR model for the short-term prediction of significant wave height10.1016/j.oceaneng.2016.05.049 ↗
4. Decompose and Conquer: Time Series Forecasting with Multiseasonal Trend Decomposition Using Loess10.3390/forecast5040037 ↗
5. Performance evaluation of input-dissipation parameterizations in WAVEWATCH III and comparison of wave hindcast with nested WAVEWATCH III-SWAN in the Indian Seas10.1016/j.oceaneng.2020.106959 ↗
6. The “SWAN” wave model for shallow water
7. Assessment of the forecasting potential of WAVEWATCH III model under different Indian Ocean wave conditions10.1007/s12040-023-02045-w ↗
8. Evaluation of different wind resources in simulating wave height for the Bohai, Yellow, and East China Seas (BYES) with SWAN model10.1016/j.csr.2020.104217 ↗
9. Time series forecasting using a hybrid ARIMA and neural network model10.1016/S0925-2312(01)00702-0 ↗
10. Long-term prediction of significant wave height based on SARIMA model in the South China Sea and adjacent waters10.1109/ACCESS.2019.2925107 ↗
11. Sun, Z. (2023). Research on the Method of Effective Wave Height Forecasting Based on Deep Learning. [Master’s Thesis, Dalian University of Technology].
12. A novel model to predict significant wave height based on long short-term memory network10.1016/j.oceaneng.2020.107298 ↗
13. Nonstationary significant wave height forecasting with a hybrid VMD-CNN model10.1016/j.oceaneng.2023.115338 ↗
14. Guan, X. (2020, January 23–25). Wave height prediction based on CNN-LSTM. Proceedings of the 2020 2nd International Conference on Machine Learning, Big Data and Business Intelligence (MLBDBI), Taiyuan, China.10.1109/MLBDBI51377.2020.00009 ↗
15. A hybrid EMD-LSTM model for non-stationary wave prediction in offshore China10.1016/j.oceaneng.2022.110566 ↗
16. Gulati, A., Qin, J., Chiu, C.C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., and Wu, Y. (2020). Conformer: Convolution-augmented transformer for speech recognition. arXiv.10.21437/Interspeech.2020-3015 ↗
17. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
18. Learning representations by back-propagating errors10.1038/323533a0 ↗
19. Backpropagation applied to handwritten zip code recognition10.1162/neco.1989.1.4.541 ↗
20. The Proof and Measurement of Association between Two Things10.2307/1422689 ↗
21. VII. Mathematical contributions to the theory of evolution.—III. Regression, heredity, and panmixia10.1098/rsta.1896.0007 ↗
22. Omonigbehin, O., Eresanya EO, O., Tao, A., Setordjie, V.E., Daramola, S., and Adebiyi, A. (2024). Long-Term Evolution of Significant Wave Height in the Eastern Tropical Atlantic between 1940 and 2022 Using the ERA5 Dataset. J. Mar. Sci. Eng., 12.10.3390/jmse12050714 ↗
23. Selection of climatic parameters affecting wave height prediction using an enhanced Takagi-Sugeno-based fuzzy methodology10.1016/j.rser.2016.01.098 ↗
24. A connection between mean wave height and atmospheric pressure gradient in the North Atlantic10.1002/joc.3370130406 ↗
25. Lv, J., Zhang, W., Shi, J., Wu, J., Wang, H., Cao, X., Wang, Q., and Zhao, Z. (2023). The Wave Period Parameterization of Ocean Waves and Its Application to Ocean Wave Simulations. Remote Sens., 15.10.3390/rs15225279 ↗
26. Batch normalization biases residual blocks towards the identity function in deep networks
27. Huang, B., and Feng, X. (2023). Scene Text Detection Based on Multi-Headed Self-Attention Using Shifted Windows. Appl. Sci., 13.10.3390/app13063928 ↗
28. Arifuzzaman, M., Uddin, M.A., Jameel, M., and Bhuiyan, M.T.R. (2022). Nonlinear Response Prediction of Spar Platform in Deep Water Using an Artificial Neural Network. Appl. Sci., 12.10.3390/app12125954 ↗
29. Makridakis, S., Wheelwright, S.C., and Hyndman, R.J. (2008). Forecasting Methods and Applications, John Wiley & Sons.
30. Bidirectional recurrent neural networks10.1109/78.650093 ↗
31. Lea, C., Vidal, R., Reiter, A., and Hager, G.D. (15–16, January 8–10). Temporal convolutional networks: A unified approach to action segmentation. Proceedings of the Computer Vision–ECCV 2016 Workshops, Amsterdam, The Netherlands. Proceedings, Part III 14.