journal article·2023-10-01Open access

Short-term wind power forecasting by bidirectional attention mechanism LSTM and its probability interval prediction by sliding-window KDE

Xin Liu, Peijuan Li, Baochun Xu

AIP Advances· Volume 13· Issue 10

Abstract

Deterministic point wind power forecasting (DP-WPF) and its probability interval prediction (PIP) are indispensable to short-term peak alleviation and frequency regulation in power systems with large-scale wind power injection. To improve short-term DP-WPF by long short-term memory (LSTM), a horizontal/vertical bidirectional feature attention (BFA) based LSTM model is proposed. More specifically, the BFA-LSTM model has three parts: first, multivariate time series are fed into LSTM to extract long-short-term temporal features; second, the LSTM outputs are processed horizontally as well as vertically for retrieving step-wise/multistep-wise temporal features, respectively, namely, in the bidirectional attention sense; third, both the horizontal and vertical attention weights are adaptively adjusted according to the feature importance in DP-WPF. Cases comparison shows that the suggested modeling is stably superior to most common counterparts. To address PIP by kernel density estimation (KDE), sliding-window KDE is leveraged for probability analysis. More precisely, probability density functions (PDF) and probability intervals are estimated with sliding-window samples, which are non-parametric operations and involve finitely many local samples. Superior performances of PIP by sliding-window KDE at different confidence levels indicate that the sliding-window PDF approach is highly effective in contrast to those with all samples.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Energy Load and Power Forecasting · Grey System Theory Applications · Computational Physics and Python Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Industrial Center/School of Innovation and Entrepreneurship, Nanjing Institute of Technology 1 , Nanjing 211167, China

College of Energy and Electrical Engineering, Hohai University 2 , Nanjing 211100, China

Funding

Nanjing Institute of Technology

References (48)

Show source-provided references
1. Short-term wind power combined forecasting based on error forecast correction10.1016/j.enconman.2016.04.036 ↗
2. Smart wind speed deep learning based multi-step forecasting model using singular spectrum analysis, convolutional gated recurrent unit network and support vector regression10.1016/j.renene.2019.05.039 ↗
3. ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP),10.1109/ICASSP43922.2022.9747383 ↗
4. A review of wind power forecasting models10.1016/j.egypro.2011.10.103 ↗
5. Comparison of the effectiveness of analytical wake models for wind farm with constant and variable hub heights10.1016/j.enconman.2016.07.017 ↗
6. Markov chain modeling for very-short-term wind power forecasting10.1016/j.epsr.2014.12.025 ↗
7. Wind speed and wind energy forecast through Kalman filtering of numerical weather prediction model output10.1016/j.apenergy.2012.03.054 ↗
8. Application of ARMA model in ultra-short term prediction of wind power10.1109/CSA.2013.91 ↗
9. Deep concatenated residual network with bidirectional LSTM for one-hour-ahead wind power forecasting10.1109/tste.2020.3043884 ↗
10. Ultra-short-term wind power prediction by salp swarm algorithm-based optimizing extreme learning machine10.1109/access.2020.2978098 ↗
11. Short-term wind power prediction based on particle swarm optimization-extreme learning machine model combined with adaboost algorithm10.1109/access.2021.3093646 ↗
12. Hybrid forecasting method for wind power integrating spatial correlation and corrected numerical weather prediction10.1016/j.apenergy.2021.116951 ↗
13. Hybrid model for short-term wind power forecasting based on singular spectrum analysis and a temporal convolutional attention network with an adaptive receptive field10.1016/j.enconman.2022.116138 ↗
14. Polynomial activation neural networks: Modeling, stability analysis and coverage BP-training10.1016/j.neucom.2019.06.004 ↗
15. Comparison and evaluation of activation functions in term of gradient instability in deep neural networks10.1109/CCDC.2019.8832578 ↗
16. Short-term wind power forecasting by stacked recurrent neural networks with parametric sine activation function10.1016/j.epsr.2020.107011 ↗
17. Neural machine translation by jointly learning to align and translate
18. ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP39728.2021.9413901 ↗
19. 2021 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN52387.2021.9534103 ↗
20. Temporal pattern attention for multivariate time series forecasting10.1007/s10994-019-05815-0 ↗
21. Feature weighting as a tool for unsupervised feature selection10.1016/j.ipl.2017.09.005 ↗
22. Short-term wind power forecasting based on attention mechanism and deep learning10.1016/j.epsr.2022.107776 ↗
23. H. Liu , H.Ma, and T.Hu, “Enhancing short-term wind speed forecasting using graph attention and frequency-enhanced mechanisms,” arXiv:2305.11526 [cs.LG] (2023).
24. Review on probabilistic forecasting of wind power generation10.1016/j.rser.2014.01.033 ↗
25. H. Wen , “Probabilistic wind power forecasting with missing values via adaptive quantile regression,” arXiv:2305.14662 [stat.AP] (2023).10.36227/techrxiv.23118806 ↗
26. Space and time efficient kernel density estimation in high dimensions
27. Layer-constrained variational autoencoding kernel density estimation model for anomaly detection10.1016/j.knosys.2020.105753 ↗
28. Unbiased cross-validation kernel density estimation for wind and PV probabilistic modelling10.1016/j.enconman.2022.115811 ↗
29. Incorporating spatial and temporal correlations to improve aggregation of decentralized day-ahead wind power forecasts10.1109/access.2022.3219602 ↗
30. Forecasted scenarios of regional wind farms based on regular vine copulas10.35833/mpce.2017.000570 ↗
31. Fast kernel density estimation with density matrices and random fourier features
32. Convolutional networks for images, speech, and time series
33. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
34. A method for stochastic optimization
35. Short-term probabilistic predictions of wind multi-parameter based on one-dimensional convolutional neural network with attention mechanism and multivariate copula distribution estimation10.1016/j.energy.2021.121306 ↗
36. Density estimation for statistics and data analysis10.2307/2347507 ↗
37. Kernel density estimation and its application10.1051/itmconf/20182300037 ↗
38. Smoothed cross-validation10.1007/bf01205233 ↗
39. 1986
40. The wind integration national dataset (wind) toolkit10.1016/j.apenergy.2015.03.121 ↗
41. Centering, scaling, and transformations: Improving the biological information content of metabolomics data10.1186/1471-2164-7-142 ↗
42. An advanced short-term wind power forecasting framework based on the optimized deep neural network models10.1016/j.ijepes.2022.108143 ↗
43. Forecasting of wind power generation with the use of artificial neural networks and support vector regression models10.1016/j.egypro.2018.12.007 ↗
44. Ultra-short term wind power forecasting based on LSTM neural network
45. S. Bai , J.Kolter, and V.Koltun, “An empirical evaluation of generic convolutional and recurrent networks for sequence modeling,” arXiv:1803.01271 [cs.LG] (2018).
46. 2.04—Wind energy potential (measurements, evaluation, forecasting)
47. Short-term wind speed or power forecasting with heteroscedastic support vector regression10.1109/tste.2015.2480245 ↗
48. A novel asexual-reproduction evolutionary neural network for wind power prediction based on generative adversarial networks10.1016/j.enconman.2021.114714 ↗