RPM-ETC: A Risk Prediction Model for Elevators Based on Transformer and Self-Temporal Compression Mechanism
Source abstract
Abstract
Elevators play an indispensable role in modern urban life. Ensuring the safe operation of elevators is crucial due to the severe consequences of malfunctions. Traditional maintenance methods are costly and may not comprehensively capture potential faults. Leveraging deep learning technologies, this study proposes a Risk Prediction Model based on Elevator Transformer and Self-temporal Compression Mechanism (RPM-ETC). By analyzing rich operational data, the model predicts potential faults before significant issues arise. The model utilizes the Transformer architecture to effectively capture temporal relationships and employs a temporal compression mechanism to enhance prediction efficiency. Additionally, it uses Enhanced Positional Encoding to prevent the the loss of temporal information as network depth increases. Based on the obtained performance results, the model achieves an accuracy of 86.3% and a frame-per-second (FPS) rate of 388.7, accurately and rapidly predicting elevator faults. Additionally, this paper provides a comprehensive dataset for elevator operation prediction to facilitate further research.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Elevator Systems and Control
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
The Key Lab of Computer Network and Information Integration (Ministry of Education), School of Computer Science and Engineering, Southeast University, Nanjing 211189, China
Hangzhou Special Equipment Inspection and Science Research Institute, Hangzhou 310015, China
Nanjing U-lake Technology Co., Ltd., Nanjing 211111, China
School of Cyber Science and Engineering, Southeast University, Nanjing 211189, China
Purple Mountain Laboratories, Nanjing 211189, China
Funding
2023 Science and Technology Program of the Zhejiang Administration for Market Regulation
References (42)
Show source-provided references
1. History and future strategy for installing vertical transportation equipment in Tokyo Metro
2. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
3. Bao, F., and Chen, R. (2012, January 25–28). Trust management for the internet of things and its application to service composition. Proceedings of the 2012 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM), San Francisco, CA, USA.
4. Sagiroglu, S., and Sinanc, D. (2013, January 20–24). Big data: A review. Proceedings of the 2013 International Conference on Collaboration Technologies and Systems (CTS), San Diego, CA, USA.10.1109/CTS.2013.6567202 ↗
5. Zhang, D., and Tao, H. (2024). Bearing Fault Diagnosis Based on Parameter-Optimized Variational Mode Extraction and an Improved One-Dimensional Convolutional Neural Network. Appl. Sci., 14.10.3390/app14083289 ↗
6. Time Series Extended Finite-State Machine-Based Relevance Vector Machine Multi-Fault Prediction10.1002/ceat.201600025 ↗
7. Wang, Z., Zhang, J., and Sun, M. (2024). MoCoformer: Quantifying Temporal Irregularities in Solar Wind for Long-Term Sequence Prediction. Appl. Sci., 14.10.3390/app14114775 ↗
8. Yang, W., Zhang, Z., Meng, K., Wang, K., and Wang, R. (2024). CEEMDAN-RIME–Bidirectional Long Short-Term Memory Short-Term Wind Speed Prediction for Wind Farms Incorporating Multi-Head Self-Attention Mechanism. Appl. Sci., 14.10.3390/app14188337 ↗
9. Chandola, V., Mithal, V., and Kumar, V. (2008, January 15–19). Comparative Evaluation of Anomaly Detection Techniques for Sequence Data. Proceedings of the Eighth IEEE International Conference on Data Mining, Pisa, Italy.10.1109/ICDM.2008.151 ↗
10. Wang, X., Zhang, J., Wang, X., Wu, Z., and Prodhan, F.A. (2024). Incorporating Multi-Temporal Remote Sensing and a Pixel-Based Deep Learning Classification Algorithm to Map Multiple-Crop Cultivated Areas. Appl. Sci., 14.10.3390/app14093545 ↗
11. Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., and Zhang, W. (2021, January 2–9). Informer: Beyond efficient transformer for long sequence time-series forecasting. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.10.1609/aaai.v35i12.17325 ↗
12. Chen, M., Peng, H., Fu, J., and Ling, H. (2021, January 10–17). AutoFormer: Searching Transformers for Visual Recognition. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.01205 ↗
13. Zhou, T., Ma, Z., Wen, Q., Wang, X., Sun, L., and Jin, R. (2022, January 17–23). Fedformer: Frequency enhanced decomposed transformer for long-term series forecasting. Proceedings of the International Conference on Machine Learning, PMLR, Baltimore, MD, USA.
14. Liu, S., Yu, H., Liao, C., Li, J., Lin, W., Liu, A.X., and Dustdar, S. (2022, January 25). Pyraformer: Low-Complexity Pyramidal Attention for Long-Range Time Series Modeling and Forecasting. Proceedings of the International Conference on Learning Representations, Virtual.
15. Temporal fusion transformers for interpretable multi-horizon time series forecasting10.1016/j.ijforecast.2021.03.012 ↗
16. Lin, Y., Koprinska, I., and Rana, M. (2021, January 7–10). SSDNet: State space decomposition neural network for time series forecasting. Proceedings of the 2021 IEEE International Conference on Data Mining (ICDM), Auckland, New Zealand.10.1109/ICDM51629.2021.00048 ↗
17. Probabilistic transformer for time series analysis
18. Self-attention for raw optical satellite time series classification10.1016/j.isprsjprs.2020.06.006 ↗
19. Self-Supervised Pre-Training of Transformers for Satellite Image Time Series Classification10.1109/JSTARS.2020.3036602 ↗
20. Zerveas, G., Jayaraman, S., Patel, D., Bhamidipaty, A., and Eickhoff, C. (2021, January 14–18). A transformer-based framework for multivariate time series representation learning. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, Virtual.10.1145/3447548.3467401 ↗
21. Yang, C.H.H., Tsai, Y.Y., and Chen, P.Y. (2021, January 18–24). Voice2series: Reprogramming acoustic models for time series classification. Proceedings of the International Conference on Machine Learning, PMLR, Virtual.
22. Functional Data Analysis10.1016/j.energy.2020.119324 ↗
23. Hsieh, T., Sun, Y., Wang, S., and Honavar, V. (May, January 29). Functional Autoencoders for Functional Data Representation Learning. Proceedings of the SIAM International Conference on Data Mining, Virtual.
24. Rao, A.R., Wang, H., and Gupta, C. (2023, January 17–20). A Functional approach for Two Way Dimension Reduction in Time Series. Proceedings of the 2022 IEEE International Conference on Big Data (Big Data), Osaka, Japan.10.1109/BigData55660.2022.10020482 ↗
25. Larose, D.T., and Larose, C.D. (2014). Discovering Knowledge in Data (An Introduction to Data Mining) || Data Preprocessing, John Wiley & Sons, Inc.10.1002/9781118874059 ↗
26. Reinforcement Learning-Based Genetic Algorithm in Optimizing Multidimensional Data Discretization Scheme
27. Chu, X., Ilyas, I.F., Krishnan, S., and Wang, J. (July, January 26). Data cleaning: Overview and emerging challenges. Proceedings of the 2016 International Conference on Management of Data, San Francisco, CA, USA.10.1145/2882903.2912574 ↗
28. Gu, A., Goel, K., and Ré, C. (2021). Efficiently modeling long sequences with structured state spaces. arXiv.
29. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning, PMLR, Lille, France.
30. Liu, G., Wu, X., and Romanov, V. (2024). Unconventional Wells Interference: Supervised Machine Learning for Detecting Fracture Hits. Appl. Sci., 14.10.3390/app14072927 ↗
31. Orr, G.B., and Müller, K.R. (1996, January 3–5). Neural Networks: Tricks of the Trade. Proceedings of the Annual Conference on Neural Information Processing Systems, Denver, CO, USA.
32. Ginsburg, B., Gitman, I., and You, Y. (2017). Large Batch Training of Convolutional Networks. arXiv.
33. Houlsby, N., Giurgiu, A., Jastrzebski, S., Morrone, B., De Laroussilhe, Q., Gesmundo, A., Attariyan, M., and Gelly, S. (2019, January 9–15). Parameter-efficient transfer learning for NLP. Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA.
34. Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv.
35. A more accurate measure of the false-negative rate of papanicolaou smear screening is obtained by determining the false-negative rate of the rescreening process
36. Improved precision and recall metric for assessing generative models
37. Brandaris 128: A digital 25 million frames per second camera with 128 highly sensitive frames10.1063/1.1626013 ↗
38. ElSaid, A., Wild, B., Higgins, J., and Desell, T. (2016, January 23–27). Using LSTM recurrent neural networks to predict excess vibration events in aircraft engines. Proceedings of the 2016 IEEE 12th International Conference on e-Science (e-Science), Baltimore, MD, USA.10.1109/eScience.2016.7870907 ↗
39. Zhang, J., and Man, K.F. (1998, January 14). Time series prediction using RNN in multi-dimension embedding phase space. Proceedings of the SMC’98 Conference Proceedings—1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No. 98CH36218), San Diego, CA, USA.
40. Attention is all you need
41. Dempster, A., Schmidt, D.F., and Webb, G. (2020, January 6–10). MINIROCKET: A Very Fast (almost) Deterministic Transform for Time Series Classification. Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Virtual.10.1145/3447548.3467231 ↗
42. SMOTE: Synthetic Minority Over-Sampling Technique10.1613/jair.953 ↗