journal article·2026-05-01Open access

Transformer multimode anomaly detection method based on convolution and LSTM unit

Fan Kuang, Chengzhou Zhang, Yaoyun Liu

AIP Advances· Volume 16· Issue 5

Abstract

Traditional methods for detecting transformer multimodal data often suffer from complex network architectures and nonlinear mapping relationships, leading to ambiguous decision-making processes and unreliable output results. To address this, a multimodal anomaly detection method for transformers based on convolutional networks and LSTM units is proposed. The method calculates the average distance between data points within a sliding window and their spatial center, then compares this distance with a predefined threshold to identify potential anomalous data points. A cross-modal sensing module, composed of a linear layer, a multimodal feature fusion layer, and a feedforward network, is designed. In addition, a dynamic threshold model for transformer operational states is introduced, building upon traditional convolutional neural networks. By incorporating an expansion rate parameter and integrating control mechanisms such as the forget gate, input gate, and output gate into the long short-term memory network, the proposed transformer multimodal anomaly detection model is constructed. The experimental results demonstrate that the detection outcomes of the proposed method align with actual anomaly occurrences, with predicted values closely matching real measurements, achieving an accuracy of ∼98.8%. This approach effectively enables anomaly detection in transformer multimodal data, significantly enhancing the stability and security of power systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Power Transformer Diagnostics and Insulation · Anomaly Detection Techniques and Applications · Power Systems Fault Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Dongguan Power Supply Bureau of Guangdong Power Grid Corporation , Dongguan 523120,

References (23)

Show source-provided references
1. Multi-scale anomaly detection in fiber optic current transformers
2. From anomaly detection to classification with graph attention and transformer for multivariate time series10.1016/j.aei.2024.102357 ↗
3. Multimodal industrial anomaly detection via hybrid fusion
4. Improved ViT multimodal anomaly detection for electricity equipment
5. Anomaly detection and fault classification in multivariate time series using multimodal deep models10.36001/phmconf.2023.v15i1.3810 ↗
6. Anomaly detection for asynchronous multivariate time series of nuclear power plants using a temporal-spatial transformer10.3390/s24092845 ↗
7. A mechanism-guided intelligent enhancement method for early aging information of winding insulation10.1109/tii.2025.3555990 ↗
8. A task-oriented physical collaborative network for pipeline defect diagnosis in a magnetic flux leakage detection system10.1016/j.compind.2025.104290 ↗
9. A reliable bolt key-points detection method in industrial magnetic separator systems10.1109/TIM.2025.3547466 ↗
10. M. Ma , L.Han, and C.Zhou, “Research and application of transformer based anomaly detection model: A literature review,” arXiv:2402.08975 (2024).
11. Fault diagnosis of power transformer based on 1D-CNN-PSO-SVM10.3969/j.issn.1006-9348.2024.03.013 ↗
12. MFGAN: Multimodal fusion for industrial anomaly detection using attention-based autoencoder and generative adversarial network10.3390/s24020637 ↗
13. On the exploration of temporal fusion transformers for anomaly detection with multivariate aviation time-series data10.3390/aerospace11080646 ↗
14. Anomaly detection by using multimodal deep learning10.1117/12.3011769 ↗
15. G. Wu , Y.Zhang, L.Deng, “Cross-modal learning for anomaly detection in fused magnesium smelting process: Methodology and benchmark,” arXiv:2406.09016 (2024).
16. Y. Li , H.Wang, S.Yuan, “Myriad: Large multimodal model by applying vision experts for industrial anomaly detection,” arXiv:2310.19070 (2023).
17. Anomaly detection model for multivariate time series based on stochastic transformer10.11959/j.issn.1000-436x.2023042 ↗
18. Time-series anomaly detection with stacked transformer representations and 1D convolutional network10.1016/j.engappai.2023.105964 ↗
19. Multiresolution feature guidance based transformer for anomaly detection10.1007/s10489-024-05283-7 ↗
20. Transformer-based multivariate time series anomaly detection using inter-variable attention mechanism10.1016/j.knosys.2024.111507 ↗
21. Robust multimodal failure detection for microservice systems
22. MEMTO: Memory-guided transformer for multivariate time series anomaly detection10.52202/075280-2525 ↗
23. Anomaly detection with graph attention network for multimodal IoT data monitoring