journal article·2024-09-01Open access

Semantic segmentation algorithm for pantograph based on multi-scale strip pooling attention mechanism and application research

Renjie Shi, Liming Li, Shubin Zheng, Yizhou Mao, Xiaoxue An

AIP Advances· Volume 14· Issue 9

Abstract

Detecting pantographs remains a challenging task due to complex scenes, variable weather conditions, and noise interference. Existing pantograph detection methods struggle to effectively segment the complete shape of the pantograph from intricate backgrounds and adverse weather, and they often exhibit inadequate real-time performance. To address these challenges, we propose a novel pantograph segmentation method that leverages a deep learning multi-scale strip pooling attention mechanism. Our approach utilizes the PidNet semantic segmentation network as the baseline architecture, while we introduce a newly designed multi-scale strip pooling attention mechanism specifically for the detail extraction branch. The multi-scale strip convolution branch effectively extracts the pantograph pixel-level detail features, while the pooling branch effectively extracts the macroscopic features of the pantograph. The unique linear interpolation method effectively mitigates the influence of weather, enhancing segmentation accuracy while maintaining a lightweight structure. In the context aggregation branch, a multi-scale context aggregation module utilizing gated convolution has been developed to replace the original network’s module, which possesses strong pantograph positioning capabilities. In comparison to existing pantograph detection methods, our model demonstrates the ability to accurately segment the pantograph with a clearly defined shape, effectively filter out extraneous background noise, and exhibit high robustness to variations in illumination and weather conditions. In addition, a rich pantograph dataset was created, including various scenarios and weather conditions, which also enhanced the robustness of the model. When the IOU and accuracy are 92.91% and 96.04%, respectively, the inference speed can still exceed 30 FPS on a single 2080Ti GPU.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Electrical Contact Performance and Analysis · Gaze Tracking and Assistive Technology · RFID technology advancements

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Urban Railway Transportation, Shanghai University of Engineering Science 1 , Shanghai 201620, China

Higher Vocational and Technical College, Shanghai University of Engineering Science 2 , Shanghai 200437, China

Engineering Training Center, Shanghai University of Engineering Science 3 , Shanghai 201620, China

Funding

National Natural Science Foundation of China · Shanghai Science and Technology Program

References (32)

Show source-provided references
1. On the issue of modeling the interaction of a pantograph with a contact wire10.1063/5.0132432 ↗
2. Automatic detection and monitoring system of Pantograph–Catenary in China’s high-speed railways10.1109/TIM.2020.3022487 ↗
3. Pantograph damage and wear monitoring system10.1049/ic:20060065 ↗
4. A measurement design for pantograph contact force
5. Methods for detecting pantograph defects using sensors installed on contact lines10.2219/rtriqr.57.3_207 ↗
6. Evaluation of time-based arc flash detection with non-contact UV sensor10.1007/s42835-023-01555-3 ↗
7. A novel method of distance measurement based on pulse position modulation and synchronization of chaotic signals using ultrasonic radar systems10.1109/tim.2008.2003309 ↗
8. A new experimental approach using image processing-based tracking for an efficient fault diagnosis in pantograph–catenary systems10.1109/tii.2016.2628042 ↗
9. Hough transform and thermo-vision for monitoring pantograph-catenary system10.1243/0954409jrrt41 ↗
10. Distinctive image features from scale-invariant keypoints10.1023/b:visi.0000029664.99615.94 ↗
11. A robust anomaly detection in pantograph-catenary system based on mean-shift tracking and foreground detection
12. Monitoring of pantograph-catenary interaction by using particle swarm based contact wire tracking
13. Automatic wear measurement of pantograph slider based on multiview analysis10.1109/tii.2020.2997724 ↗
14. Real-time detection of pantograph using improved CenterNet
15. Condition monitoring of railway pantograph using r-CNN and image processing10.1007/s42835-022-01229-6 ↗
16. Defect detection of pantograph slide based on deep learning and image processing technology10.1109/tits.2019.2900385 ↗
17. PIDNet: A real-time semantic segmentation network inspired by PID controllers
18. The influence of the sigmoid function parameters on the speed of backpropagation learning
19. Strip pooling: Rethinking spatial pooling for scene parsing
20. SegNeXt: Rethinking convolutional attention design for semantic segmentation
21. Going deeper with convolutions
22. Hornet: Efficient high-order spatial interactions with recursive gated convolutions
23. Cross-entropy loss functions: Theoretical analysis and applications
24. D. P. Kingma and J.Ba, “Adam: A method for stochastic optimization,” Comput. Sci. arXiv:1412.6980 (2014).
25. BiSeNet: Bilateral segmentation network for real-time semantic segmentation
26. BiSeNet V2: Bilateral network with guided aggregation for real-time semantic segmentation10.1007/s11263-021-01515-2 ↗
27. Deep dual-resolution networks for real-time and accurate semantic segmentation of traffic scenes10.1109/TITS.2022.3228042 ↗
28. Pyramid scene parsing network
29. DNL-net: Deformed non-local neural network for blood vessel segmentation10.1186/s12880-022-00836-z ↗
30. Gcnet: Non-local networks meet squeeze-excitation networks and beyond
31. Fully convolutional networks for semantic segmentation
32. Pointrend: Image segmentation as rendering