journal article·2025-10-02Open access

Frequency-Domain Importance-Based Attack for 3D Point Cloud Object Tracking

Ang Ma, Anqi Zhang, Likai Wang, Rui Yao

Applied Sciences· Volume 15· Issue 19

Abstract

3D point cloud object tracking plays a critical role in fields such as autonomous driving and robotics, making the security of these models essential. Adversarial attacks are a key approach for studying the robustness and security of tracking models. However, research on the generalization of adversarial attacks for 3D point-cloud-tracking models is limited, and the frequency-domain information of the point cloud’s geometric structure is often overlooked. This frequency information is closely related to the generalization of 3D point-cloud-tracking models. To address these limitations, this paper proposes a novel adversarial method for 3D point cloud object tracking, utilizing frequency-domain attacks based on the importance of frequency bands. The attack operates in the frequency domain, targeting the low-frequency components of the point cloud within the search area. To make the attack more targeted, the paper introduces a frequency band importance saliency map, which reflects the significance of sub-frequency bands for tracking and uses this importance as attack weights to enhance the attack’s effectiveness. The proposed attack method was evaluated on mainstream 3D point-cloud-tracking models, and the adversarial examples generated from white-box attacks were transferred to other black-box tracking models. Experiments show that the proposed attack method reduces both the average success rate and precision of tracking, proving the effectiveness of the proposed adversarial attack. Furthermore, when the white-box adversarial samples were transferred to the black-box model, the tracking metrics also decreased, verifying the transferability of the attack method.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Advanced Optical Sensing Technologies · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Xuzhou Public Security Bureau, Xuzhou 221008, China

School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, China

References (31)

Show source-provided references
1. Luo, W., Yang, B., and Urtasun, R. (2018, January 18–23). Fast and furious: Real time end-to-end 3d detection, tracking and motion forecasting with a single convolutional net. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00376 ↗
2. Learning-Based Reflection-Aware Virtual Point Removal for Large-Scale 3D Point Clouds10.1109/LRA.2023.3329365 ↗
3. Multiview abnormal video synopsis in real-time10.1016/j.engappai.2023.106406 ↗
4. Multi-object tracking based on a novel feature image with multi-modal information10.1109/TVT.2023.3259999 ↗
5. Selective Audio Perturbations for Targeting Specific Phrases in Speech Recognition Systems10.1007/s44196-025-00844-1 ↗
6. Wang, Z., Wang, X., Sohel, F., Bennamoun, M., Liao, Y., and Yu, J. (2022, January 7–13). Adversary distillation for one-shot attacks on 3D target tracking. Proceedings of the ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Virtual.10.1109/ICASSP43922.2022.9747080 ↗
7. Liu, X., Lin, Y., Yang, Q., and Fan, H. (2025, January 8–10). Transferable adversarial attack on 3D object tracking in point cloud. Proceedings of the International Conference on Multimedia Modeling, Nara, Japan.
8. Adversarial examples are not bugs, they are features
9. Xu, Z.Q.J., Zhang, Y., and Xiao, Y. (2019, January 12–15). Training behavior of deep neural network in frequency domain. Proceedings of the Neural Information Processing: 26th International Conference, ICONIP 2019, Sydney, NSW, Australia. Proceedings, Part I 26.
10. Li, Y., Yu, A.W., Meng, T., Caine, B., Ngiam, J., Peng, D., Shen, J., Lu, Y., Zhou, D., and Le, Q.V. (2022, January 18–24). Deepfusion: Lidar-camera deep fusion for multi-modal 3d object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01667 ↗
11. Giancola, S., Zarzar, J., and Ghanem, B. (2019, January 15–20). Leveraging shape completion for 3d siamese tracking. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00145 ↗
12. Qi, H., Feng, C., Cao, Z., Zhao, F., and Xiao, Y. (2020, January 13–19). P2b: Point-to-box network for 3d object tracking in point clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00636 ↗
13. Li, B., Yan, J., Wu, W., Zhu, Z., and Hu, X. (2018, January 18–23). High performance visual tracking with siamese region proposal network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00935 ↗
14. Zheng, C., Yan, X., Gao, J., Zhao, W., Zhang, W., Li, Z., and Cui, S. (2021, January 11–17). Box-aware feature enhancement for single object tracking on point clouds. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.01295 ↗
15. Zhou, C., Luo, Z., Luo, Y., Liu, T., Pan, L., Cai, Z., Zhao, H., and Lu, S. (2022, January 18–24). Pttr: Relational 3d point cloud object tracking with transformer. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00834 ↗
16. Exploring point-bev fusion for 3d point cloud object tracking with transformer10.1109/TPAMI.2024.3373693 ↗
17. Xu, T.X., Guo, Y.C., Lai, Y.K., and Zhang, S.H. (2023, January 17–24). CXTrack: Improving 3D point cloud tracking with contextual information. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00111 ↗
18. Zheng, C., Yan, X., Zhang, H., Wang, B., Cheng, S., Cui, S., and Li, Z. (2022, January 18–24). Beyond 3d siamese tracking: A motion-centric paradigm for 3d single object tracking in point clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00794 ↗
19. Cheng, R., Sang, N., Zhou, Y., and Wang, X. (2022, January 7–13). Non-rigid transformation based adversarial attack against 3d object tracking. Proceedings of the ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Virtual.10.1109/ICASSP43922.2022.9746692 ↗
20. Low Frequency Adversarial Perturbation
21. Long, Y., Zhang, Q., Zeng, B., Gao, L., Liu, X., Zhang, J., and Song, J. (2022, January 23–27). Frequency domain model augmentation for adversarial attack. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-19772-7_32 ↗
22. Cai, X., Tao, Y., Liu, D., Zhou, P., Qu, X., Dong, J., Tang, K., and Sun, L. (November, January 28). Frequency-aware gan for imperceptible transfer attack on 3d point clouds. Proceedings of the 32nd ACM International Conference on Multimedia, Melbourne, VIC, Australia.
23. The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains10.1109/MSP.2012.2235192 ↗
24. Wavelets on graphs via spectral graph theory10.1016/j.acha.2010.04.005 ↗
25. Chen, X., Yan, X., Zheng, F., Jiang, Y., Xia, S.T., Zhao, Y., and Ji, R. (2020, January 13–19). One-shot adversarial attacks on visual tracking with dual attention. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01019 ↗
26. Xiang, C., Qi, C.R., and Li, B. (2019, January 15–20). Generating 3d adversarial point clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00935 ↗
27. Fan, H., Su, H., and Guibas, L.J. (2017, January 21–26). A point set generation network for 3d object reconstruction from a single image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.264 ↗
28. Adversarial Geometric Attacks for 3D Point Cloud Object Tracking10.1109/TMM.2025.3557613 ↗
29. Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16–21). Are we ready for autonomous driving?. the kitti vision benchmark suite. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.10.1109/CVPR.2012.6248074 ↗
30. Wu, Y., Lim, J., and Yang, M.H. (2013, January 23–28). Online object tracking: A benchmark. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.312 ↗
31. Wu, Q., Yang, J., Sun, K., Zhang, C., Zhang, Y., and Salzmann, M. (2023, January 1–6). Mixcycle: Mixup assisted semi-supervised 3d single object tracking with cycle consistency. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01283 ↗