journal article·2023-02-07Open access

Open-Set Signal Recognition Based on Transformer and Wasserstein Distance

Wei Zhang, Da Huang, Minghui Zhou, Jingran Lin, Xiangfeng Wang

Applied Sciences· Volume 13· Issue 4

Abstract

Open-set signal recognition provides a new approach for verifying the robustness of models by introducing novel unknown signal classes into the model testing and breaking the conventional closed-set assumption, which has become very popular in real-world scenarios. In the present work, we propose an efficient open-set signal recognition algorithm, which contains three key sub-modules: the signal representation sub-module based on a vision transformer (ViT) structure, a set distance metric sub-module based on Wasserstein distance, and a class space compression sub-module based on reciprocal point separation and central loss. In this algorithm, the representing features of signals are established based on transformer-based neural networks, i.e., ViT, in order to extract global information about time series-related data. The employed reciprocal point is used in modeling the potential unknown space without using the corresponding samples, while the distance metric between different class spaces is mathematically modeled in terms of the Wasserstein distance instead of the classical Euclidean distance. Numerical experiments on different open-set signal recognition tasks show that the proposed algorithm can significantly improve the recognition efficiency in both known and unknown categories.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Blind Source Separation Techniques · Wireless Signal Modulation Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China

Science and Technology on Electronic Information Control Laboratory, Chengdu 610036, China

School of Computer Science and Technology, East China Normal University, Shanghai 200062, China

Funding

NSFC

References (44)

Show source-provided references
1. O’Shea, T.J., Corgan, J., and Clancy, T.C. (2016, January 6–8). Unsupervised representation learning of structured radio communication signals. Proceedings of the SPLINE, Aalborg, Denmark.10.1109/SPLIM.2016.7528397 ↗
2. Over-the-Air Deep Learning Based Radio Signal Classification10.1109/JSTSP.2018.2797022 ↗
3. SR2CNN: Zero-Shot Learning for Signal Recognition10.1109/TSP.2021.3070186 ↗
4. SSRCNN: A Semi-Supervised Learning Framework for Signal Recognition10.1109/TCCN.2021.3067916 ↗
5. Recent advancement in haze removal approaches10.1007/s00530-021-00865-8 ↗
6. Batool, R., Bibi, N., Muhammad, N., and Alhazmi, S. (2022). Detection of Primary User Emulation Attack Using the Differential Evolution Algorithm in Cognitive Radio Networks. Appl. Sci., 13.10.3390/app13010571 ↗
7. Recent Advances in Open Set Recognition: A Survey10.1109/TPAMI.2020.2981604 ↗
8. Toward Open Set Recognition10.1109/TPAMI.2012.256 ↗
9. Probability Models for Open Set Recognition10.1109/TPAMI.2014.2321392 ↗
10. Jain, L.P., Scheirer, W.J., and Boult, T.E. (2014, January 6–12). Multi-class Open Set Recognition Using Probability of Inclusion. Proceedings of the ECCV, Zurich, Switzerland.10.1007/978-3-319-10578-9_26 ↗
11. Rethinking compact abating probability modeling for open set recognition problem in Cyber-physical systems10.1016/j.sysarc.2019.101660 ↗
12. Open set recognition for automatic target classification with rejection10.1109/TAES.2015.150027 ↗
13. Best Fitting Hyperplanes for Classification10.1109/TPAMI.2016.2587647 ↗
14. Cevikalp, H., and Triggs, B. (2017, January 21–26). Polyhedral Conic Classifiers for Visual Object Detection and Classification. Proceedings of the CVPR, Honolulu, HI, USA.10.1109/CVPR.2017.438 ↗
15. Sparse Representation-Based Open Set Recognition10.1109/TPAMI.2016.2613924 ↗
16. Nearest neighbors distance ratio open-set classifier10.1007/s10994-016-5610-8 ↗
17. Vareto, R.H., Silva, S., de Oliveira Costa, F., and Schwartz, W.R. (2017, January 1–4). Towards open-set face recognition using hashing functions. Proceedings of the IJCB, Denver, CO, USA.10.1109/BTAS.2017.8272751 ↗
18. The Extreme Value Machine10.1109/TPAMI.2017.2707495 ↗
19. Bendale, A., and Boult, T.E. (July, January 26). Towards Open Set Deep Networks. Proceedings of the CVPR, Las Vegas, NV, USA.
20. Prakhya, S., Venkataram, V., and Kalita, J. (2017, January 18–21). Open Set Text Classification Using CNNs. Proceedings of the ICON, Antalya, Turkey.
21. Shu, L., Xu, H., and Liu, B. (2017, January 7–11). DOC: Deep Open Classification of Text Documents. Proceedings of the EMNLP, Copenhagen, Denmark.10.18653/v1/D17-1314 ↗
22. Weightless neural networks for open set recognition10.1007/s10994-017-5646-4 ↗
23. Yoshihashi, R., Shao, W., Kawakami, R., You, S., Iida, M., and Naemura, T. (2019, January 16–20). Classification-Reconstruction Learning for Open-Set Recognition. Proceedings of the CVPR, Long Beach, CA, USA.10.1109/CVPR.2019.00414 ↗
24. Oza, P., and Patel, V.M. (2019, January 16–20). C2AE: Class Conditioned Auto-Encoder for Open-Set Recognition. Proceedings of the CVPR, Long Beach, CA, USA.10.1109/CVPR.2019.00241 ↗
25. Hassen, M., and Chan, P.K. (2020, January 24–26). Learning a Neural-network-based Representation for Open Set Recognition. Proceedings of the SDM, Split, Croatia.10.1137/1.9781611976236.18 ↗
26. Adversarial Reciprocal Points Learning for Open Set Recognition
27. Mahdavi, A., and Carvalho, M. (2021, January 1–3). A Survey on Open Set Recognition. Proceedings of the AIKE, Laguna Hills, CA, USA.10.1109/AIKE52691.2021.00013 ↗
28. O’Shea, T.J., Corgan, J., and Clancy, T.C. (2016, January 2–5). Convolutional Radio Modulation Recognition Networks. Proceedings of the EANN, Aberdeen, UK.10.1007/978-3-319-44188-7_16 ↗
29. Modulation Classification Based on Signal Constellation Diagrams and Deep Learning10.1109/TNNLS.2018.2850703 ↗
30. Big Data Processing Architecture for Radio Signals Empowered by Deep Learning: Concept, Experiment, Applications and Challenges10.1109/ACCESS.2018.2872769 ↗
31. Evaluating Adversarial Evasion Attacks in the Context of Wireless Communications10.1109/TIFS.2019.2934069 ↗
32. Automatic Multicarrier Waveform Classification via PCA and Convolutional Neural Networks10.1109/ACCESS.2018.2869901 ↗
33. Specific Emitter Identification Using Convolutional Neural Network-Based IQ Imbalance Estimators10.1109/ACCESS.2019.2903444 ↗
34. Automatic Modulation Classification Using Compressive Convolutional Neural Network10.1109/ACCESS.2019.2921988 ↗
35. Deep Learning Based Communication Over the Air10.1109/JSTSP.2017.2784180 ↗
36. Kardan, N., and Stanley, K.O. (2017, January 14–19). Mitigating fooling with competitive overcomplete output layer neural networks. Proceedings of the IJCNN, Anchorage, AK, USA.10.1109/IJCNN.2017.7965897 ↗
37. Neal, L., Olson, M., Fern, X., Wong, W.K., and Li, F. (2018, January 8–14). Open Set Learning with Counterfactual Images. Proceedings of the ECCV, Munich, Germany.10.1007/978-3-030-01231-1_38 ↗
38. Ge, Z., Demyanov, S., and Garnavi, R. (2017, January 4–7). Generative OpenMax for Multi-Class Open Set Classification. Proceedings of the BMVC, London, UK.10.5244/C.31.42 ↗
39. Yu, Y., Qu, W.Y., Li, N., and Guo, Z. (2017, January 19–25). Open-category classification by adversarial sample generation. Proceedings of the IJCAI, Melbourne, Australia.10.24963/ijcai.2017/469 ↗
40. Yue, Z., Wang, T., Zhang, H., Sun, Q., and Hua, X.S. (2021, January 19–25). Counterfactual Zero-Shot and Open-Set Visual Recognition. Proceedings of the CVPR, Online.10.1109/CVPR46437.2021.01515 ↗
41. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4–9). Attention is All you Need. Proceedings of the NeurIPS, Long Beach, CA, USA.
42. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 3–7). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. Proceedings of the ICLR, Online.
43. Mehta, S., and Rastegari, M. (2022, January 25–29). MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer. Proceedings of the ICLR, Online.
44. Wen, Y., Zhang, K., Li, Z., and Qiao, Y. (2016, January 11–14). A discriminative feature learning approach for deep face recognition. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-46478-7_31 ↗