An Explainable Deep Semantic Coding for Binary-Classification- Oriented Communication
Source abstract
Abstract
Semantic communication is emerging as a promising communication paradigm, where semantic coding plays an essential role by explicitly extracting task-critical information. Prior efforts toward semantic coding often rely on learning-based feature extraction methods but tend to overlook data compression and lack a rigorous theoretical foundation. To address these limitations, this paper proposes a novel explainable deep semantic coding framework, considering a binary mixed source and a classification task at the receiver. From an information-theoretic perspective, we formulate a semantic coding problem that jointly optimizes data compression rate and classification accuracy subject to distortion constraints. To solve this problem, we leverage deep learning techniques and variational approximation methods to develop practical deep semantic coding schemes. Experiments on the CelebA dataset and the CIFAR-10 dataset demonstrate that the proposed schemes effectively balance data compression and binary classification accuracy, which aligns with the theoretical formulation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Digital Media Forensic Detection · Wireless Signal Modulation Classification · Advanced Steganography and Watermarking Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Electronic and Information Engineering, Tongji University, Shanghai 201804, China
Funding
Inter-Governmental International Science and Technology Innovation Cooperation of National Key Research and Development Program of China · National Natural Science Foundation of China
References (36)
Show source-provided references
1. Goal-oriented quantization: Analysis, design, and application to resource allocation10.1109/JSAC.2022.3221976 ↗
2. Semantic communications: Overview, open issues, and future research directions10.1109/MWC.101.2100269 ↗
3. Semantic communications for future internet: Fundamentals, applications, and challenges10.1109/COMST.2022.3223224 ↗
4. Wireless image transmission using deep source channel coding with attention modules10.1109/TCSVT.2021.3082521 ↗
5. Semantic communications for image recovery and classification via deep joint source and channel coding10.1109/TWC.2023.3349330 ↗
6. Communication-efficient framework for distributed image semantic wireless transmission10.1109/JIOT.2023.3304650 ↗
7. Classification-oriented distributed semantic communication for multivariate time series10.1109/LSP.2023.3265330 ↗
8. Deep learning enabled semantic communication systems10.1109/TSP.2021.3071210 ↗
9. A lite distributed semantic communication system for Internet of Things10.1109/JSAC.2020.3036968 ↗
10. Wang, Z., Zou, L., Wei, S., Liao, F., Zhuo, J., Mi, H., and Lai, R. (2024). Large language model enabled semantic communication systems. arXiv.
11. Enhanced semantic information transfer on RIS-assisted communication systems10.1109/LWC.2024.3408420 ↗
12. Deep joint source-channel coding for semantic communications10.1109/MCOM.004.2200819 ↗
13. Liang, C., Deng, X., Sun, Y., Cheng, R., Xia, L., Niyato, D., and Imran, M.A. (June, January 28). VISTA: Video transmission over a semantic communication approach. Proceedings of the IEEE International Conference on Communications, Rome, Italy.
14. Task-oriented multi-user semantic communications10.1109/JSAC.2022.3191326 ↗
15. Semantic communication with memory10.1109/JSAC.2023.3288236 ↗
16. Qin, Z., Tao, X., Lu, J., Tong, W., and Li, G.Y. (2021). Semantic communications: Principles and challenges. arXiv.
17. A survey on goal-oriented semantic communication: Techniques, challenges, and future directions10.1109/ACCESS.2024.3381967 ↗
18. Deep learning-constructed joint transmission-recognition for Internet of Things10.1109/ACCESS.2019.2920929 ↗
19. Adaptable semantic compression and resource allocation for task-oriented communications10.1109/TCCN.2023.3346481 ↗
20. Wireless image retrieval at the edge10.1109/JSAC.2020.3036955 ↗
21. Federated semantic learning driven by information bottleneck for task-oriented communications10.1109/LCOMM.2023.3307096 ↗
22. Bao, J., Basu, P., Dean, M., Partridge, C., Swami, A., Leland, W., and Hendler, J.A. (2011, January 15–17). Towards a theory of semantic communication. Proceedings of the 2011 IEEE Network Science Workshop, IEEE, West Point, NY, USA.10.1109/NSW.2011.6004632 ↗
23. Beyond transmitting bits: Context, semantics, and task-oriented communications
24. Semantics-empowered communication for networked intelligent systems10.1109/MCOM.001.2000604 ↗
25. Explainable semantic communication for text tasks10.1109/JIOT.2024.3450902 ↗
26. Task-oriented explainable semantic communications10.1109/TWC.2023.3269444 ↗
27. Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., and Abbeel, P. (2016, January 5–10). InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets. Proceedings of the Advances in NeurIPS, Barcelona, Spain.
28. Alemi, A.A., Fischer, I., Dillon, J.V., and Murphy, K. (2017, January 24–26). Deep variational information bottleneck. Proceedings of the the 5th ICLR, Toulon, France.
29. Han, T.S. (2003). Information-Spectrum Methods in Information Theory, Springer. Stochastic Modelling and Applied Probability.10.1007/978-3-662-12066-8 ↗
30. Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, Wiley. [2nd ed.].10.1002/047174882X ↗
31. Bottlenecks CLUB: Unifying information-theoretic trade-offs among complexity, leakage, and utility10.1109/TIFS.2023.3262112 ↗
32. Nowozin, S., Cseke, B., and Tomioka, R. (2016, January 5–11). f-GAN: Training generative neural samplers using variational divergence minimization. Proceedings of the Advances in NeurIPS, Barcelona, Spain.
33. Estimating divergence functionals and the likelihood ratio by convex risk minimization10.1109/TIT.2010.2068870 ↗
34. Birrell, J., Dupuis, P., Katsoulakis, M., Pantazis, Y., and Rey-Bellet, L. (2023, January 1–5). Function-space regularized Rényi divergences. Proceedings of the ICLR 2023 Conference, Kigali, Rwanda.
35. Liu, Z., Luo, P., Wang, X., and Tang, X. (2015, January 11–18). Deep learning face attributes in the wild. Proceedings of the International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.425 ↗
36. Krizhevsky, A. (2009). Learning Multiple Layers of Features from Tiny Images, University of Toronto. Technical Report.