MNTSCC: A VMamba-Based Nonlinear Joint Source-Channel Coding for Semantic Communications
Source abstract
Abstract
Deep learning-based semantic communication has achieved remarkable progress with CNNs and Transformers. However, CNNs exhibit constrained performance in high-resolution image transmission, while Transformers incur high computational cost due to quadratic complexity. Recently, VMamba, a novel state space model with linear complexity and exceptional long-range dependency modeling capabilities, has shown great potential in computer vision tasks. Inspired by this, we propose MNTSCC, an efficient VMamba-based nonlinear joint source-channel coding (JSCC) model for wireless image transmission. Specifically, MNTSCC comprises a VMamba-based nonlinear transform module, an MCAM entropy model, and a JSCC module. In the encoding stage, the input image is first encoded into a latent representation via the nonlinear transformation module, which is then processed by the MCAM for source distribution modeling. The JSCC module then optimizes transmission efficiency by adaptively assigning transmission rate to the latent representation according to the estimated entropy values. The proposed MCAM enhances the channel-wise autoregressive entropy model with attention mechanisms, which enables the entropy model to effectively capture both global and local information within latent features, thereby enabling more accurate entropy estimation and improved rate-distortion performance. Additionally, to further enhance the robustness of the system under varying signal-to-noise ratio (SNR) conditions, we incorporate SNR adaptive net (SAnet) into the JSCC module, which dynamically adjusts the encoding strategy by integrating SNR information with latent features, thereby improving SNR adaptability. Experimental results across diverse resolution datasets demonstrate that the proposed method achieves superior image transmission performance compared to existing CNN- and Transformer-based semantic communication models, while maintaining competitive computational efficiency. In particular, under an Additive White Gaussian Noise (AWGN) channel with SNR = 10 dB and a channel bandwidth ratio (CBR) of 1/16, MNTSCC consistently outperforms NTSCC, achieving a 1.72 dB Peak Signal-to-Noise Ratio (PSNR) gain on the Kodak24 dataset, 0.79 dB on CLIC2022, and 2.54 dB on CIFAR-10, while reducing computational cost by 32.23%. The code is available at (accessed on 09 July 2025).
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Data Compression Techniques · Error Correcting Code Techniques · Advanced Wireless Communication Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (41)
Show source-provided references
1. Internet of things: a survey on enabling technologies, protocols, and applications10.1109/COMST.2015.2444095 ↗
2. Semantic communication empowered NTN for IoT: benefits and challenges10.1109/MNET.2024.3383604 ↗
3. A mathematical theory of communication10.1002/j.1538-7305.1948.tb01338.x ↗
4. Joint source and channel coding
5. Deep joint source-channel coding for wireless image transmission10.1109/TCCN.2019.2919300 ↗
6. Suppressing the cliff effect in video reproduction quality10.1002/bltj.20540 ↗
7. SwinJSCC: taming swin transformer for deep joint source-channel coding10.1109/TCCN.2024.3424842 ↗
8. An image is worth 16x16 words: transformers for image recognition at scale
9. Attention is all you need
10. A survey of transformers10.1016/j.aiopen.2022.10.001 ↗
11. Swin Transformer: hierarchical vision transformer using shifted windows
12. Swin Transformer V2: scaling up capacity and resolution
13. VMamba: visual state space model
14. Wu T, Chen Z, Tao M, Sun Y, Xu X, Zhang W, et al. MambaJSCC: adaptive deep joint source-channel coding with generalized state space model. arXiv:2409.16592. 2024.10.1109/GLOBECOM52923.2024.10901192 ↗
15. Gu A, Dao T. Mamba: linear-time sequence modeling with selective state spaces. arXiv:2312.00752. 2023.
16. Channel-wise autoregressive entropy models for learned image compression
17. Adaptive resource allocation for semantic communication networks10.1109/TCOMM.2024.3405355 ↗
18. WITT: a wireless image transmission transformer for semantic communications
19. Nonlinear transform source-channel coding for semantic communications10.1109/JSAC.2022.3180802 ↗
20. Variational image compression with a scale hyperprior
21. Efficient Contextformer: spatio-channel window attention for fast context modeling in learned image compression10.1109/TCSVT.2024.3371686 ↗
22. MLIC: multi-reference entropy model for learned image compression
23. End-to-end learnt image compression via non-local attention optimization and improved context modeling10.1109/TIP.2021.3058615 ↗
24. Combining recurrent, convolutional, and continuous-time models with linear state-space layers
25. HiPPO: recurrent memory with optimal polynomial projections
26. Somvanshi S, Islam MM, Mimi MS, Polock SB, Chhetri G, Das S. A survey on structured state space sequence (S4) models. arXiv:2503.18970. 2025.
27. Patro BN, Agneeswaran VS. Mamba-360: survey of state space models as transformer alternative for long sequence modelling: methods, applications, and challenges. arXiv:2404.16112. 2024.10.2139/ssrn.4930035 ↗
28. Vision Mamba: efficient visual representation learning with bidirectional state space model
29. Ruan J, Li J, Xiang S. VM-UNet: vision Mamba UNet for medical image segmentation. arXiv:2402.02491. 2024.10.1145/3767748 ↗
30. Mamba-YOLO-World: marrying YOLO-world with Mamba for open-vocabulary detection
31. YOLO-World: real-time open-vocabulary object detection
32. Efficiently modeling long sequences with structured state spaces
33. Factorized dynamic fully-connected layers for neural networks
34. Dynamic neural networks: a survey10.1109/TPAMI.2021.3117837 ↗
35. An improved gravitational search algorithm for dynamic neural network identification10.1007/s11633-014-0810-9 ↗
36. A comparison of SNR estimation techniques for the AWGN channel10.1109/26.871393 ↗
37. Mean squared error: love it or leave it? A new look at signal fidelity measures10.1109/MSP.2008.930649 ↗
38. Image quality metrics: PSNR vs. SSIM
39. Multiscale structural similarity for image quality assessment
40. MambaTree: tree topology is all you need in state space model
41. EfficientVMamba: atrous selective scan for light weight visual Mamba