Medical Image Compression Method Using Lightweight Multi-Layer Perceptron for Mobile Healthcare Applications
Source abstract
Abstract
As video compression is one of the core technologies required to enable seamless medical data streaming in mobile healthcare applications, there is a need to develop powerful media codecs that can achieve minimum bitrates while maintaining high perceptual quality. Versatile Video Coding (VVC) is the latest video coding standard that can provide powerful coding performance with a similar visual quality compared to the previously developed method that is High Efficiency Video Coding (HEVC). In order to achieve this improved coding performance, VVC adopted various advanced coding tools, such as flexible Multi-type Tree (MTT) block structure which uses Binary Tree (BT) split and Ternary Tree (TT) split. However, VVC encoder requires heavy computational complexity due to the excessive Rate-distortion Optimization (RDO) processes used to determine the optimal MTT block mode. In this paper, we propose a fast MTT decision method with two Lightweight Neural Networks (LNNs) using Multi-layer Perceptron (MLP), which are applied to determine the early termination of the TT split within the encoding process. Experimental results show that the proposed method significantly reduced the encoding complexity up to 26% with unnoticeable coding loss compared to the VVC Test Model (VTM).
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Video Coding and Compression Technologies · Advanced Data Compression Techniques · Image and Video Quality Assessment
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (40)
Show source-provided references
1. A robust quasi-quantum walks-based steganography protocol for secure transmission of images on cloud-based E-healthcare platforms
2. Versatile video coding (Draft 10)
3. Overview of high efficiency video coding standard10.1109/TCSVT.2012.2221191 ↗
4. Fraunhofer Heinrich Hertz Institute, Joint Video Experts Team (JVET), “JVET, test model 10 of versatile video coding (VTM 10),” 2020. [Online]. Available: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM.
5. VTM common test conditions and software reference configurations for SDR video
6. CE3: Simplified PDPC (Test 2.4.1)
7. CE3: Tests of cross-component linear model in BMS1.0 (Test 4.1.8, 4.1.9, 4.1.10, 4.1.11)
8. CE3-related: Wide-angle intra prediction for non-square blocks
9. CE3: Affine linear weighted intra prediction
10. JVET AHG report: Test model software development (AHG3)
11. Implementation of fast HEVC encoder based on SIMD and data-level parallelism
12. JVET AHG report: Tool reporting procedure (AHG13)
13. Fast CU size decision and mode decision algorithm for HEVC intra coding10.1109/TCE.2013.6490261 ↗
14. A design of fast high efficiency video coding scheme based on markov chain monte carlo model and Bayesian classifier10.1109/TIE.2018.2815941 ↗
15. A fast CU size decision algorithm for the HEVC intra encoder10.1109/TCSVT.2014.2363739 ↗
16. AHG5: Enhanced fast algorithm of JVET-e0078
17. Low complexity CTU partition structure decision and fast intra mode decision for versatile video coding10.1109/TCSVT.2019.2904198 ↗
18. Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding10.1109/TCSVT.2013.2249017 ↗
19. Effective CU size decision for HEVC intra-coding10.1109/TIP.2014.2341927 ↗
20. An effective CU size decision method for HEVC encoders10.1109/TMM.2012.2231060 ↗
21. A fast coding unit mode decision method based on mode inheritance of upper coding unit for low-complexity compression of smart contents10.1016/j.displa.2018.10.006 ↗
22. Context-based ternary tree decision method in versatile video coding for fast intra coding10.1109/ACCESS.2019.2956196 ↗
23. Fast partitioning decision scheme for versatile video coding intra-frame prediction
24. Fast CU partitioning algorithm for H.266/VVC intra-frame coding
25. Look-ahead prediction based coding unit size pruning for VVC intra coding
26. SVM based fast CU partitioning algorithm for VVC intra coding
27. A fast QTMT partition decision strategy for VVC intra prediction10.1109/ACCESS.2020.3000565 ↗
28. Reducing complexity of HEVC: A deep learning approach10.1109/TIP.2018.2847035 ↗
29. Fast CU depth decision for HEVC using neural networks10.1109/TCSVT.2018.2839113 ↗
30. CNN-Based driving of block partitioning for intra slices encoding
31. Fast QTBT partitioning decision for interframe coding with convolution neural network
32. Fast QTBT partition algorithm for intra frame coding through convolutional neural network10.1109/ACCESS.2018.2872492 ↗
33. DeepQTMT: A deep learning approach for fast QTMT-based CU partition of intra-mode VVC
34. Convolutional neural network based fast intra mode prediction for H.266/FVC video coding
35. Adaptive CU split decision based on deep learning and multifeatured fusion for H.266/VVC
36. Ctunet: A deep learning-based framework for fast CTU partitioning of H265/HEVC intra-coding10.1016/j.asej.2021.01.001 ↗
37. An overview of gradient descent optimization algorithms
38. Understanding the difficulty of training deep feedforward neural networks
39. Calculation of average PSNR differences between RD curves
40. Bernal · Computerized Medical Imaging and Graphics · 2015 · 43 · 9910.1016/j.compmedimag.2015.02.007 ↗