journal article·2024Open access

Multimodality Medical Image Fusion Based on Pixel Significance with Edge-Preserving Processing for Clinical Applications

Bhawna Goyal, Ayush Dogra, Dawa Chyophel Lepcha, Rajesh Singh, Hemant Sharma, Ahmed Alkhayyat, Manob Jyoti Saikia

Computers, Materials & Continua· Volume 78· Issue 3

Abstract

Multimodal medical image fusion has attained immense popularity in recent years due to its robust technology for clinical diagnosis. It fuses multiple images into a single image to improve the quality of images by retaining significant information and aiding diagnostic practitioners in diagnosing and treating many diseases. However, recent image fusion techniques have encountered several challenges, including fusion artifacts, algorithm complexity, and high computing costs. To solve these problems, this study presents a novel medical image fusion strategy by combining the benefits of pixel significance with edge-preserving processing to achieve the best fusion performance. First, the method employs a cross-bilateral filter (CBF) that utilizes one image to determine the kernel and the other for filtering, and vice versa, by considering both geometric closeness and the gray-level similarities of neighboring pixels of the images without smoothing edges. The outputs of CBF are then subtracted from the original images to obtain detailed images. It further proposes to use edge-preserving processing that combines linear lowpass filtering with a non-linear technique that enables the selection of relevant regions in detailed images while maintaining structural properties. These regions are selected using morphologically processed linear filter residuals to identify the significant regions with high-amplitude edges and adequate size. The outputs of low-pass filtering are fused with meaningfully restored regions to reconstruct the original shape of the edges. In addition, weight computations are performed using these reconstructed images, and these weights are then fused with the original input images to produce a final fusion result by estimating the strength of horizontal and vertical details. Numerous standard quality evaluation metrics with complementary properties are used for comparison with existing, well-known algorithms objectively to validate the fusion results. Experimental results from the proposed research article exhibit superior performance compared to other competing techniques in the case of both qualitative and quantitative evaluation. In addition, the proposed method advocates less computational complexity and execution time while improving diagnostic computing accuracy. Nevertheless, due to the lower complexity of the fusion algorithm, the efficiency of fusion methods is high in practical applications. The results reveal that the proposed method exceeds the latest state-of-the-art methods in terms of providing detailed information, edge contour, and overall contrast.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Image Fusion Techniques · Infrared Target Detection Methodologies · Optical Systems and Laser Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (60)

Show source-provided references
1. Current advances and future perspectives of image fusion: A comprehensive review10.1016/j.inffus.2022.09.019 ↗
2. Recent advancements in multimodal medical image fusion techniques for better diagnosis: An overview
3. Recent trends in computer assisted diagnosis (CAD) system for breast cancer diagnosis using histopathological images10.1016/j.irbm.2019.06.001 ↗
4. Multiobjective genetic algorithm and convolutional neural network based COVID-19 identification in chest X-ray images10.1155/2021/7804540 ↗
5. Multimodal medical image fusion based on pixel significance using anisotropic diffusion and cross bilateral filter
6. Medical image fusion based on anisotropic diffusion and non-subsampled contourlet transform
7. Image fusion algorithm at pixel level based on edge detection
8. Multi-modality image fusion for medical assistive technology management based on hybrid domain filtering10.1016/j.eswa.2022.118283 ↗
9. Infrared and visible image fusion based on target-enhanced multiscale transform decomposition10.1016/j.ins.2019.08.066 ↗
10. A phase congruency and local laplacian energy based multi-modality medical image fusion method in NSCT domain10.1109/ACCESS.2019.2898111 ↗
11. Multi-modal medical image fusion based on two-scale image decomposition and sparse representation10.1016/j.bspc.2019.101810 ↗
12. A survey on the new generation of deep learning in image processing10.1109/ACCESS.2019.2956508 ↗
13. A gentle introduction to deep learning in medical image processing10.1016/j.zemedi.2018.12.003 ↗
14. Multimodal medical image fusion based on average cross bilateral filtering
15. Medical image fusion based on quasi-cross bilateral filtering10.1016/j.bspc.2022.104259 ↗
16. Generative adversarial nets
17. Generative adversarial networks in medical image augmentation: A review10.1016/j.compbiomed.2022.105382 ↗
18. A state-of-the-art review on image synthesis with generative adversarial networks10.1109/ACCESS.2020.2982224 ↗
19. Transformers in medical image analysis10.1016/j.imed.2022.07.002 ↗
20. SimViT: Exploring a simple vision transformer with sliding windows
21. Transformer-based end-to-end anatomical and functional image fusion
22. An end-to-end medical image fusion network based on Swin-transformer10.1016/j.micpro.2023.104781 ↗
23. DFENet: A dual-branch feature enhanced network integrating transformers and convolutional feature learning for multimodal medical image fusion10.1016/j.bspc.2022.104402 ↗
24. Image fusion techniques: A survey10.1007/s11831-021-09540-7 ↗
25. Survey study of multimodality medical image fusion methods10.1007/s11042-020-08834-5 ↗
26. Hyperspectral and multispectral image fusion using optimized twin dictionaries10.1109/TIP.2020.2968773 ↗
27. An infrared and visible image fusion method based on multi-scale transformation and norm optimization10.1016/j.inffus.2021.02.008 ↗
28. An image quality enhancement scheme employing adolescent identity search algorithm in the NSST domain for multimodal medical image fusion10.1016/j.bspc.2021.102480 ↗
29. Medical image fusion via convolutional sparsity based morphological component analysis10.1109/LSP.2019.2895749 ↗
30. A novel method of multimodal medical image fusion based on hybrid approach of NSCT and DTCWT10.3991/ijoe.v18i03.28011 ↗
31. Multifocus image fusion using multiscale transform and convolutional sparse representation10.1142/S0219691320500617 ↗
32. Image fusion based on cross bilateral and rolling guidance filter through weight normalization10.2174/1874440002013010051 ↗
33. Osseous and digital subtraction angiography image fusion via various enhancement schemes and Laplacian pyramid transformations10.1016/j.future.2017.12.052 ↗
34. Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering10.1016/j.measurement.2021.109663 ↗
35. Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain10.1109/TIM.2018.2838778 ↗
36. A novel image fusion framework based on sparse representation and pulse coupled neural network10.1109/ACCESS.2019.2929303 ↗
37. Medical image fusion based on sparse representation and PCNN in NSCT domain10.1155/2018/2806047 ↗
38. Joint medical image fusion, denoising and enhancement via discriminative low-rank sparse dictionaries learning10.1016/j.patcog.2018.02.005 ↗
39. A novel multi-modality image fusion method based on image decomposition and sparse representation10.1016/j.ins.2017.09.010 ↗
40. Medical image fusion method by deep learning
41. Multi-modality medical image fusion technique using multi-objective differential evolution based deep neural networks10.1007/s12652-020-02386-0 ↗
42. A novel improved deep convolutional neural network model for medical image fusion10.1007/s10586-018-2026-1 ↗
43. Multi-modal medical image fusion based on geometric algebra discrete cosine transform10.1007/s00006-021-01197-6 ↗
44. Multimodal medical image fusion based on joint bilateral filter and local gradient energy10.1016/j.ins.2021.04.052 ↗
45. Improving medical image fusion method using fuzzy entropy and nonsubsampling contourlet transform10.1002/ima.22476 ↗
46. Medical image fusion based on convolutional neural networks and non-subsampled contourlet transform10.1016/j.eswa.2021.114574 ↗
47. LatLRR-FCNs: Latent low-rank representation with fully convolutional networks for medical image fusion10.3389/fnins.2020.615435 ↗
48. Multimodal medical image fusion based on the spectral total variation and local structural patch measurement10.1002/ima.22460 ↗
49. Image fusion based on pixel significance using cross bilateral filter10.1007/s11760-013-0556-9 ↗
50. Bilateral filtering for gray and color images
51. Multiresolution bilateral filtering for image denoising10.1109/TIP.2008.2006658 ↗
52. Digital photography with flash and no-flash image pairs10.1145/1015706.1015777 ↗
53. Iwanowski · ICCVG 2020: Computer Vision and Graphics · 2020 · 59
54. Morphological image analysis
55. An efficient adaptive fusion scheme for multifocus images in wavelet domain using statistical properties of neighborhood
56. Robust estimation and outlier detection with correlation coefficients10.1093/biomet/62.3.531 ↗
57. FDGNet: A pair feature difference guided network for multimodal medical image fusion10.1016/j.bspc.2022.104545 ↗
58. An improved approach for medical image fusion using sparse representation and Siamese convolutional neural network10.1016/j.bspc.2021.103357 ↗
59. Objective image fusion performance measure10.1049/el:20000267 ↗
60. The whole brain atlas10.1097/NPT.0b013e3182563795 ↗