journal article·2021Open access

Multimodal Medical Image Registration and Fusion for Quality Enhancement

Muhammad Adeel Azam, Khan Bahadar Khan, Muhammad Ahmad, Manuel Mazzara

Computers, Materials & Continua· Volume 68· Issue 1

Abstract

For the last two decades, physicians and clinical experts have used a single imaging modality to identify the normal and abnormal structure of the human body. However, most of the time, medical experts are unable to accurately analyze and examine the information from a single imaging modality due to the limited information. To overcome this problem, a multimodal approach is adopted to increase the qualitative and quantitative medical information which helps the doctors to easily diagnose diseases in their early stages. In the proposed method, a Multi-resolution Rigid Registration (MRR) technique is used for multimodal image registration while Discrete Wavelet Transform (DWT) along with Principal Component Averaging (PCAv) is utilized for image fusion. The proposed MRR method provides more accurate results as compared with Single Rigid Registration (SRR), while the proposed DWT-PCAv fusion process adds-on more constructive information with less computational time. The proposed method is tested on CT and MRI brain imaging modalities of the HARVARD dataset. The fusion results of the proposed method are compared with the existing fusion techniques. The quality assessment metrics such as Mutual Information (MI), Normalize Cross-correlation (NCC) and Feature Mutual Information (FMI) are computed for statistical comparison of the proposed method. The proposed methodology provides more accurate results, better image quality and valuable information for medical diagnoses.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Image Fusion Techniques · Brain Tumor Detection and Classification · Image and Signal Denoising Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (40)

Show source-provided references
1. Medical image fusion: A survey of the state of the art10.1016/j.inffus.2013.12.002 ↗
2. Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform10.1016/j.neucom.2008.02.025 ↗
3. Multimodal medical image fusion using redundant discrete wavelet transform
4. Recognition of Alzheimer’s disease and mild cognitive impairment with multimodal image-derived biomarkers and multiple kernel learning10.1016/j.neucom.2016.08.041 ↗
5. Multimodality image fusion for coronary artery disease detection10.17996/anc.18-00065 ↗
6. Medical fusion of CLAHE images using SWT and PCA for brain disease analysis
7. Review of multimodality medical image fusion using combined transform techniques for clinical application
8. Medical image fusion by wavelet transform modulus maxima10.1364/OE.9.000184 ↗
9. PubMed, [Online]. Available: https://www.ncbi.nlm.nih.gov/pubmed [Accessed: 10 February 2020].
10. Affine-based registration of CT and MR modality images of human brain using multiresolution approaches: Comparative study on genetic algorithm and particle swarm optimization10.1007/s00521-010-0374-8 ↗
11. Multi-resolution approach for medical image registration using genetic algorithm
12. Medical image interpolation based on multi-resolution registration10.1016/j.camwa.2013.04.026 ↗
13. The image registration techniques for medical imaging (MRI-CT)
14. Multiresolution image registration for multimodal brain images and fusion for better neurosurgical planning10.1016/j.bj.2017.09.002 ↗
15. Multifractals based multimodal 3D image registration10.1016/j.bspc.2018.08.015 ↗
16. Multi-modal medical image registration by local affine transformations
17. A general framework in single and multi-modality registration for lung imaging analysis using statistical prior shapes10.1016/j.cmpb.2019.105232 ↗
18. Directive contrast based multimodal medical image fusion in NSCT domain10.1109/TMM.2013.2244870 ↗
19. Medical image fusion with Laplacian pyramids
20. SWT and PCA image fusion methods for multi-modal imagery10.1007/s11042-018-6229-5 ↗
21. Multimodal medical image fusion based on IHS and PCA10.1016/j.proeng.2010.11.045 ↗
22. PET/CT medical image fusion algorithm based on multiwavelet transform
23. Multimodal medical image fusion using PCNN optimized by the QPSO algorithm10.1016/j.asoc.2016.03.028 ↗
24. Fast curvelet transform through genetic algorithm for multimodal medical image fusion10.1007/s00500-019-04011-5 ↗
25. Multi-modal medical image fusion based on two-scale image decomposition and sparse representation10.1016/j.bspc.2019.101810 ↗
26. Deep learning and medical image processing for coronavirus (COVID-19) pandemic: A survey10.1016/j.scs.2020.102589 ↗
27. A novel PCA-whale optimization-based deep neural network model for classification of tomato plant diseases using GPU
28. Deep neural networks to predict diabetic retinopathy
29. Antlion re-sampling based deep neural network model for classification of imbalanced multimodal stroke dataset
30. A novel method of multimodal medical image fusion using fuzzy transform10.1016/j.jvcir.2016.06.021 ↗
31. Medical image registration using mutual information10.1109/JPROC.2003.817864 ↗
32. An improved multimodal medical image fusion scheme based on hybrid combination of nonsubsampled contourlet transform and stationary wavelet transform10.1002/ima.22310 ↗
33. Quality assessment of image fusion based on image content and structural similarity
34. A non-reference image fusion metric based on mutual information of image features10.1016/j.compeleceng.2011.07.012 ↗
35. Quality evaluation of multiresolution remote sensing images fusion
36. Discrete wavelet transform based principal component averaging fusion for medical images
37. Fusion of MRI and CT images using guided image filter and image statistics10.1002/ima.22228 ↗
38. Fast filtering image fusion10.1117/1.JEI.26.6.063004 ↗
39. A phase congruency and local laplacian energy-based multi-modality medical image fusion method in NSCT domain10.1109/ACCESS.2019.2898111 ↗
40. A fast and compact 3-D CNN for hyperspectral image classification