Medical image fusion based on pixel correlation analysis in NSST domain

XIAO Ming-yao, LI Xiong-fei, ZHU Rui

PDF(1648 KB)
PDF(1648 KB)
J Jilin Univ Eng Tech Ed ›› 2023, Vol. 53 ›› Issue (09) : 2640-2648. DOI: 10.13229/j.cnki.jdxbgxb.20200365

Medical image fusion based on pixel correlation analysis in NSST domain

Author information +
History +

Abstract

To solve the problem of information loss in pixel-level multimodal medical image fusion, an image fusion method using pixel correlation analysis (PCA) in Non-subsampled Shearlet Transform (NSST) domain is proposed. First, NSST decomposition is performed on the source images to obtain high and low frequency sub-bands. The intensity correlation factor between neighborhood pixels and central pixel is calculated using the proposed center pixel variance, and the correlation coefficient matrix of neighborhood pixels is constructed. The proposed correlation-sum of modified laplacian (C-SML) is used as the fusion rule for high-frequency sub-bands. The energy of the central pixel and the energy gradient information of the neighboring pixels of the low-frequency sub-bands are calculated to obtain the fusion decision map for low-frequency sub-bands. Finally, the fused image is obtained by inverse NSST. The experimental results about magnetic resonance imaging (MRI) and computed tomography (CT), positron emission tomography (PET), single-photon emission computed tomography (SPECT) brain images indicate that the proposed fusion method can well retain the significant information and texture details of the source images.

Key words

computer application / image processing / image fusion / non-subsampled shearlet transform(NSST) / pixel correlation

Cite this article

Download Citations
XIAO Ming-yao , LI Xiong-fei , ZHU Rui. Medical image fusion based on pixel correlation analysis in NSST domain. Journal of Jilin University(Engineering and Technology Edition). 2023, 53(09): 2640-2648 https://doi.org/10.13229/j.cnki.jdxbgxb.20200365

References

1
Yang Y. Multimodal medical image fusion through a new DWT based technique[C]//2010 4th International Conference on Bioinformatics and Biomedical Engineering, Chengdu, China, 2010: 1-4.
2
Srivastava R, Prakash O, Khare A. Local energy-based multimodal medical image fusion in curvelet domain[J]. IET Comput Vision, 2016, 10(6): 513-527.
3
Koley S, Galande A, Kelkar B, et al. Multispectral MRI image fusion for enhanced visualization of meningioma brain tumors and edema using contourlet transform and fuzzy statistics[J]. Journal of Medical and Biological Engineering, 2016, 36(4): 470-484.
4
Easley G, Labate D, Lim W Q. Sparse directional image representations using the discrete shearlet transform[J]. Applied and Computational Harmonic Analysis, 2008, 25(1): 25-46.
5
高印寒, 陈广秋, 刘妍妍. 基于图像质量评价参数的非下采样剪切波域自适应图像融合[J]. 吉林大学学报:工学版, 2014, 44(1): 225-234.
Gao Yin-han, Chen Guang-qiu, Liu Yan-yan. Adaptive image fusion based on image quality assessment parameter in NSST system[J]. Journal of Jilin University(Engineering and Technology Edition), 2014, 44(1): 225-234.
6
Vishwakarma A, Bhuyan M K. Image fusion using adjustable non-subsampled shearlet transform[J]. IEEE Transactions on Instrumentation and Measurement, 2018, 68(9): 3367-3378.
7
Zhu Y L, Zhou X Y, Li X W, et al. Algorithm of medical image fusion based on Laplasse pyramid and PCA[C]//IOP Conference Series: Materials Science and Engineering, Shanghai, China, 2019: 490(4): No.042030.
8
Devi M S, Balamurugan P. Local energy match based non-sub sampled contourlet Transform for multi modal medical image fusion[J]. International Journal of Engineering and Technology, 2018, 7(2): 165-169.
9
刘哲, 徐涛, 宋余庆,等. 基于NSCT变换和相似信息鲁棒主成分分析模型的图像融合技术[J]. 吉林大学学报:工学版, 2018,48(5): 1614-1620.
Liu Zhe, Xu Tao, Song Yu-qing, et al. Image fusion technology based on NSCT transform and robust principal component analysis model of similarity information[J]. Journal of Jilin University (Engineering and Technology Edition), 2018,48(5):1614-1620.
10
Yin Ming, Liu Xiao-ning, Liu Yu, et al. Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain[J]. IEEE Transactions on Instrumentation and Measurement, 2018, 68(1): 49-64.
11
Kumar B K S. Image fusion based on pixel significance using cross bilateral filter[J]. Signal, Image and Video Processing, 2015, 9(5): 1193-1204.
12
Liu Y, Chen X, Ward R K, et al. Medical image fusion via convolutional sparsity based morphological component analysis[J]. IEEE Signal Processing Letters, 2019, 26(3): 485-489.
13
Nencini F, Garzelli A, Baronti S, et al. Remote sensing image fusion using the curvelet transform[J]. Information Fusion, 2007, 8(2): 143-156.
14
Li S, Kang X, Hu J. Image fusion with guided filtering[J]. IEEE Transactions on Image Processing, 2013, 22(7): 2864-2875.
15
Liu Yu, Liu Shu-ping, Wang Zeng-fu. A general framework for image fusion based on multi-scale transform and sparse representation[J]. Information Fusion, 2015, 24: 147-164.
16
Zhu Zhi-qin, Zheng Ming-yao, Qi Guan-qiu, et al. A phase congruency and local Laplacian energy based multi-modality medical image fusion method in NSCT domain[J]. IEEE Access, 2019, 7: 20811-20824.

Comments

PDF(1648 KB)

Accesses

Citation

Detail

Sections
Recommended

/