基于NSST域像素相关分析的医学图像融合

肖明尧, 李雄飞, 朱芮

PDF(1648 KB)
PDF(1648 KB)
吉林大学学报(工学版) ›› 2023, Vol. 53 ›› Issue (09) : 2640-2648. DOI: 10.13229/j.cnki.jdxbgxb.20200365
计算机科学与技术

基于NSST域像素相关分析的医学图像融合

作者信息 +

Medical image fusion based on pixel correlation analysis in NSST domain

Author information +
History +

摘要

针对像素级多模态医学图像融合信息丢失的问题,提出了一种基于非下采样剪切波变换(NSST)的像素相关性分析(PCAS)的图像融合方法。首先,对源图像进行NSST分解,获得高低频子带。然后,利用提出的中心像素方差计算邻域像素与中心像素的强度相关因子,构建邻域像素相关系数矩阵,并提出将相关性拉普拉斯能量和作为高频方向子带的融合规则。再次,计算低频子带中心像素能量以及邻域像素能量梯度信息,得到低频融合决策图。最后,通过逆变换得到融合结果图像。磁共振图像(MRI)和计算机断层扫描(CT)、单光子发射计算机断层成像(PET)、正电子发射断层成像(SPECT)的脑部图像融合实验结果表明,本文融合方法可以很好地保留源图像的显著信息和纹理细节。

Abstract

To solve the problem of information loss in pixel-level multimodal medical image fusion, an image fusion method using pixel correlation analysis (PCA) in Non-subsampled Shearlet Transform (NSST) domain is proposed. First, NSST decomposition is performed on the source images to obtain high and low frequency sub-bands. The intensity correlation factor between neighborhood pixels and central pixel is calculated using the proposed center pixel variance, and the correlation coefficient matrix of neighborhood pixels is constructed. The proposed correlation-sum of modified laplacian (C-SML) is used as the fusion rule for high-frequency sub-bands. The energy of the central pixel and the energy gradient information of the neighboring pixels of the low-frequency sub-bands are calculated to obtain the fusion decision map for low-frequency sub-bands. Finally, the fused image is obtained by inverse NSST. The experimental results about magnetic resonance imaging (MRI) and computed tomography (CT), positron emission tomography (PET), single-photon emission computed tomography (SPECT) brain images indicate that the proposed fusion method can well retain the significant information and texture details of the source images.

关键词

计算机应用 / 图像处理 / 图像融合 / 非下采样剪切波变换 / 像素相关性

Key words

computer application / image processing / image fusion / non-subsampled shearlet transform(NSST) / pixel correlation

中图分类号

TP391

引用本文

导出引用
肖明尧 , 李雄飞 , 朱芮. 基于NSST域像素相关分析的医学图像融合. 吉林大学学报(工学版). 2023, 53(09): 2640-2648 https://doi.org/10.13229/j.cnki.jdxbgxb.20200365
XIAO Ming-yao, LI Xiong-fei, ZHU Rui. Medical image fusion based on pixel correlation analysis in NSST domain[J]. Journal of Jilin University(Engineering and Technology Edition). 2023, 53(09): 2640-2648 https://doi.org/10.13229/j.cnki.jdxbgxb.20200365

参考文献

1
Yang Y. Multimodal medical image fusion through a new DWT based technique[C]//2010 4th International Conference on Bioinformatics and Biomedical Engineering, Chengdu, China, 2010: 1-4.
2
Srivastava R, Prakash O, Khare A. Local energy-based multimodal medical image fusion in curvelet domain[J]. IET Comput Vision, 2016, 10(6): 513-527.
3
Koley S, Galande A, Kelkar B, et al. Multispectral MRI image fusion for enhanced visualization of meningioma brain tumors and edema using contourlet transform and fuzzy statistics[J]. Journal of Medical and Biological Engineering, 2016, 36(4): 470-484.
4
Easley G, Labate D, Lim W Q. Sparse directional image representations using the discrete shearlet transform[J]. Applied and Computational Harmonic Analysis, 2008, 25(1): 25-46.
5
高印寒, 陈广秋, 刘妍妍. 基于图像质量评价参数的非下采样剪切波域自适应图像融合[J]. 吉林大学学报:工学版, 2014, 44(1): 225-234.
Gao Yin-han, Chen Guang-qiu, Liu Yan-yan. Adaptive image fusion based on image quality assessment parameter in NSST system[J]. Journal of Jilin University(Engineering and Technology Edition), 2014, 44(1): 225-234.
6
Vishwakarma A, Bhuyan M K. Image fusion using adjustable non-subsampled shearlet transform[J]. IEEE Transactions on Instrumentation and Measurement, 2018, 68(9): 3367-3378.
7
Zhu Y L, Zhou X Y, Li X W, et al. Algorithm of medical image fusion based on Laplasse pyramid and PCA[C]//IOP Conference Series: Materials Science and Engineering, Shanghai, China, 2019: 490(4): No.042030.
8
Devi M S, Balamurugan P. Local energy match based non-sub sampled contourlet Transform for multi modal medical image fusion[J]. International Journal of Engineering and Technology, 2018, 7(2): 165-169.
9
刘哲, 徐涛, 宋余庆,等. 基于NSCT变换和相似信息鲁棒主成分分析模型的图像融合技术[J]. 吉林大学学报:工学版, 2018,48(5): 1614-1620.
Liu Zhe, Xu Tao, Song Yu-qing, et al. Image fusion technology based on NSCT transform and robust principal component analysis model of similarity information[J]. Journal of Jilin University (Engineering and Technology Edition), 2018,48(5):1614-1620.
10
Yin Ming, Liu Xiao-ning, Liu Yu, et al. Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain[J]. IEEE Transactions on Instrumentation and Measurement, 2018, 68(1): 49-64.
11
Kumar B K S. Image fusion based on pixel significance using cross bilateral filter[J]. Signal, Image and Video Processing, 2015, 9(5): 1193-1204.
12
Liu Y, Chen X, Ward R K, et al. Medical image fusion via convolutional sparsity based morphological component analysis[J]. IEEE Signal Processing Letters, 2019, 26(3): 485-489.
13
Nencini F, Garzelli A, Baronti S, et al. Remote sensing image fusion using the curvelet transform[J]. Information Fusion, 2007, 8(2): 143-156.
14
Li S, Kang X, Hu J. Image fusion with guided filtering[J]. IEEE Transactions on Image Processing, 2013, 22(7): 2864-2875.
15
Liu Yu, Liu Shu-ping, Wang Zeng-fu. A general framework for image fusion based on multi-scale transform and sparse representation[J]. Information Fusion, 2015, 24: 147-164.
16
Zhu Zhi-qin, Zheng Ming-yao, Qi Guan-qiu, et al. A phase congruency and local Laplacian energy based multi-modality medical image fusion method in NSCT domain[J]. IEEE Access, 2019, 7: 20811-20824.

基金

国家自然科学基金项目(61801190)
吉林省自然科学基金项目(20180101055JC)
国家博士后科研基金项目(2017M611323)
吉林省教育厅科学研究项目(JJKH20230920KJ)

评论

PDF(1648 KB)

Accesses

Citation

Detail

段落导航
相关文章

/