scholarly journals Multimodal Medical Image Fusion based on Deep Learning Neural Network for Clinical Treatment Analysis

2018 ◽  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Image Fusion ◽  
Medical Image ◽  
Clinical Treatment ◽  
Medical Image Fusion ◽  
Treatment Analysis ◽  
Deep Learning Neural Network

scholarly journals Medical Image Fusion Using Deep Learning Mechanism

2022 ◽  
Vol 10 (1) ◽  
pp. 128-136
Author(s):  
Nukapeyyi Tanuja
Keyword(s):  
Deep Learning ◽  
Image Fusion ◽  
Sparse Representation ◽  
Medical Image ◽  
Medical Image Fusion ◽  
Morphological Component Analysis ◽  
Extension Mechanism ◽  
Morphological Component ◽  
Image Component ◽  
Segmentation Image

Abstract: Sparse representation(SR) model named convolutional sparsity based morphological component analysis is introduced for pixel-level medical image fusion. The CS-MCA model can achieve multicomponent and global SRs of source images, by integrating MCA and convolutional sparse representation(CSR) into a unified optimization framework. In the existing method, the CSRs of its gradient and texture components are obtained by the CSMCA model using pre-learned dictionaries. Then for each image component, sparse coefficients of all the source images are merged and then fused component is reconstructed using the corresponding dictionary. In the extension mechanism, we are using deep learning based pyramid decomposition. Now a days deep learning is a very demanding technology. Deep learning is used for image classification, object detection, image segmentation, image restoration. Keywords: CNN, CT, MRI, MCA, CS-MCA.

scholarly journals Medical Image Fusion Based on Sparse Representation and PCNN in NSCT Domain

2018 ◽  
Vol 2018 ◽  
pp. 1-12 ◽  
Author(s):  
Jingming Xia ◽  
Yiming Chen ◽  
Aiyue Chen ◽  
Yicai Chen
Keyword(s):  
Neural Network ◽  
Image Fusion ◽  
Sparse Representation ◽  
High Frequency ◽  
Medical Image ◽  
Information Transfer ◽  
Color Image ◽  
Low Frequency ◽  
Source Image ◽  
Medical Image Fusion

The clinical assistant diagnosis has a high requirement for the visual effect of medical images. However, the low frequency subband coefficients obtained by the NSCT decomposition are not sparse, which is not conducive to maintaining the details of the source image. To solve these problems, a medical image fusion algorithm combined with sparse representation and pulse coupling neural network is proposed. First, the source image is decomposed into low and high frequency subband coefficients by NSCT transform. Secondly, the K singular value decomposition (K-SVD) method is used to train the low frequency subband coefficients to get the overcomplete dictionary D, and the orthogonal matching pursuit (OMP) algorithm is used to sparse the low frequency subband coefficients to complete the fusion of the low frequency subband sparse coefficients. Then, the pulse coupling neural network (PCNN) is excited by the spatial frequency of the high frequency subband coefficients, and the fusion coefficients of the high frequency subband coefficients are selected according to the number of ignition times. Finally, the fusion medical image is reconstructed by NSCT inverter. The experimental results and analysis show that the algorithm of gray and color image fusion is about 34% and 10% higher than the contrast algorithm in the edge information transfer factor QAB/F index, and the performance of the fusion result is better than the existing algorithm.

Sign in / Sign up

Export Citation Format

Share Document