scholarly journals Fusion of Multispectral and Panchromatic Images via Spatial Weighted Neighbor Embedding

2019 ◽  
Vol 11 (5) ◽  
pp. 557 ◽  
Author(s):  
Kai Zhang ◽  
Feng Zhang ◽  
Shuyuan Yang

Fusing the panchromatic (PAN) image and low spatial-resolution multispectral (LR MS) images is an effective technology for generating high spatial-resolution MS (HR MS) images. Some image-fusion methods inspired by neighbor embedding (NE) are proposed and produce competitive results. These methods generally adopt Euclidean distance to determinate the neighbors. However, closer Euclidean distance is not equal to greater similarity in spatial structure. In this paper, we propose a spatial weighted neighbor embedding (SWNE) approach for PAN and MS image fusion, by exploring the similar manifold structures existing in the observed LR MS images to those of HR MS images. In SWNE, the spatial neighbors of the LR patch are found first. Second, the weights of these neighbors are estimated by the alternative direction multiplier method (ADMM), in which the neighbors and their weights are determined simultaneously. Finally, the HR patches are reconstructed by the sum of HR patches corresponding to the LR patches multiplying with their weights. Due to the introduction of spatial structures in objective function, outlier patches can be eliminated effectively by ADMM. Compared with other methods based on NE, more reasonable neighbor patches and their weights are estimated simultaneously. Some experiments are conducted on datasets collected by QuickBird and Geoeye-1 satellites to validate the effectiveness of SWNE, and the results demonstrate a better performance of SWNE in spatial and spectral information preservation.

2013 ◽  
Vol 760-762 ◽  
pp. 1524-1528 ◽  
Author(s):  
Ya Feng Zhang ◽  
Jian Guo Wen ◽  
Jun Ling Zhu ◽  
Jian Lin Yu

Data fusion technique can produce fused images with high spatial resolution and abundant spectral information. A new image fusion algorithm based on two-dimension PCA and Curvelet transform will be proposed according to image process models specialities in this paper. First of all, we performed 2DPCA on the MS image to get the 1st principle component (PC1); then we applied Curvelet transform in Pan Image and PC1; lastly decomposition coefficients obtained was processed according to certain rules to get fused coefficients, and afterwards, we performed inverse Curvelet transform on them to acquire fused sub-images. Then we performed inverse 2DPCA transform on the other components and the fused sub-images to get fused images. Experiments will be carried out via application of multispectral and panchromatic images, and it turns out that this new algorithm can improve spatial resolution greatly while maintaining spectral information.


2020 ◽  
Vol 12 (6) ◽  
pp. 1009
Author(s):  
Xiaoxiao Feng ◽  
Luxiao He ◽  
Qimin Cheng ◽  
Xiaoyi Long ◽  
Yuxin Yuan

Hyperspectral (HS) images usually have high spectral resolution and low spatial resolution (LSR). However, multispectral (MS) images have high spatial resolution (HSR) and low spectral resolution. HS–MS image fusion technology can combine both advantages, which is beneficial for accurate feature classification. Nevertheless, heterogeneous sensors always have temporal differences between LSR-HS and HSR-MS images in the real cases, which means that the classical fusion methods cannot get effective results. For this problem, we present a fusion method via spectral unmixing and image mask. Considering the difference between the two images, we firstly extracted the endmembers and their corresponding positions from the invariant regions of LSR-HS images. Then we can get the endmembers of HSR-MS images based on the theory that HSR-MS images and LSR-HS images are the spectral and spatial degradation from HSR-HS images, respectively. The fusion image is obtained by two result matrices. Series experimental results on simulated and real datasets substantiated the effectiveness of our method both quantitatively and visually.


2017 ◽  
Vol 35 (1) ◽  
pp. 82-91
Author(s):  
Cesar Edwin García ◽  
David Montero ◽  
Hector Alberto Chica

The main objective of the research carried out in the sugar productive sector in Colombia is to improve crop productivity of sugarcane. The rise of RPAS, together with the use of multispectral cameras, which allows for high spatial resolution images and spectral information outside the visible spectrum, has generated an alternative nondestructive technological approach to monitoring crop sugarcane that must be evaluated and adapted to the specific conditions of Colombia's sugar productive sector. In this context, this paper assesses the potential of a modified camera (NIR) to discriminate three varieties of sugarcane, as well as three doses of fertilization and estimating the sugarcane yield at an early stage, for the three varieties through multiple vegetation indices. In this study, no significant differences were found by vegetation index between fertilization doses, and only significant differences between varieties were found when the fertilization was normal or high. Likewise, multiple regressions between scores derived from vegetation indices after applying PCA and productivity produced determinations of up to 56%.


1987 ◽  
Vol 115 ◽  
pp. 71-74
Author(s):  
H. Zinnecker ◽  
A. Chelli ◽  
C. Perrier

High spatial resolution infrared observations (mostly at L, some at K) of several young stars in the ρ Oph dark cloud were obtained with the specklegraph at the ESO 3.6m telescope in Chile in July 1985. Sources included EL29, EL21, EL14 and EL9 (Elias 1978, Table 2), and were all measured in two orthogonal directions, W-E (PA=90°) and N-S (PA=180°). Here we shall present visibility functions for EL29 and EL21 and indicate the spatial structure and dimension of these objects. We refer to Elias (1978, p.468/69) for earlier studies of EL29 and EL21.


2019 ◽  
Vol 11 (9) ◽  
pp. 1005
Author(s):  
Jiahui Qu ◽  
Yunsong Li ◽  
Qian Du ◽  
Wenqian Dong ◽  
Bobo Xi

Hyperspectral pansharpening is an effective technique to obtain a high spatial resolution hyperspectral (HS) image. In this paper, a new hyperspectral pansharpening algorithm based on homomorphic filtering and weighted tensor matrix (HFWT) is proposed. In the proposed HFWT method, open-closing morphological operation is utilized to remove the noise of the HS image, and homomorphic filtering is introduced to extract the spatial details of each band in the denoised HS image. More importantly, a weighted root mean squared error-based method is proposed to obtain the total spatial information of the HS image, and an optimized weighted tensor matrix based strategy is presented to integrate spatial information of the HS image with spatial information of the panchromatic (PAN) image. With the appropriate integrated spatial details injection, the fused HS image is generated by constructing the suitable gain matrix. Experimental results over both simulated and real datasets demonstrate that the proposed HFWT method effectively generates the fused HS image with high spatial resolution while maintaining the spectral information of the original low spatial resolution HS image.


2018 ◽  
Vol 215 ◽  
pp. 01002
Author(s):  
Yuhendra ◽  
Minarni

Image fusion is a useful tool for integrating low spatial resolution multispectral (MS) images with a high spatial resolution panchromatic (PAN) image, thus producing a high resolution multispectral image for better understanding of the observed earth surface. A main proposed the research were the effectiveness of different image fusion methods while filtering methods added to speckle suppression in synthetic aperture radar (SAR) images. The quality assessment of the filtering fused image implemented by statistical parameter namely mean, standard deviation, bias, universal index quality image (UIQI) and root mean squared error (RMSE). In order to test the robustness of the image quality, either speckle noise (Gamma map filter) is intentionally added to the fused image. When comparing and testing result, Gram Scmidth (GS) methods have shown better results for good colour reproduction, as compared with high pass filtering (HPF). And the other hands, GS, and wavelet intensity hue saturation (W-IHS) have shown the preserving good colour with original image for Landsat TM data.


Author(s):  
Dr.Vani. K ◽  
Anto. A. Micheal

This paper is an attempt to combine high resolution panchromatic lunar image with low resolution multispectral lunar image to produce a composite image using wavelet approach. There are many sensors that provide us image data about the lunar surface. The spatial resolution and spectral resolution is unique for each sensor, thereby resulting in limitation in extraction of information about the lunar surface. The high resolution panchromatic lunar image has high spatial resolution but low spectral resolution; the low resolution multispectral image has low spatial resolution but high spectral resolution. Extracting features such as craters, crater morphology, rilles and regolith surfaces with a low spatial resolution in multispectral image may not yield satisfactory results. A sensor which has high spatial resolution can provide better information when fused with the high spectral resolution. These fused image results pertain to enhanced crater mapping and mineral mapping in lunar surface. Since fusion using wavelet preserve spectral content needed for mineral mapping, image fusion has been done using wavelet approach.


Sign in / Sign up

Export Citation Format

Share Document