scholarly journals A Novel Adversarial Based Hyperspectral and Multispectral Image Fusion

2019 ◽  
Vol 11 (5) ◽  
pp. 492 ◽  
Author(s):  
Xukun Luo ◽  
Jihao Yin ◽  
Xiaoyan Luo ◽  
Xiuping Jia
Keyword(s):  
Spatial Correlation ◽  
Spectral Resolution ◽  
Real World ◽  
Hyperspectral Image ◽  
Selection Process ◽  
Multispectral Image ◽  
High Spectral Resolution ◽  
Spectral Correlation ◽  
Spatial Quality ◽  
Band Image

In order to reconstruct a high spatial and high spectral resolution image (H2SI), one of the most common methods is to fuse a hyperspectral image (HSI) with a corresponding multispectral image (MSI). To effectively obtain both the spectral correlation of bands in HSI and the spatial correlation of pixels in MSI, this paper proposes an adversarial selection fusion (ASF) method for the HSI–MSI fusion problem. Firstly, the unmixing based fusion (UF) method is adopted to dig out the spatial correlation in MSI. Then, to acquire the spectral correlation in HSI, a band reconstruction-based fusion (BRF) method is proposed, regarding H2SI as the product of the optimized band image dictionary and reconstruction coefficients. Finally, spectral spatial quality (SSQ) index is designed to guide the adversarial selection process of UF and BRF. Experimental results on four real-world images demonstrate that the proposed strategy achieves smaller errors and better reconstruction results than other comparison methods.

scholarly journals Hyperspectral Data Simulation (Sentinel-2 to AVIRIS-NG) for Improved Wildfire Fuel Mapping, Boreal Alaska

2021 ◽  
Vol 13 (9) ◽  
pp. 1693
Author(s):  
Anushree Badola ◽  
Santosh K. Panda ◽  
Dar A. Roberts ◽  
Christine F. Waigl ◽  
Uma S. Bhatt ◽  
...  
Keyword(s):  
Land Cover ◽  
Spectral Resolution ◽  
Hyperspectral Image ◽  
Spectral Response ◽  
Spectral Characteristics ◽  
Hyperspectral Data ◽  
Spectral Unmixing ◽  
High Spectral Resolution ◽  
Fuel Mapping ◽  
Sentinel 2

Alaska has witnessed a significant increase in wildfire events in recent decades that have been linked to drier and warmer summers. Forest fuel maps play a vital role in wildfire management and risk assessment. Freely available multispectral datasets are widely used for land use and land cover mapping, but they have limited utility for fuel mapping due to their coarse spectral resolution. Hyperspectral datasets have a high spectral resolution, ideal for detailed fuel mapping, but they are limited and expensive to acquire. This study simulates hyperspectral data from Sentinel-2 multispectral data using the spectral response function of the Airborne Visible/Infrared Imaging Spectrometer-Next Generation (AVIRIS-NG) sensor, and normalized ground spectra of gravel, birch, and spruce. We used the Uniform Pattern Decomposition Method (UPDM) for spectral unmixing, which is a sensor-independent method, where each pixel is expressed as the linear sum of standard reference spectra. The simulated hyperspectral data have spectral characteristics of AVIRIS-NG and the reflectance properties of Sentinel-2 data. We validated the simulated spectra by visually and statistically comparing it with real AVIRIS-NG data. We observed a high correlation between the spectra of tree classes collected from AVIRIS-NG and simulated hyperspectral data. Upon performing species level classification, we achieved a classification accuracy of 89% for the simulated hyperspectral data, which is better than the accuracy of Sentinel-2 data (77.8%). We generated a fuel map from the simulated hyperspectral image using the Random Forest classifier. Our study demonstrated that low-cost and high-quality hyperspectral data can be generated from Sentinel-2 data using UPDM for improved land cover and vegetation mapping in the boreal forest.

scholarly journals Lunar Image Fusion using Wavelet Transform

2013 ◽  
pp. 211-215
Author(s):  
Dr.Vani. K ◽  
Anto. A. Micheal
Keyword(s):  
High Resolution ◽  
Image Fusion ◽  
Spatial Resolution ◽  
Spectral Resolution ◽  
Lunar Surface ◽  
High Spatial Resolution ◽  
Multispectral Image ◽  
High Spectral Resolution ◽  
Low Resolution ◽  
Mineral Mapping

This paper is an attempt to combine high resolution panchromatic lunar image with low resolution multispectral lunar image to produce a composite image using wavelet approach. There are many sensors that provide us image data about the lunar surface. The spatial resolution and spectral resolution is unique for each sensor, thereby resulting in limitation in extraction of information about the lunar surface. The high resolution panchromatic lunar image has high spatial resolution but low spectral resolution; the low resolution multispectral image has low spatial resolution but high spectral resolution. Extracting features such as craters, crater morphology, rilles and regolith surfaces with a low spatial resolution in multispectral image may not yield satisfactory results. A sensor which has high spatial resolution can provide better information when fused with the high spectral resolution. These fused image results pertain to enhanced crater mapping and mineral mapping in lunar surface. Since fusion using wavelet preserve spectral content needed for mineral mapping, image fusion has been done using wavelet approach.

scholarly journals Self-Dictionary Regression for Hyperspectral Image Super-Resolution

2018 ◽  
Vol 10 (10) ◽  
pp. 1574 ◽  
Author(s):  
Dongsheng Gao ◽  
Zhentao Hu ◽  
Renzhen Ye
Keyword(s):  
High Resolution ◽  
Spatial Resolution ◽  
Spectral Resolution ◽  
Cross Correlation ◽  
Hyperspectral Image ◽  
High Spatial Resolution ◽  
Super Resolution ◽  
High Spectral Resolution ◽  
Low Resolution ◽  
Image Super Resolution

Due to sensor limitations, hyperspectral images (HSIs) are acquired by hyperspectral sensors with high-spectral-resolution but low-spatial-resolution. It is difficult for sensors to acquire images with high-spatial-resolution and high-spectral-resolution simultaneously. Hyperspectral image super-resolution tries to enhance the spatial resolution of HSI by software techniques. In recent years, various methods have been proposed to fuse HSI and multispectral image (MSI) from an unmixing or a spectral dictionary perspective. However, these methods extract the spectral information from each image individually, and therefore ignore the cross-correlation between the observed HSI and MSI. It is difficult to achieve high-spatial-resolution while preserving the spatial-spectral consistency between low-resolution HSI and high-resolution HSI. In this paper, a self-dictionary regression based method is proposed to utilize cross-correlation between the observed HSI and MSI. Both the observed low-resolution HSI and MSI are simultaneously considered to estimate the endmember dictionary and the abundance code. To preserve the spectral consistency, the endmember dictionary is extracted by performing a common sparse basis selection on the concatenation of observed HSI and MSI. Then, a consistent constraint is exploited to ensure the spatial consistency between the abundance code of low-resolution HSI and the abundance code of high-resolution HSI. Extensive experiments on three datasets demonstrate that the proposed method outperforms the state-of-the-art methods.

scholarly journals A spectra classification methodology of infrared hyperspectral images to reach near real-time SO2 emission flux estimation of Mount Etna plume

2021 ◽  
Author(s):  
Charlotte Segonne ◽  
Nathalie Huret ◽  
Sébastien Payan ◽  
Mathieu Gouhier
Keyword(s):  
Real Time ◽  
Spectral Resolution ◽  
Hyperspectral Image ◽  
Mount Etna ◽  
High Spectral Resolution ◽  
Training Dataset ◽  
Retrieval Algorithm ◽  
Transfer Model ◽  
Calculation Time ◽  
Active Volcanoes

<p>Monitoring active volcanoes activity passes through the detection of fluctuations in degassing levels which may reflect changes in the magma supply rate and help inform a short-term forecast of on-going eruptions. Infrared hyperspectral imagers, which is an imaging technology still little used for volcanoes monitoring, have been deployed for various field campaigns on active volcanoes recently. For example, the Hyper-Cam LWIR (LongWave InfraRed) ranging between 850-1300 cm<sup>-1</sup> (7.7 - 11.8 µm) with a spectral resolution up to 0.25 cm<sup>-1</sup>, provided high spectral resolution images from ground-based measurements of the Mount Etna (Sicily, Italy) plume during IMAGETNA campaign in June 2015. Processing the raw data and retrieving the infrared spectra with the LATMOS (Laboratoire Atmosphères Milieux Observations Spatiales) Atmospheric Retrieval Algorithm (LARA), a robust and a complete radiative transfer model, require a calculation time of ~7 days per image.</p><p>One of the main ways of risk mitigation effects of explosive eruptions is to get a fast and accurate quantification of SO<sub>2</sub> fluxes emitted by volcanoes. In this context, using the dataset acquired during IMAGETNA campaign at Mount Etna, a spectra classification methodology has been developed to drastically decrease the calculation time and reach near real-time retrievals of SO<sub>2</sub> slant column densities. The methodology is based on a network built on two layers of information from the extraction of spectral features in the O<sub>3</sub> and SO<sub>2</sub> emission bands. A training dataset of five SO<sub>2</sub> slant column densities images retrieved with the time-consuming pixel-by-pixel retrieval method allowed the creation of a library. The spectra classification makes it possible to process each hyperspectral image in less than 40 seconds. It opens the possibility to infer near real-time estimation of SO<sub>2</sub> emission fluxes from IR hyperspectral imager measurements.</p>

scholarly journals Target detection algorithm for airborne thermal hyperspectral data

2014 ◽  
Vol XL-8 ◽  
pp. 827-832 ◽  
Author(s):  
R. Marwaha ◽  
A. Kumar ◽  
P. L. N. Raju ◽  
Y. V. N. Krishna Murthy
Keyword(s):  
Spectral Resolution ◽  
Hyperspectral Image ◽  
Imaging System ◽  
Hyperspectral Data ◽  
High Spectral Resolution ◽  
Infrared Range ◽  
Digital Photograph ◽  
Minimum Noise Fraction ◽  
Noise Fraction ◽  
Minimum Noise

Airborne hyperspectral imaging is constantly being used for classification purpose. But airborne thermal hyperspectral image usually is a challenge for conventional classification approaches. The Telops Hyper-Cam sensor is an interferometer-based imaging system that helps in the spatial and spectral analysis of targets utilizing a single sensor. It is based on the technology of Fourier-transform which yields high spectral resolution and enables high accuracy radiometric calibration. The Hypercam instrument has 84 spectral bands in the 868 cm<sup>&minus;1</sup> to 1280 cm<sup>&minus;1</sup> region (7.8 μm to 11.5 μm), at a spectral resolution of 6 cm<sup>&minus;1</sup> (full-width-half-maximum) for LWIR (long wave infrared) range. Due to the Hughes effect, only a few classifiers are able to handle high dimensional classification task. MNF (Minimum Noise Fraction) rotation is a data dimensionality reducing approach to segregate noise in the data. In this, the component selection of minimum noise fraction (MNF) rotation transformation was analyzed in terms of classification accuracy using constrained energy minimization (CEM) algorithm as a classifier for Airborne thermal hyperspectral image and for the combination of airborne LWIR hyperspectral image and color digital photograph. On comparing the accuracy of all the classified images for airborne LWIR hyperspectral image and combination of Airborne LWIR hyperspectral image with colored digital photograph, it was found that accuracy was highest for MNF component equal to twenty. The accuracy increased by using the combination of airborne LWIR hyperspectral image with colored digital photograph instead of using LWIR data alone.

scholarly journals Hyperspectral Image Super-Resolution by Deep Spatial-Spectral Exploitation

2019 ◽  
Vol 11 (10) ◽  
pp. 1229 ◽  
Author(s):  
Jing Hu ◽  
Minghua Zhao ◽  
Yunsong Li
Keyword(s):  
Spatial Resolution ◽  
Hyperspectral Image ◽  
Super Resolution ◽  
Input Image ◽  
High Spectral Resolution ◽  
Spectral Information ◽  
Spectral Correlation ◽  
Fusion Operation ◽  
Image Super Resolution ◽  
Sr Method

Limited by the existing imagery sensors, hyperspectral images are characterized by high spectral resolution but low spatial resolution. The super-resolution (SR) technique aiming at enhancing the spatial resolution of the input image is a hot topic in computer vision. In this paper, we present a hyperspectral image (HSI) SR method based on a deep information distillation network (IDN) and an intra-fusion operation. Specifically, bands are firstly selected by a certain distance and super-resolved by an IDN. The IDN employs distillation blocks to gradually extract abundant and efficient features for reconstructing the selected bands. Second, the unselected bands are obtained via spectral correlation, yielding a coarse high-resolution (HR) HSI. Finally, the spectral-interpolated coarse HR HSI is intra-fused with the input HSI to achieve a finer HR HSI, making further use of the spatial-spectral information these unselected bands convey. Different from most existing fusion-based HSI SR methods, the proposed intra-fusion operation does not require any auxiliary co-registered image as the input, which makes this method more practical. Moreover, contrary to most single-based HSI SR methods whose performance decreases significantly as the image quality gets worse, the proposal deeply utilizes the spatial-spectral information and the mapping knowledge provided by the IDN, which achieves more robust performance. Experimental data and comparative analysis have demonstrated the effectiveness of this method.

Sign in / Sign up

Export Citation Format

Share Document