scholarly journals PWNet: An Adaptive Weight Network for the Fusion of Panchromatic and Multispectral Images

2020 ◽  
Vol 12 (17) ◽  
pp. 2804
Author(s):  
Junmin Liu ◽  
Yunqiao Feng ◽  
Changsheng Zhou ◽  
Chunxia Zhang
Keyword(s):  
Neural Network ◽  
Spatial Resolution ◽  
High Spatial Resolution ◽  
State Of The Art ◽  
Spectral Information ◽  
Data Sets ◽  
Multispectral Images ◽  
Image Prior ◽  
Adaptive Weight ◽  
Component Substitution

Pansharpening is a typical image fusion problem, which aims to produce a high resolution multispectral (HRMS) image by integrating a high spatial resolution panchromatic (PAN) image with a low spatial resolution multispectral (MS) image. Prior arts have used either component substitution (CS)-based methods or multiresolution analysis (MRA)-based methods for this propose. Although they are simple and easy to implement, they usually suffer from spatial or spectral distortions and could not fully exploit the spatial and/or spectral information existed in PAN and MS images. By considering their complementary performances and with the goal of combining their advantages, we propose a pansharpening weight network (PWNet) to adaptively average the fusion results obtained by different methods. The proposed PWNet works by learning adaptive weight maps for different CS-based and MRA-based methods through an end-to-end trainable neural network (NN). As a result, the proposed PWN inherits the data adaptability or flexibility of NN, while maintaining the advantages of traditional methods. Extensive experiments on data sets acquired by three different kinds of satellites demonstrate the superiority of the proposed PWNet and its competitiveness with the state-of-the-art methods.

scholarly journals Deriving VIIRS High-Spatial Resolution Water Property Data over Coastal and Inland Waters Using Deep Convolutional Neural Network

2021 ◽  
Vol 13 (10) ◽  
pp. 1944
Author(s):  
Xiaoming Liu ◽  
Menghua Wang
Keyword(s):  
Neural Network ◽  
High Resolution ◽  
Spatial Resolution ◽  
High Spatial Resolution ◽  
Ocean Color ◽  
Super Resolution ◽  
Inland Waters ◽  
Coastal Oceans ◽  
Chl A ◽  
Color Data

The Visible Infrared Imaging Radiometer Suite (VIIRS) onboard the Suomi National Polar-orbiting Partnership (SNPP) satellite has been a reliable source of ocean color data products, including five moderate (M) bands and one imagery (I) band normalized water-leaving radiance spectra nLw(λ). The spatial resolutions of the M-band and I-band nLw(λ) are 750 m and 375 m, respectively. With the technique of convolutional neural network (CNN), the M-band nLw(λ) imagery can be super-resolved from 750 m to 375 m spatial resolution by leveraging the high spatial resolution features of I1-band nLw(λ) data. However, it is also important to enhance the spatial resolution of VIIRS-derived chlorophyll-a (Chl-a) concentration and the water diffuse attenuation coefficient at the wavelength of 490 nm (Kd(490)), as well as other biological and biogeochemical products. In this study, we describe our effort to derive high-resolution Kd(490) and Chl-a data based on super-resolved nLw(λ) images at the VIIRS five M-bands. To improve the network performance over extremely turbid coastal oceans and inland waters, the networks are retrained with a training dataset including ocean color data from the Bohai Sea, Baltic Sea, and La Plata River Estuary, covering water types from clear open oceans to moderately turbid and highly turbid waters. The evaluation results show that the super-resolved Kd(490) image is much sharper than the original one, and has more detailed fine spatial structures. A similar enhancement of finer structures is also found in the super-resolved Chl-a images. Chl-a filaments are much sharper and thinner in the super-resolved image, and some of the very fine spatial features that are not shown in the original images appear in the super-resolved Chl-a imageries. The networks are also applied to four other coastal and inland water regions. The results show that super-resolution occurs mainly on pixels of Chl-a and Kd(490) features, especially on the feature edges and locations with a large spatial gradient. The biases between the original M-band images and super-resolved high-resolution images are small for both Chl-a and Kd(490) in moderately to extremely turbid coastal oceans and inland waters, indicating that the super-resolution process does not change the mean values of the original images.

scholarly journals Evaluation of a NIR camera for monitoring yield and nitrogen effect in sugarcane

2017 ◽  
Vol 35 (1) ◽  
pp. 82-91
Author(s):  
Cesar Edwin García ◽  
David Montero ◽  
Hector Alberto Chica
Keyword(s):  
Spatial Resolution ◽  
Vegetation Index ◽  
High Spatial Resolution ◽  
Early Stage ◽  
Vegetation Indices ◽  
Visible Spectrum ◽  
Crop Productivity ◽  
Spectral Information ◽  
Nitrogen Effect ◽  
Sugarcane Yield

The main objective of the research carried out in the sugar productive sector in Colombia is to improve crop productivity of sugarcane. The rise of RPAS, together with the use of multispectral cameras, which allows for high spatial resolution images and spectral information outside the visible spectrum, has generated an alternative nondestructive technological approach to monitoring crop sugarcane that must be evaluated and adapted to the specific conditions of Colombia's sugar productive sector. In this context, this paper assesses the potential of a modified camera (NIR) to discriminate three varieties of sugarcane, as well as three doses of fertilization and estimating the sugarcane yield at an early stage, for the three varieties through multiple vegetation indices. In this study, no significant differences were found by vegetation index between fertilization doses, and only significant differences between varieties were found when the fertilization was normal or high. Likewise, multiple regressions between scores derived from vegetation indices after applying PCA and productivity produced determinations of up to 56%.

scholarly journals High-resolution mapping of the NO<sub>2</sub> spatial distribution over Belgian urban areas based on airborne APEX remote sensing

2017 ◽  
Vol 10 (5) ◽  
pp. 1665-1688 ◽  
Author(s):  
Frederik Tack ◽  
Alexis Merlaud ◽  
Marian-Daniel Iordache ◽  
Thomas Danckaert ◽  
Huan Yu ◽  
...  
Keyword(s):  
High Resolution ◽  
Spatial Resolution ◽  
Urban Areas ◽  
High Spatial Resolution ◽  
European Space Agency ◽  
Correlation Coefficients ◽  
Time Frame ◽  
Quantitative Information ◽  
Data Sets ◽  
Vertical Column

Abstract. We present retrieval results of tropospheric nitrogen dioxide (NO2) vertical column densities (VCDs), mapped at high spatial resolution over three Belgian cities, based on the DOAS analysis of Airborne Prism EXperiment (APEX) observations. APEX, developed by a Swiss-Belgian consortium on behalf of ESA (European Space Agency), is a pushbroom hyperspectral imager characterised by a high spatial resolution and high spectral performance. APEX data have been acquired under clear-sky conditions over the two largest and most heavily polluted Belgian cities, i.e. Antwerp and Brussels on 15 April and 30 June 2015. Additionally, a number of background sites have been covered for the reference spectra. The APEX instrument was mounted in a Dornier DO-228 aeroplane, operated by Deutsches Zentrum für Luft- und Raumfahrt (DLR). NO2 VCDs were retrieved from spatially aggregated radiance spectra allowing urban plumes to be resolved at the resolution of 60  ×  80 m2. The main sources in the Antwerp area appear to be related to the (petro)chemical industry while traffic-related emissions dominate in Brussels. The NO2 levels observed in Antwerp range between 3 and 35  ×  1015 molec cm−2, with a mean VCD of 17.4 ± 3.7  ×  1015 molec cm−2. In the Brussels area, smaller levels are found, ranging between 1 and 20  ×  1015 molec cm−2 and a mean VCD of 7.7 ± 2.1  ×  1015 molec cm−2. The overall errors on the retrieved NO2 VCDs are on average 21 and 28 % for the Antwerp and Brussels data sets. Low VCD retrievals are mainly limited by noise (1σ slant error), while high retrievals are mainly limited by systematic errors. Compared to coincident car mobile-DOAS measurements taken in Antwerp and Brussels, both data sets are in good agreement with correlation coefficients around 0.85 and slopes close to unity. APEX retrievals tend to be, on average, 12 and 6 % higher for Antwerp and Brussels, respectively. Results demonstrate that the NO2 distribution in an urban environment, and its fine-scale variability, can be mapped accurately with high spatial resolution and in a relatively short time frame, and the contributing emission sources can be resolved. High-resolution quantitative information about the atmospheric NO2 horizontal variability is currently rare, but can be very valuable for (air quality) studies at the urban scale.

scholarly journals Hyperspectral Pansharpening Based on Homomorphic Filtering and Weighted Tensor Matrix

2019 ◽  
Vol 11 (9) ◽  
pp. 1005
Author(s):  
Jiahui Qu ◽  
Yunsong Li ◽  
Qian Du ◽  
Wenqian Dong ◽  
Bobo Xi
Keyword(s):  
Spatial Resolution ◽  
Spatial Information ◽  
Mean Squared Error ◽  
High Spatial Resolution ◽  
Experimental Results ◽  
Spectral Information ◽  
Morphological Operation ◽  
Effective Technique ◽  
Squared Error ◽  
Homomorphic Filtering

Hyperspectral pansharpening is an effective technique to obtain a high spatial resolution hyperspectral (HS) image. In this paper, a new hyperspectral pansharpening algorithm based on homomorphic filtering and weighted tensor matrix (HFWT) is proposed. In the proposed HFWT method, open-closing morphological operation is utilized to remove the noise of the HS image, and homomorphic filtering is introduced to extract the spatial details of each band in the denoised HS image. More importantly, a weighted root mean squared error-based method is proposed to obtain the total spatial information of the HS image, and an optimized weighted tensor matrix based strategy is presented to integrate spatial information of the HS image with spatial information of the panchromatic (PAN) image. With the appropriate integrated spatial details injection, the fused HS image is generated by constructing the suitable gain matrix. Experimental results over both simulated and real datasets demonstrate that the proposed HFWT method effectively generates the fused HS image with high spatial resolution while maintaining the spectral information of the original low spatial resolution HS image.

scholarly journals Joint Spatial-spectral Resolution Enhancement of Multispectral Images with Spectral Matrix Factorization and Spatial Sparsity Constraints

2020 ◽  
Vol 12 (6) ◽  
pp. 993 ◽  
Author(s):  
Chen Yi ◽  
Yong-qiang Zhao ◽  
Jonathan Cheung-Wai Chan ◽  
Seong G. Kong
Keyword(s):  
Spatial Resolution ◽  
Spectral Resolution ◽  
High Spatial Resolution ◽  
Resolution Enhancement ◽  
Multispectral Image ◽  
Observation Model ◽  
Multispectral Images ◽  
Spectral Matrix ◽  
Spectral Bands ◽  
Landsat 7

This paper presents a joint spatial-spectral resolution enhancement technique to improve the resolution of multispectral images in the spatial and spectral domain simultaneously. Reconstructed hyperspectral images (HSIs) from an input multispectral image represent the same scene in higher spatial resolution, with more spectral bands of narrower wavelength width than the input multispectral image. Many existing improvement techniques focus on spatial- or spectral-resolution enhancement, which may cause spectral distortions and spatial inconsistency. The proposed scheme introduces virtual intermediate variables to formulate a spectral observation model and a spatial observation model. The models alternately solve spectral dictionary and abundances to reconstruct desired high-resolution HSIs. An initial spectral dictionary is trained from prior HSIs captured in different landscapes. A spatial dictionary trained from a panchromatic image and its sparse coefficients provide high spatial-resolution information. The sparse coefficients are used as constraints to obtain high spatial-resolution abundances. Experiments performed on simulated datasets from AVIRIS/Landsat 7 and a real Hyperion/ALI dataset demonstrate that the proposed method outperforms the state-of-the-art spatial- and spectral-resolution enhancement methods. The proposed method also worked well for combination of exiting spatial- and spectral-resolution enhancement methods.

scholarly journals An Efficient Building Extraction Method from High Spatial Resolution Remote Sensing Images Based on Improved Mask R-CNN

Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1465 ◽  
Author(s):  
Lili Zhang ◽  
Jisen Wu ◽  
Yu Fan ◽  
Hongmin Gao ◽  
Yehong Shao
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Spatial Resolution ◽  
High Spatial Resolution ◽  
Extraction Methods ◽  
Detection Algorithm ◽  
Building Extraction ◽  
Remote Sensing Images ◽  
Edge Detection Algorithm ◽  
Average Value

In this paper, we consider building extraction from high spatial resolution remote sensing images. At present, most building extraction methods are based on artificial features. However, the diversity and complexity of buildings mean that building extraction methods still face great challenges, so methods based on deep learning have recently been proposed. In this paper, a building extraction framework based on a convolution neural network and edge detection algorithm is proposed. The method is called Mask R-CNN Fusion Sobel. Because of the outstanding achievement of Mask R-CNN in the field of image segmentation, this paper improves it and then applies it in remote sensing image building extraction. Our method consists of three parts. First, the convolutional neural network is used for rough location and pixel level classification, and the problem of false and missed extraction is solved by automatically discovering semantic features. Second, Sobel edge detection algorithm is used to segment building edges accurately so as to solve the problem of edge extraction and the integrity of the object of deep convolutional neural networks in semantic segmentation. Third, buildings are extracted by the fusion algorithm. We utilize the proposed framework to extract the building in high-resolution remote sensing images from Chinese satellite GF-2, and the experiments show that the average value of IOU (intersection over union) of the proposed method was 88.7% and the average value of Kappa was 87.8%, respectively. Therefore, our method can be applied to the recognition and segmentation of complex buildings and is superior to the classical method in accuracy.

Sign in / Sign up

Export Citation Format

Share Document