Spectral unmixing of mixed pixels for texture boundary refinement

Author(s):  
K.P. Camilleri ◽  
M. Petrou
2020 ◽  
Vol 12 (5) ◽  
pp. 779 ◽  
Author(s):  
Bei Fang ◽  
Yunpeng Bai ◽  
Ying Li

Recently, Hyperspectral Image (HSI) classification methods based on deep learning models have shown encouraging performance. However, the limited numbers of training samples, as well as the mixed pixels due to low spatial resolution, have become major obstacles for HSI classification. To tackle these problems, we propose a resource-efficient HSI classification framework which introduces adaptive spectral unmixing into a 3D/2D dense network with early-exiting strategy. More specifically, on one hand, our framework uses a cascade of intermediate classifiers throughout the 3D/2D dense network that is trained end-to-end. The proposed 3D/2D dense network that integrates 3D convolutions with 2D convolutions is more capable of handling spectral-spatial features, while containing fewer parameters compared with the conventional 3D convolutions, and further boosts the network performance with limited training samples. On another hand, considering the existence of mixed pixels in HSI data, the pixels in HSI classification are divided into hard samples and easy samples. With the early-exiting strategy in these intermediate classifiers, the average accuracy can be improved by reducing the amount of computation cost for easy samples, thus focusing on classifying hard samples. Furthermore, for hard samples, an adaptive spectral unmixing method is proposed as a complementary source of information for classification, which brings considerable benefits to the final performance. Experimental results on four HSI benchmark datasets demonstrate that the proposed method can achieve better performance than state-of-the-art deep learning-based methods and other traditional HSI classification methods.


2020 ◽  
Vol 2020 ◽  
pp. 1-10
Author(s):  
Haonan Zhang ◽  
Xingping Wen ◽  
Junlong Xu ◽  
Dayou Luo ◽  
Ping He

In the spectrum measurement experiment, the roughness of the object surface is an essential factor that cannot be ignored. In this experiment, a group of mixed pixel samples with different mixing ratios were designed, and these samples were printed on four kinds of papers with different roughness. The spectral characteristics of mixed pixels with different roughness are quantitatively analyzed by using the measured spectral data. The linear spectral mixture model is used for spectral decomposition, and the effect of roughness on the unmixing precision of mixed pixels was studied. The surface roughness will affect the reflectivity of the mixed pixel. Specifically, the higher the roughness is, the higher the reflectivity of the sample is. This phenomenon is more noticeable when the proportion of white endmember (PWE) is large, and as the white area ratio decreases, the reflectance difference gradually decreases. When the surface roughness of the sample is less than 3.339 μm, the spectral decomposition is performed using a linear spectral mixing model in the visible light band. The average error of the unmixing is less than 0.53%, which is lower than the conventional standard spectral measurement error. In other words, when the surface roughness of the sample is controlled within a specific range, the effect of roughness on the unmixing accuracy of the mixed pixels is small, and this effect can be almost ignored. Multiple scattering within the pixels is the key to model selection and unmixing accuracy, when using the ASD FieldSpec3 spectrometer to perform spectral reflectance measurement and linear spectral unmixing experiments. If the surface roughness of the sample to be measured is less than the maximum wavelength of the spectrometer, the experimental results believe that the photon energy is mainly mirror reflection on the surface of the object and diffuse reflection. At this time, it is still a better choice to use a linear spectral mixing model to decompose the mixed pixels.


Author(s):  
F. Kizel ◽  
Y. Vidro

Abstract. Hyperspectral imaging is crucial for a variety of land-cover mapping and analyzing tasks. The available large number of reflected light measurements along a wide range of wavelengths allows for distinguishing between different materials under various conditions. Though, several effects bear an undesired variability within hyperspectral images and increase the complexity of interpreting such data. Two of the most significant effects in this regard are the BRDF and the spectral mixture. Due to the first, the acquisitions geometrical and viewing conditions influences the measured spectral signature of a surface to a large extent. On the other hand, because of the typical low spatial resolution of remotely sensed images, each pixel can contain more than one material. Despite much research addressing either the BRDF effect and ways to correct it or the spectral unmixing, too few works considered these two effects' mutual influence. In this work, we study the BRDF of mixed pixels and present preliminary insights of testing a strategy to correct its undesired impact on the data by incorporating the EMs fractions within an unmixing-based semi-empirical correction model. Experimental results using real laboratory data acquired under controlled conditions clearly show the significant improvement of the corrected reflectance results through the proposed model.


Author(s):  
Y. Constans ◽  
S. Fabre ◽  
M. Seymour ◽  
V. Crombez ◽  
X. Briottet ◽  
...  

Abstract. Earth observation at the local scale implies working on images with both high spatial and spectral resolutions. As the latter cannot be simultaneously provided by current sensors, hyperspectral pansharpening methods combine images jointly acquired by two different sensors, a panchromatic one providing high spatial resolution, and a hyperspectral one providing high spectral resolution, to generate an image with both high spatial and spectral resolutions. The main limitation in the fusion process is in presence of mixed pixels, which particularly affect urban scenes, and where large fusion errors may occur. Recently, the Spatially Organized Spectral Unmixing (SOSU) method was developed to overcome this limitation, delivering good results on agricultural and peri-urban landscapes, which contain a limited number of mixed pixels. This article presents a new version of SOSU, adapted to urban landscapes. It is validated on a Toulouse (France) urban dataset at a 1.6 m spatial resolution acquired by the HySpex instrument from the 2012 UMBRA campaign. A performance assessment is established, following Wald’s protocol and using complementary quality criteria. Visual and numerical (at the global and local scales) analyses of this performance are also proposed. Notably, in the VNIR domain, around 51 % of the mixed pixels are better processed by the presented version of SOSU than by the method used as a reference. This ratio is improved regarding shadowed areas in the reflective (52 %) and VNIR (57 %) domains.


2019 ◽  
Vol 11 (24) ◽  
pp. 3038
Author(s):  
Yunlei Cui ◽  
Hua Sun ◽  
Guangxing Wang ◽  
Chengjie Li ◽  
Xiaoyu Xu

China has been facing serious land degradation and desertification in its north and northwest arid and semi-arid areas. Monitoring the dynamics of percentage vegetation cover (PVC) using remote sensing imagery in these areas has become critical. However, because these areas are large, remote, and sparsely populated, and also because of the existence of mixed pixels, there have been no accurate and cost-effective methods available for this purpose. Spectral unmixing methods are a good alternative as they do not need field data and are low cost. However, traditional linear spectral unmixing (LSU) methods lack the ability to capture the characteristics of spectral reflectance and scattering from endmembers and their interactions within mixed pixels. Moreover, existing nonlinear spectral unmixing methods, such as random forest (RF) and radial basis function neural network (RBFNN), are often costly because they require field measurements of PVC from a large number of training samples. In this study, a cost-effective approach to mapping PVC in arid and semi-arid areas was proposed. A method for selection and purification of endmembers mainly based on Landsat imagery was first presented. A probability-based spectral unmixing analysis (PBSUA) and a probability-based optimized k nearest-neighbors (PBOkNN) approach were then developed to improve the mapping of PVC in Duolun County in Inner Mongolia, China, using Landsat 8 images and field data from 920 sample plots. The proposed PBSUA and PBOkNN methods were further validated in terms of accuracy and cost-effectiveness by comparison with two LSU methods, with and without purification of endmembers, and two nonlinear approaches, RF and RBFNN. The cost-effectiveness was defined as the reciprocal of cost timing relative root mean square error (RRMSE). The results showed that (1) Probability-based spectral unmixing analysis (PBSUA) was most cost-effective and increased the cost-effectiveness by 29.3% 29.3%, 33.5%, 50.8%, and 53.0% compared with two LSU methods, PBOkNN, RF, and RBFNN, respectively; (2) PBSUA, RF, and RBFNN gave RRMSE values of 22.9%, 21.8%, and 22.8%, respectively, which were not significantly different from each other at the significance level of 0.05. Compatibly, PBOkNN and LSU methods with and without purification of endmembers resulted in significantly greater RRMSE values of 27.5%, 32.4%, and 43.3%, respectively; (3) the average estimates of the sample plots and predicted maps from PBSUA, PBOkNN, RF, and RBFNN fell in the confidence interval of the test plot data, but those from two LSU methods did not, although the LSU with purification of endmembers improved the PVC estimation accuracy by 25.2% compared with the LSU without purification of endmembers. Thus, this study indicated that the proposed PBSUA had great potential for cost-effectively mapping PVC in arid and semi-arid areas.


2019 ◽  
Vol 11 (9) ◽  
pp. 1045 ◽  
Author(s):  
Yang Shao ◽  
Jinhui Lan

Limited to the low spatial resolution of the hyperspectral imaging sensor, mixed pixels are inevitable in hyperspectral images. Therefore, to obtain the endmembers and corresponding fractions in mixed pixels, hyperspectral unmixing becomes a hot spot in the field of remote sensing. Endmember spectral variability (ESV), which is common in hyperspectral images, affects spectral unmixing accuracy. This paper proposes a spectral unmixing method based on maximum margin criterion and derivative weights (MDWSU) to reduce the effect of ESV on spectral unmixing. Firstly, in the MDWSU model, an effective and fast algorithm is employed for establishing the endmember spectral library. Then a spectral weighting matrix based on the maximum margin criterion is constructed based on the endmember spectral library. Besides, derivative analysis and local neighborhood weights are merged into local neighborhood derivative weights, which act as a regularization term to penalize different abundance vectors. Local neighborhood derivative weights and spectral weighting matrix are proved to reduce the effect of ESV. Real hyperspectral data experiments show that the MDWSU model can obtain more accurate endmembers and abundance estimation. In addition, the experimental results, including the spectral angle distance and the root mean square error, prove the superiority of the MDWSU model over the previous methods.


2021 ◽  
Vol 13 (13) ◽  
pp. 2550
Author(s):  
Ke Wu ◽  
Tao Chen ◽  
Ying Xu ◽  
Dongwei Song ◽  
Haishan Li

Due to the high temporal repetition rates, median/low spatial resolution remote sensing images are the main data source of change detection (CD). It is worth noting that they contain a large number of mixed pixels, which makes adequately capturing the details in the resulting thematic map challenging. The spectral unmixing (SU) method is a potential solution to this problem, as it decomposes mixed pixels into a set of fractions of the land covers. However, there are accumulated errors in the fractional difference images, which lead to a poor change detection results. Meanwhile, the spectra variation of the endmember and the heterogeneity of the land cover materials cannot be fully considered in the traditional framework. In order to solve this problem, a novel change detection approach with image stacking and dividing based on spectral unmixing while considering the variability of endmembers (CD_SDSUVE) was proposed in this paper. Firstly, the remote sensing images at different times were stacked into a unified framework. After that, several patch images were produced by dividing the stacked images so that the similar endmembers according to each land cover can be completely extracted and compared. Finally, the multiple endmember spectral mixture analysis (MESMA) is performed, and the abundant images were combined to produce the entire change detection thematic map. This proposed algorithm was implemented and compared to four relevant state-of-the-art methods on three experimental data, whereby the results confirmed that it effectively improved the accuracy. In the simulated data, the overall accuracy (OA) and Kappa coefficient values were 99.61% and 0.99. In the two real data, the maximum of OA were acquired with 93.26% and 80.85%, which gained 14.88% and 13.42% over the worst results at most. Meanwhile, the Kappa coefficient value was consistent with the OA.


Author(s):  
R. Ramak ◽  
M. J. Valadan Zouj ◽  
B. Mojaradi

There are a considerable number of mixed pixels in remotely sensed images. Different sub-pixel analyses have been recently developed correspondingly. A well-known method is linear spectral unmixing which obtains an abundance of each endmember in a given pixel. This model assumes that each pixel is a linear combination of all endmembers in a scene. This assumption is not correct since each pixel can only be a composition of some surrounding endmembers. Even though, a fully mathematical technique is used for spectral analysis, the output of the model may not represent the physical nature of the objects over the pixel under test. In this regard, this paper proposes a Local Linear Spectral Unmixing which is based on neighbor pixels classes. Having classified the image, using a supervised classifier, it is scanned through a window of an appropriate size. For each pixel at the center of the window, the endmember matrix is formed only based on the majority classes existed in the window. Then the amount of each one is calculated. The LLSU method was evaluated on an AVIRIS data set collected from an agricultural area of northern Indiana. The results of the proposed method demonstrate a significant improvement in comparison with the LSU results. Moreover, due to the dimension reduction of the endmember matrix in this method, the computation time of the LLSU speeds up by three to eight times compared to the conventional Linear Spectral Unmixing method. As a result, the proposed method is efficient over the spectral unmixing tasks.


Author(s):  
Zhaoxin Liu ◽  
Liaoying Zhao ◽  
Xiaorun Li ◽  
Shuhan Chen

Owing to the limitation of spatial resolution of the imaging sensor and the variability of ground surfaces, mixed pixels are widesperead in hyperspectral imagery. The traditional subpixel mapping algorithms treat all mixed pixels as boundary-mixed pixels while ignoring the existence of linear subpixels. To solve this question, this paper proposed a new subpixel mapping method based on linear subpixel feature detection and object optimization. Firstly, the fraction value of each class is obtained by spectral unmixing. Secondly, the linear subpixel features are pre-determined based on the hyperspectral characteristics and the linear subpixel feature; the remaining mixed pixels are detected based on maximum linearization index analysis. The classes of linear subpixels are determined by using template matching method. Finally, the whole subpixel mapping results are iteratively optimized by binary particle swarm optimization algorithm. The performance of the proposed subpixel mapping method is evaluated via experiments based on simulated and real hyperspectral data sets. The experimental results demonstrate that the proposed method can improve the accuracy of subpixel mapping.


Sign in / Sign up

Export Citation Format

Share Document