scholarly journals Hyperspectral Estimation of Soil Organic Matter Content using Different Spectral Preprocessing Techniques and PLSR Method

2020 ◽  
Vol 12 (7) ◽  
pp. 1206
Author(s):  
Lanzhi Shen ◽  
Maofang Gao ◽  
Jingwen Yan ◽  
Zhao-Liang Li ◽  
Pei Leng ◽  
...  
Keyword(s):  
Organic Matter ◽  
Soil Organic Matter ◽  
Dimensionality Reduction ◽  
Spectral Data ◽  
Wavelet Packet ◽  
Estimation Model ◽  
Data Transformations ◽  
First Derivative ◽  
Model Based ◽  
Reduction Methods

Soil organic matter (SOM) is the main source of soil nutrients, which are essential for the growth and development of agricultural crops. Hyperspectral remote sensing is one of the most efficient ways of estimating the SOM content. Visible, near infrared, and mid-infrared reflectance spectroscopy, combined with the partial least squares regression (PLSR) method is considered to be an effective way of determining soil properties. In this study, we used 54 different spectral pretreatments to preprocess soil spectral data. These spectral pretreatments were composed of three denoising methods, six data transformations, and three dimensionality reduction methods. The three denoising methods included no denoising (ND), Savitzky–Golay denoising (SGD), and wavelet packet denoising (WPD). The six data transformations included original spectral data, R; reciprocal, 1/R; logarithmic, log(R); reciprocal logarithmic, log(1/R); first derivative, R’; and first derivative of reciprocal, (1/R)’. The three dimensionality reduction methods included no dimensionality reduction (NDR), sensitive waveband dimensionality reduction (SWDR), and principal component analysis (PCA) dimensionality reduction (PCADR). The processed spectra were then employed to construct PLSR models for predicting the SOM content. The main results were as follows—(1) the wavelet packet denoising (WPD)-R’ and WPD-(1/R)’ data showed stronger correlations with the SOM content. Furthermore, these methods could effectively limit the correlation between the adjacent bands and, thus, prevent “overfitting”. (2) Of the 54 pretreatments investigated, WPD-(1/R)’-PCADR yielded the model with the highest accuracy and stability. (3) For the same denoising method and spectral transformation data, the accuracy of the SOM content estimation model based on SWDR was higher than that of the model based on NDR. Furthermore, the accuracy in the case of PCADR was higher than that for SWDR. (4) Dimensionality reduction was effective in preventing data overfitting. (5) The quality of the spectral data could be improved and the accuracy of the SOM content estimation model could be enhanced effectively, by using some appropriate preprocessing methods (one combining WPD and PCADR in this study).

scholarly journals Hyperspectral Estimation Model of Forest Soil Organic Matter in Northwest Yunnan Province, China

Forests ◽  
2019 ◽  
Vol 10 (3) ◽  
pp. 217 ◽  
Author(s):  
Yun Chen ◽  
Jinliang Wang ◽  
Guangjie Liu ◽  
Yanlin Yang ◽  
Zhiyuan Liu ◽  
...  
Keyword(s):  
Particle Size ◽  
Organic Matter ◽  
Soil Organic Matter ◽  
Linear Regression ◽  
Forest Soil ◽  
Spectral Reflectance ◽  
Soil Particle ◽  
Estimation Model ◽  
Soil Particle Size ◽  
First Derivative

Soil organic matter (SOM) is an important index to evaluate soil fertility and soil quality, while playing an important role in the terrestrial carbon cycle. The technology of hyperspectral remote sensing is an important method to estimate SOM content efficiently and accurately. This study researched the best hyperspectral estimation model for SOM content in Shangri-La forest soil. The spectral reflectance of soils with sizes of 2 mm, 1 mm, 0.50 mm, and 0.25 mm were measured indoors. After smoothing and de-noising, the reciprocal reflectance (RR), logarithmic reflectance (LR), first-derivative reflectance (FR), reciprocal first-derivative reflectance (RFR), logarithmic first-derivative reflectance (LFR), and mathematical transformations of the original spectral reflectance (REF) were carried out to analyze the relevance of spectral reflectance and SOM content and extract the characteristic bands. Finally the simple linear regression (SLR), multiple stepwise linear regression (SMLR), and partial least squares regression (PLSR) models for SOM content estimation were established. The results showed that: (1) With the decrease of soil particle size, the spectral reflectance increased. The smaller the soil particle sizes, the more obvious was the increase in spectral reflectance. (2) The sensitive bands of SOM were mainly in the 580–690 nm range (correlation coefficient (R) > 0.6, p-value (p) < 0.01), and the spectral information of SOM could be significantly enhanced by first-order differential transformation. (3) Comparing the three models, PLSR had better estimation ability than SMLR and SLR. The precision of the 0.25 mm soil particle size and the LFR index in the PLSR estimation model of SOM content was the best (coefficient of determination of validation (Rv2) = 0.91, root mean square error of validation (RMSEv) = 13.41, the ratio of percent deviation (RPD) = 3.33). The results provide a basis for monitoring SOM content rapidly in the forests of Northwest Yunnan, and provide a reference for forest SOM estimation in other areas.

Estimation of soil organic matter using proximal and satellite sensors after a wildfire in Mediterranean Croatia

2021 ◽  
Author(s):  
Iva Hrelja ◽  
Ivana Šestak ◽  
Igor Bogunović
Keyword(s):  
Organic Matter ◽  
Soil Organic Matter ◽  
Spectral Data ◽  
Near Infrared ◽  
Mean Squared Error ◽  
Nir Spectroscopy ◽  
Soil Samples ◽  
Least Squares Regression ◽  
Macro Scale ◽  
Sentinel 2

&lt;p&gt;Spectral data obtained from optical spaceborne sensors are being recognized as a valuable source of data that show promising results in assessing soil properties on medium and macro scale. Combining this technique with laboratory Visible-Near Infrared (VIS-NIR) spectroscopy methods can be an effective approach to perform robust research on plot scale to determine wildfire impact on soil organic matter (SOM) immediately after the fire. Therefore, the objective of this study was to assess the ability of Sentinel-2 superspectral data in estimating post-fire SOM content and comparison with the results acquired with laboratory VIS-NIR spectroscopy.&lt;/p&gt;&lt;p&gt;The study is performed in Mediterranean Croatia (44&amp;#176; 05&amp;#8217; N; 15&amp;#176; 22&amp;#8217; E; 72 m a.s.l.), on approximately 15 ha of fire affected mixed &lt;em&gt;Quercus ssp.&lt;/em&gt; and &lt;em&gt;Juniperus ssp.&lt;/em&gt; forest on Cambisols. A total of 80 soil samples (0-5 cm depth) were collected and geolocated on August 22&lt;sup&gt;nd&lt;/sup&gt; 2019, two days after a medium to high severity wildfire. The samples were taken to the laboratory where soil organic carbon (SOC) content was determined via dry combustion method with a CHNS analyzer. SOM was subsequently calculated by using a conversion factor of 1.724. Laboratory soil spectral measurements were carried out using a portable spectroradiometer (350-1050 nm) on all collected soil samples. Two Sentinel-2 images were downloaded from ESAs Scientific Open Access Hub according to the closest dates of field sampling, namely August 31&lt;sup&gt;st&lt;/sup&gt; and September 5&lt;sup&gt;th &lt;/sup&gt;2019, each containing eight VIS-NIR and two SWIR (Short-Wave Infrared) bands which were extracted from bare soil pixels using SNAP software. Partial least squares regression (PLSR) model based on the pre-processed spectral data was used for SOM estimation on both datasets. Spectral reflectance data were used as predictors and SOM content was used as a response variable. The accuracy of the models was determined via Root Mean Squared Error of Prediction (RMSE&lt;sub&gt;p&lt;/sub&gt;) and Ratio of Performance to Deviation (RPD) after full cross-validation of the calibration datasets.&lt;/p&gt;&lt;p&gt;The average post-fire SOM content was 9.63%, ranging from 5.46% minimum to 23.89% maximum. Models obtained from both datasets showed low RMSE&lt;sub&gt;p &lt;/sub&gt;(Spectroscopy dataset RMSE&lt;sub&gt;p&lt;/sub&gt; = 1.91; Sentinel-2 dataset RMSE&lt;sub&gt;p&lt;/sub&gt; = 0.99). RPD values indicated very good predictions for both datasets (Spectrospcopy dataset RPD = 2.72; Sentinel-2 dataset RPD = 2.22). Laboratory spectroscopy method with higher spectral resolution provided more accurate results. Nonetheless, spaceborne method also showed promising results in the analysis and monitoring of SOM in post-burn period.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Keywords:&lt;/strong&gt; remote sensing, soil spectroscopy, wildfires, soil organic matter&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Acknowledgment: &lt;/strong&gt;This work was supported by the Croatian Science Foundation through the project &quot;Soil erosion and degradation in Croatia&quot; (UIP-2017-05-7834) (SEDCRO). Aleksandra Per&amp;#269;in is acknowledged for her cooperation during the laboratory work.&lt;/p&gt;

scholarly journals Exploring Appropriate Preprocessing Techniques for Hyperspectral Soil Organic Matter Content Estimation in Black Soil Area

2020 ◽  
Vol 12 (22) ◽  
pp. 3765
Author(s):  
Xitong Xu ◽  
Shengbo Chen ◽  
Zhengyuan Xu ◽  
Yan Yu ◽  
Sen Zhang ◽  
...  
Keyword(s):  
Organic Matter ◽  
Soil Organic Matter ◽  
Dimensionality Reduction ◽  
Near Infrared ◽  
Organic Matter Content ◽  
Nir Spectroscopy ◽  
Data Transformation ◽  
Black Soil ◽  
Locally Linear Embedding ◽  
Soil Area

Black soil in northeast China is gradually degraded and soil organic matter (SOM) content decreases at a rate of 0.5% per year because of the long-term cultivation. SOM content can be obtained rapidly by visible and near-infrared (Vis–NIR) spectroscopy. It is critical to select appropriate preprocessing techniques for SOM content estimation through Vis–NIR spectroscopy. This study explored three categories of preprocessing techniques to improve the accuracy of SOM content estimation in black soil area, and a total of 496 ground samples were collected from the typical black soil area at 0–15 cm in Hai Lun City, Heilongjiang Province, northeast of China. Three categories of preprocessing include denoising, data transformation and dimensionality reduction. For denoising, Svitzky-Golay filter (SGF), wavelet packet transform (WPT), multiplicative scatter correction (MSC), and none (N) were applied to spectrum of ground samples. For data transformation, fractional derivatives were allowed to vary from 0 to 2 with an increment of 0.2 at each step. For dimensionality reduction, multidimensional scaling (MDS) and locally linear embedding (LLE) were introduced and compared with principal component analysis (PCA), which was commonly used for dimensionality reduction of soil spectrum. After spectral pretreatments, a total of 132 partial least squares regression (PLSR) models were constructed for SOM content estimation. Results showed that SGF performed better than the other three denoising methods. Low-order derivatives can accentuate spectral features of soil for SOM content estimation; as the order increases from 0.8, the spectrum were more susceptible to spectral noise interferences. In most cases, 0.2–0.8 order derivatives exhibited the best estimation performance. Furthermore, PCA yielded the optimal predictability, the mean residual predictive deviation (RPD) and maximum RPD of the models using PCA were 1.79 and 2.60, respectively. The application of appropriate preprocessing techniques could improve the efficiency and accuracy of SOM content estimation, which is important for the protection of ecological and agricultural environment in black soil area.

A genetic algorithm‐based stacking algorithm for predicting soil organic matter from vis–NIR spectral data

2019 ◽  
Vol 70 (3) ◽  
pp. 578-590 ◽  
Author(s):  
Nikolaos L. Tsakiridis ◽  
Nikolaos V. Tziolas ◽  
John B. Theocharis ◽  
George C. Zalidis
Keyword(s):  
Genetic Algorithm ◽  
Organic Matter ◽  
Soil Organic Matter ◽  
Spectral Data

scholarly journals Estimation of Soil Organic Matter, Total Nitrogen and Total Carbon in Sustainable Coastal Wetlands

2019 ◽  
Vol 11 (3) ◽  
pp. 667 ◽  
Author(s):  
Sen Zhang ◽  
Xia Lu ◽  
Yuanzhi Zhang ◽  
Gege Nie ◽  
Yurong Li
Keyword(s):  
Neural Network ◽  
Organic Matter ◽  
Soil Organic Matter ◽  
Bp Neural Network ◽  
Coastal Wetlands ◽  
Coastal Wetland ◽  
Soil Samples ◽  
Total Carbon ◽  
First Derivative ◽  
Estimation Models

Soil plays an important role in coastal wetland ecosystems. The estimation of soil organic matter (SOM), total nitrogen (TN), and total carbon (TC) was investigated at the topsoil (0–20 cm) in the coastal wetlands of Dafeng Elk National Nature Reserve in Yancheng, Jiangsu province (China) using hyperspectral remote sensing data. The sensitive bands corresponding to SOM, TN, and TC content were retrieved based on the correlation coefficient after Savitzky–Golay (S–G) filtering and four differential transformations of the first derivative (R′), first derivative of reciprocal (1/R)′, second derivative of reciprocal (1/R)″, and first derivative of logarithm (lgR)′ by spectral reflectance (R) as R′, (1/R)′, (1/R)″, (lgR)′ of soil samples. The estimation models of SOM, TN, and TC by support vector machine (SVM) and back propagation (BP) neural network were applied. The results indicated that the effective bands can be identified by S–G filtering, differential transformation, and the correlation coefficient methods based on the original spectra of soil samples. The estimation accuracy of SVM is better than that of the BP neural network for SOM, TN, and TC in the Yancheng coastal wetland. The estimation model of SOM by SVM based on (1/R)′ spectra had the highest accuracy, with the determination coefficients (R2) and root mean square error (RMSE) of 0.93 and 0.23, respectively. However, the estimation models of TN and TC by using the (1/R)″ differential transformations of spectra were also high, with determination coefficients R2 of 0.88 and 0.85, RMSE of 0.17 and 0.26, respectively. The results also show that it is possible to estimate the nutrient contents of topsoil from hyperspectral data in sustainable coastal wetlands.

Research on SPOT-5 Image-Based Soil Organic Matter Content Estimation

2013 ◽  
Vol 409-410 ◽  
pp. 246-251
Author(s):  
Yun Kai Guo ◽  
Fan Zeng ◽  
Mei Qing Ding ◽  
Xiao Yan Cao ◽  
Jin Hui Zhang
Keyword(s):  
Organic Matter ◽  
Soil Organic Matter ◽  
Active Material ◽  
Regional Distribution ◽  
Organic Matter Content ◽  
Paper Analysis ◽  
Matter Content ◽  
Hunan Province ◽  
Estimation Model ◽  
Spot 5

Soil organic matter (SOM) is the most active material component in soil, whats more, it is significant for soil fertility evaluation and agricultural sustainable development. This paper tries to establish a regional SOM prediction model of Yang Jiaqiao town, Xiangtan county in Hunan province, which based on the data obtained in the field and SPOT-5 image with the help of remote sensing retrieval technique, and then get the regional distribution of SOM. The results show that the most SOM content in experimental area is higher than 3%, which indicates SOM plays an important role in spectral reflectance characteristics, then establish corresponding estimation model and test them after transferring the reflectivity spectral data. The paper analysis and comes to a conclusion that the most appropriate model is the second-order polynomial one of red band based on SPOT-5 image by comparing the models between SOM content and single band measured reflectance.

Speech Emotion Recognition Based on Sparse Representation

2013 ◽  
Vol 38 (4) ◽  
pp. 465-470 ◽  
Author(s):  
Jingjie Yan ◽  
Xiaolan Wang ◽  
Weiyi Gu ◽  
LiLi Ma
Keyword(s):  
Dimensionality Reduction ◽  
Emotion Recognition ◽  
Least Squares ◽  
Partial Least Squares ◽  
Partial Least Squares Regression ◽  
Speech Emotion Recognition ◽  
Least Squares Regression ◽  
Computer Science Pedagogy ◽  
Reduction Methods ◽  
Analysis Computer

Abstract Speech emotion recognition is deemed to be a meaningful and intractable issue among a number of do- mains comprising sentiment analysis, computer science, pedagogy, and so on. In this study, we investigate speech emotion recognition based on sparse partial least squares regression (SPLSR) approach in depth. We make use of the sparse partial least squares regression method to implement the feature selection and dimensionality reduction on the whole acquired speech emotion features. By the means of exploiting the SPLSR method, the component parts of those redundant and meaningless speech emotion features are lessened to zero while those serviceable and informative speech emotion features are maintained and selected to the following classification step. A number of tests on Berlin database reveal that the recogni- tion rate of the SPLSR method can reach up to 79.23% and is superior to other compared dimensionality reduction methods.

Sign in / Sign up

Export Citation Format

Share Document