scholarly journals Information theoretic analysis of hyperspectral imaging systems with applications to fluorescence microscopy

2018 ◽  
Author(s):  
Sripad Ram
Keyword(s):  
Maximum Likelihood ◽  
Least Squares ◽  
Hyperspectral Imaging ◽  
Spectral Resolution ◽  
Stokes Shift ◽  
Information Matrix ◽  
Hyperspectral Data ◽  
Spectral Unmixing ◽  
Resolution Limit ◽  
Performance Bound

AbstractWe present a general stochastic model for hyperspectral imaging data and derive analytical expressions for the Fisher information matrix for the underlying spectral unmixing problem. We investigate the linear mixing model as a special case and define a linear unmixing performance bound by using the Cramer-Rao inequality. As an application, we consider fluorescence imaging and show how the performance bound provides a spectral resolution limit that predicts how accurately a pair of spectrally similar fluorescent labels can be spectrally unmixed. We also report a novel result that shows how the spectral resolution limit can be overcome by exploiting the phenomenon of anti-Stokes shift fluorescence. In addition, we investigate how photon statistics, channel addition and channel splitting affect the performance bound. Finally by using the performance bound as a benchmark, we compare the performance of the least squares and the maximum likelihood estimators for spectral unmixing. For the imaging conditions tested here, our analysis shows that both estimators are unbiased and that the standard deviation of the maximum likelihood estimator is consistently closer to the performance bound than that of the least squares estimator. The results presented here are based on broad assumptions regarding the underlying data model and are applicable to hyperspectral data acquired with point detectors, sCMOS, CCD and EMCCD imaging detectors.EDICS: ELI-COL, COI-MCI.

scholarly journals Hyperspectral Data Simulation (Sentinel-2 to AVIRIS-NG) for Improved Wildfire Fuel Mapping, Boreal Alaska

2021 ◽  
Vol 13 (9) ◽  
pp. 1693
Author(s):  
Anushree Badola ◽  
Santosh K. Panda ◽  
Dar A. Roberts ◽  
Christine F. Waigl ◽  
Uma S. Bhatt ◽  
...  
Keyword(s):  
Land Cover ◽  
Spectral Resolution ◽  
Hyperspectral Image ◽  
Spectral Response ◽  
Spectral Characteristics ◽  
Hyperspectral Data ◽  
Spectral Unmixing ◽  
High Spectral Resolution ◽  
Fuel Mapping ◽  
Sentinel 2

Alaska has witnessed a significant increase in wildfire events in recent decades that have been linked to drier and warmer summers. Forest fuel maps play a vital role in wildfire management and risk assessment. Freely available multispectral datasets are widely used for land use and land cover mapping, but they have limited utility for fuel mapping due to their coarse spectral resolution. Hyperspectral datasets have a high spectral resolution, ideal for detailed fuel mapping, but they are limited and expensive to acquire. This study simulates hyperspectral data from Sentinel-2 multispectral data using the spectral response function of the Airborne Visible/Infrared Imaging Spectrometer-Next Generation (AVIRIS-NG) sensor, and normalized ground spectra of gravel, birch, and spruce. We used the Uniform Pattern Decomposition Method (UPDM) for spectral unmixing, which is a sensor-independent method, where each pixel is expressed as the linear sum of standard reference spectra. The simulated hyperspectral data have spectral characteristics of AVIRIS-NG and the reflectance properties of Sentinel-2 data. We validated the simulated spectra by visually and statistically comparing it with real AVIRIS-NG data. We observed a high correlation between the spectra of tree classes collected from AVIRIS-NG and simulated hyperspectral data. Upon performing species level classification, we achieved a classification accuracy of 89% for the simulated hyperspectral data, which is better than the accuracy of Sentinel-2 data (77.8%). We generated a fuel map from the simulated hyperspectral image using the Random Forest classifier. Our study demonstrated that low-cost and high-quality hyperspectral data can be generated from Sentinel-2 data using UPDM for improved land cover and vegetation mapping in the boreal forest.

scholarly journals Parameterized Nonlinear Least Squares for Unsupervised Nonlinear Spectral Unmixing

2019 ◽  
Vol 11 (2) ◽  
pp. 148 ◽  
Author(s):  
Risheng Huang ◽  
Xiaorun Li ◽  
Haiqiang Lu ◽  
Jing Li ◽  
Liaoying Zhao
Keyword(s):  
Least Squares ◽  
Optimization Problem ◽  
Nonnegative Matrix Factorization ◽  
Optimization Problems ◽  
State Of The Art ◽  
Synthetic Data ◽  
Nonnegative Matrix ◽  
Nonlinear Least Squares ◽  
Hyperspectral Data ◽  
Spectral Unmixing

This paper presents a new parameterized nonlinear least squares (PNLS) algorithm for unsupervised nonlinear spectral unmixing (UNSU). The PNLS-based algorithms transform the original optimization problem with respect to the endmembers, abundances, and nonlinearity coefficients estimation into separate alternate parameterized nonlinear least squares problems. Owing to the Sigmoid parameterization, the PNLS-based algorithms are able to thoroughly relax the additional nonnegative constraint and the nonnegative constraint in the original optimization problems, which facilitates finding a solution to the optimization problems . Subsequently, we propose to solve the PNLS problems based on the Gauss–Newton method. Compared to the existing nonnegative matrix factorization (NMF)-based algorithms for UNSU, the well-designed PNLS-based algorithms have faster convergence speed and better unmixing accuracy. To verify the performance of the proposed algorithms, the PNLS-based algorithms and other state-of-the-art algorithms are applied to synthetic data generated by the Fan model and the generalized bilinear model (GBM), as well as real hyperspectral data. The results demonstrate the superiority of the PNLS-based algorithms.

scholarly journals Chlorophyll content for millet leaf using hyperspectral imaging and an attention-convolutional neural network

2020 ◽  
Vol 50 (3) ◽  
Author(s):  
Wang Xiaoyan ◽  
Li Zhiwei ◽  
Wang Wenjun ◽  
Wang Jiawei
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Least Squares ◽  
Chlorophyll Content ◽  
Hyperspectral Imaging ◽  
Vegetation Index ◽  
Characteristic Parameter ◽  
Hyperspectral Data ◽  
Growth And Yield ◽  
Support Vector

ABSTRACT: Chlorophyll is a major factor affecting photosynthesis; and consequently, crop growth and yield. In this study, we devised a chlorophyll-content detection model for millet leaves in different stages of growth based on hyperspectral data. The hyperspectral images of millet leaves were obtained under a wavelength range of 380-1000 nm using a hyperspectral imager. Threshold segmentation was performed with near-infrared (NIR) reflectance and normalized difference vegetation index (NDVI) to intelligently acquire the regions of interest (ROI). Furthermore, raw spectral data were preprocessed using multivariate scatter correction (MSC). A correlation coefficient-successive projections algorithm (CC-SPA) was used to extract the characteristic wavelengths, and the characteristic parameters were extracted based on the spectral and image information. A partial least squares regression (PLSR) prediction model was established based on the single characteristic parameter and multi-characteristic parameter fusion. The determination coefficient (Rv 2) and the root-mean-square error (RMSEv) of the validation set for the multi-characteristic parameter fusion model were reported to be 0.813 and 1.766, respectively, which are higher than those obtained by the single characteristic parameter model. Based on the multi-characteristic parameter fusion, an attention-convolutional neural network (attention-CNN) (Rv 2 = 0.839, RMSEv = 1.451, RPD = 2.355) was established, which is more effective than the PLSR (Rv 2 = 0.813, RMSEv = 1.766, RPD = 2.167) and least squares support vector machine (LS-SVM) models (Rv 2 = 0.806, RMSEv = 1.576, RPD = 2.061). These results indicated that the combination of hyperspectral imaging and attention-CNN is beneficial to the application of nutrient element monitoring of crops.

Statistical performance analysis of transient-based extended blockage detection in a water supply pipeline

2019 ◽  
Vol 68 (5) ◽  
pp. 346-357 ◽  
Author(s):  
Alireza Keramat ◽  
Roohollah Zanganeh
Keyword(s):  
Lower Bound ◽  
Water Supply ◽  
Fisher Information ◽  
Noise Level ◽  
Minimum Mean Square Error ◽  
Information Matrix ◽  
Physical Parameters ◽  
Resolution Limit ◽  
Performance Bound ◽  
Water Supply Pipeline

Abstract The aim of the present research is to quantify the maximum feasible accuracy (location and size) for the transient-based blockage detection in a water supply pipeline. Owing to the randomness of transient measurements, a performance bound for the extended blockage detection exists which estimated parameters cannot exceed. The Cramér–Rao lower bound (CRLB) theorem is utilized to compute the lower bound variance of noise-induced estimation errors. It gives the minimum mean square error of any estimator according to information obtained from measurements and quantified by Fisher information. The Fisher information matrix is computed using direct differentiation of the compatibility equations obtained by the method of characteristics. The influence of relevant physical parameters including valve closure time, measurement time length and noise level on the best possible localization of blockage is investigated. The connection between the signal bandwidth, noise level and the performance limit is quantified for a typical case study. The results demonstrate trade-off between the size and the location/length of blockage estimates subject to different maneuver times, roughly offering half the wave speed times maneuver duration as the resolution limit.

scholarly journals Maximum Likelihood Estimation Based Nonnegative Matrix Factorization for Hyperspectral Unmixing

2021 ◽  
Vol 13 (13) ◽  
pp. 2637
Author(s):  
Qin Jiang ◽  
Yifei Dong ◽  
Jiangtao Peng ◽  
Mei Yan ◽  
Yi Sun
Keyword(s):  
Maximum Likelihood ◽  
Maximum Likelihood Estimation ◽  
Objective Function ◽  
Least Squares ◽  
Matrix Factorization ◽  
Nonnegative Matrix Factorization ◽  
Nonnegative Matrix ◽  
Likelihood Estimation ◽  
Hyperspectral Data ◽  
Hyperspectral Unmixing

Hyperspectral unmixing (HU) is a research hotspot of hyperspectral remote sensing technology. As a classical HU method, the nonnegative matrix factorization (NMF) unmixing method can decompose an observed hyperspectral data matrix into the product of two nonnegative matrices, i.e., endmember and abundance matrices. Because the objective function of NMF is the traditional least-squares function, NMF is sensitive to noise. In order to improve the robustness of NMF, this paper proposes a maximum likelihood estimation (MLE) based NMF model (MLENMF) for unmixing of hyperspectral images (HSIs), which substitutes the least-squares objective function in traditional NMF by a robust MLE-based loss function. Experimental results on a simulated and two widely used real hyperspectral data sets demonstrate the superiority of our MLENMF over existing NMF methods.

scholarly journals Multimodal Deep Learning and Visible-Light and Hyperspectral Imaging for Fruit Maturity Estimation

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1288
Author(s):  
Cinmayii A. Garillos-Manliguez ◽  
John Y. Chiang
Keyword(s):  
Deep Learning ◽  
Visible Light ◽  
Hyperspectral Imaging ◽  
Morphological Changes ◽  
Consumer Preference ◽  
Hyperspectral Data ◽  
Sensitivity Analyses ◽  
Deep Convolutional Neural Networks ◽  
Fruit Maturity ◽  
Learning Architectures

Fruit maturity is a critical factor in the supply chain, consumer preference, and agriculture industry. Most classification methods on fruit maturity identify only two classes: ripe and unripe, but this paper estimates six maturity stages of papaya fruit. Deep learning architectures have gained respect and brought breakthroughs in unimodal processing. This paper suggests a novel non-destructive and multimodal classification using deep convolutional neural networks that estimate fruit maturity by feature concatenation of data acquired from two imaging modes: visible-light and hyperspectral imaging systems. Morphological changes in the sample fruits can be easily measured with RGB images, while spectral signatures that provide high sensitivity and high correlation with the internal properties of fruits can be extracted from hyperspectral images with wavelength range in between 400 nm and 900 nm—factors that must be considered when building a model. This study further modified the architectures: AlexNet, VGG16, VGG19, ResNet50, ResNeXt50, MobileNet, and MobileNetV2 to utilize multimodal data cubes composed of RGB and hyperspectral data for sensitivity analyses. These multimodal variants can achieve up to 0.90 F1 scores and 1.45% top-2 error rate for the classification of six stages. Overall, taking advantage of multimodal input coupled with powerful deep convolutional neural network models can classify fruit maturity even at refined levels of six stages. This indicates that multimodal deep learning architectures and multimodal imaging have great potential for real-time in-field fruit maturity estimation that can help estimate optimal harvest time and other in-field industrial applications.

scholarly journals Prediction of Sugar Content in Port Wine Vintage Grapes Using Machine Learning and Hyperspectral Imaging

Processes ◽  
2021 ◽  
Vol 9 (7) ◽  
pp. 1241
Author(s):  
Véronique Gomes ◽  
Marco S. Reis ◽  
Francisco Rovira-Más ◽  
Ana Mendes-Ferreira ◽  
Pedro Melo-Pinto
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Hyperspectral Imaging ◽  
Sugar Content ◽  
Hyperspectral Data ◽  
Machine Learning Algorithms ◽  
Port Wine ◽  
Monitoring And Control ◽  
High Quality ◽  
Harvesting Stage

The high quality of Port wine is the result of a sequence of winemaking operations, such as harvesting, maceration, fermentation, extraction and aging. These stages require proper monitoring and control, in order to consistently achieve the desired wine properties. The present work focuses on the harvesting stage, where the sugar content of grapes plays a key role as one of the critical maturity parameters. Our approach makes use of hyperspectral imaging technology to rapidly extract information from wine grape berries; the collected spectra are fed to machine learning algorithms that produce estimates of the sugar level. A consistent predictive capability is important for establishing the harvest date, as well as to select the best grapes to produce specific high-quality wines. We compared four different machine learning methods (including deep learning), assessing their generalization capacity for different vintages and varieties not included in the training process. Ridge regression, partial least squares, neural networks and convolutional neural networks were the methods considered to conduct this comparison. The results show that the estimated models can successfully predict the sugar content from hyperspectral data, with the convolutional neural network outperforming the other methods.

scholarly journals Rotational hyperspectral scanner and related image reconstruction algorithm

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Longqiang Luo ◽  
Shuo Li ◽  
Xinli Yao ◽  
Sailing He
Keyword(s):  
Image Reconstruction ◽  
Spectral Resolution ◽  
Reconstruction Algorithm ◽  
Hyperspectral Data ◽  
Data Cube ◽  
Spatial Accuracy ◽  
Scanning Method ◽  
Image Reconstruction Algorithm

AbstractWe design and implement a compact and lightweight hyperspectral scanner. Based on this, a novel rotational hyperspectral scanner was demonstrated. Different from translational scanning, rotational scanning is a moveless and stable scanning method. We also designed a relevant image algorithm to reconstruct the image from an angular recorded hyperspectral data cube. The algorithm works well even with uncertain radial and tangential offset, which is caused by mechanical misalignment. The system shown a spectral resolution of 5 nm after calibration. Finally, spatial accuracy and spectral precision were discussed, based on some additional experiments.

Sign in / Sign up

Export Citation Format

Share Document