scholarly journals Sequence Image Interpolation via Separable Convolution Network

2021 ◽  
Vol 13 (2) ◽  
pp. 296
Author(s):  
Xing Jin ◽  
Ping Tang ◽  
Thomas Houet ◽  
Thomas Corpetti ◽  
Emilien Gence Alvarez-Vanhard ◽  
...  

Remote-sensing time-series data are significant for global environmental change research and a better understanding of the Earth. However, remote-sensing acquisitions often provide sparse time series due to sensor resolution limitations and environmental factors, such as cloud noise for optical data. Image interpolation is the method that is often used to deal with this issue. This paper considers the deep learning method to learn the complex mapping of an interpolated intermediate image from predecessor and successor images, called separable convolution network for sequence image interpolation. The separable convolution network uses a separable 1D convolution kernel instead of 2D kernels to capture the spatial characteristics of input sequence images and then is trained end-to-end using sequence images. Our experiments, which were performed with unmanned aerial vehicle (UAV) and Landsat-8 datasets, show that the method is effective to produce high-quality time-series interpolated images, and the data-driven deep model can better simulate complex and diverse nonlinear image data information.

Forests ◽  
2019 ◽  
Vol 10 (2) ◽  
pp. 139 ◽  
Author(s):  
Yingying Yang ◽  
Taixia Wu ◽  
Shudong Wang ◽  
Jing Li ◽  
Farhan Muhanmmad

Evergreen trees play a significant role in urban ecological services, such as air purification, carbon and oxygen balance, and temperature and moisture regulation. Remote sensing represents an essential technology for obtaining spatiotemporal distribution data for evergreen trees in cities. However, highly developed subtropical cities, such as Nanjing, China, have serious land fragmentation problems, which greatly increase the difficulty of extracting evergreen trees information and reduce the extraction precision of remote-sensing methods. This paper introduces a normalized difference vegetation index coefficient of variation (NDVI-CV) method to extract evergreen trees from remote-sensing data by combining the annual minimum normalized difference vegetation index (NDVIann-min) with the CV of a Landsat 8 time-series NDVI. To obtain an intra-annual, high-resolution time-series dataset, Landsat 8 cloud-free and partially cloud-free images over a three-year period were collected and reconstructed for the study area. Considering that the characteristic growth of evergreen trees remained nearly unchanged during the phenology cycle, NDVIann-min is the optimal phenological node to separate this information from that of other vegetation types. Furthermore, the CV of time-series NDVI considers all of the phenologically critical phases; therefore, the NDVI-CV method had higher extraction accuracy. As such, the approach presented herein represents a more practical and promising method based on reasonable NDVIann-min and CV thresholds to obtain spatial distribution data for evergreen trees. The experimental verification results indicated a comparable performance since the extraction accuracy of the model was over 85%, which met the classification accuracy requirements. In a cross-validation comparison with other evergreen trees’ extraction methods, the NDVI-CV method showed higher sensitivity and stability.


2021 ◽  
Vol 13 (9) ◽  
pp. 1853
Author(s):  
Xing Jin ◽  
Ping Tang ◽  
Zheng Zhang

Remote-sensing time-series datasets are significant for global change research and a better understanding of the Earth. However, remote-sensing acquisitions often provide sparse time series due to sensor resolution limitations and environmental factors such as cloud noise for optical data. Image transformation is the method that is often used to deal with this issue. This paper considers the deep convolution networks to learn the complex mapping between sequence images, called adaptive filter generation network (AdaFG), convolution long short-term memory network (CLSTM), and cycle-consistent generative adversarial network (CyGAN) for construction of sequence image datasets. AdaFG network uses a separable 1D convolution kernel instead of 2D kernels to capture the spatial characteristics of input sequence images and then is trained end-to-end using sequence images. CLSTM network can map between different images using the state information of multiple time-series images. CyGAN network can map an image from a source domain to a target domain without additional information. Our experiments, which were performed with unmanned aerial vehicle (UAV) and Landsat-8 datasets, show that the deep convolution networks are effective to produce high-quality time-series image datasets, and the data-driven deep convolution networks can better simulate complex and diverse nonlinear data information.


Land ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 102
Author(s):  
Manuela Hirschmugl ◽  
Carina Sobe ◽  
Cosette Khawaja ◽  
Rainer Janssen ◽  
Lorenzo Traverso

This study aims at identifying underutilized land potentially suitable for bioenergy production in Europe by means of remote sensing time series analysis. The background is the Revised Renewable Energy Directive (REDII) requesting that 32% of Europe’s energy production shall come from renewable energy sources until 2030. In order to avoid the food versus fuel debate, we only considered land that has not been used in the previous five years. Satellite remote sensing is the only technique that allows for the assessment of the usage of land for such a long time span at the pan-European scale with reasonable efforts. We used Landsat 8 (L8) data for the full five year time period 2015–2019 and included additional Sentinel-2 (S2) data for 2018 and 2019. The analysis was based on a stratified approach for biogeographical regions and countries using Google Earth Engine. To our knowledge, this is the first work that employs high resolution time series data for pan-European mapping of underutilized land. The average patch size of underutilized land was found to be between 23.2 ha and 49.6 ha, depending on the biogeographical region. The results show an overall accuracy of more than 85% with a confidence interval (CI) of 1.55% at the 95% confidence level (CL). The classification suggests that at total of 5.3 million ha of underutilized land in Europe is potentially available for agricultural bioenergy production.


2020 ◽  
Vol 12 (11) ◽  
pp. 1876 ◽  
Author(s):  
Katsuto Shimizu ◽  
Tetsuji Ota ◽  
Nobuya Mizoue ◽  
Hideki Saito

Developing accurate methods for estimating forest structures is essential for efficient forest management. The high spatial and temporal resolution data acquired by CubeSat satellites have desirable characteristics for mapping large-scale forest structural attributes. However, most studies have used a median composite or single image for analyses. The multi-temporal use of CubeSat data may improve prediction accuracy. This study evaluates the capabilities of PlanetScope CubeSat data to estimate canopy height derived from airborne Light Detection and Ranging (LiDAR) by comparing estimates using Sentinel-2 and Landsat 8 data. Random forest (RF) models using a single composite, multi-seasonal composites, and time-series data were investigated at different spatial resolutions of 3, 10, 20, and 30 m. The highest prediction accuracy was obtained by the PlanetScope multi-seasonal composites at 3 m (relative root mean squared error: 51.3%) and Sentinel-2 multi-seasonal composites at the other spatial resolutions (40.5%, 35.2%, and 34.2% for 10, 20, and 30 m, respectively). The results show that RF models using multi-seasonal composites are 1.4% more accurate than those using harmonic metrics from time-series data in the median. PlanetScope is recommended for canopy height mapping at finer spatial resolutions. However, the unique characteristics of PlanetScope data in a spatial and temporal context should be further investigated for operational forest monitoring.


2019 ◽  
Vol 11 (14) ◽  
pp. 1683 ◽  
Author(s):  
Yangchengsi Zhang ◽  
Long Guo ◽  
Yiyun Chen ◽  
Tiezhu Shi ◽  
Mei Luo ◽  
...  

High-precision maps of soil organic carbon (SOC) are beneficial for managing soil fertility and understanding the global carbon cycle. Digital soil mapping plays an important role in efficiently obtaining the spatial distribution of SOC, which contributes to precision agriculture. However, traditional soil-forming factors (i.e., terrain or climatic factors) have weak variability in low-relief areas, such as plains, and cannot reflect the spatial variation of soil attributes. Meanwhile, vegetation cover hinders the acquisition of the direct information of farmland soil. Thus, useful environmental variables should be utilized for SOC prediction and the digital mapping of such areas. SOC has an important effect on crop growth status, and remote sensing data can record the apparent spectral characteristics of crops. The normalized difference vegetation index (NDVI) is an important index reflecting crop growth and biomass. This study used NDVI time series data rather than traditional soil-forming factors to map SOC. Honghu City, located in the middle of the Jianghan Plain, was selected as the study region, and the NDVI time series data extracted from Landsat 8 were used as the auxiliary variables. SOC maps were estimated through stepwise linear regression (SLR), partial least squares regression (PLSR), support vector machine (SVM), and artificial neural network (ANN). Ordinary kriging (OK) was used as the reference model, while root mean square error of prediction (RMSEP) and coefficient of determination of prediction (R2P) were used to evaluate the model performance. Results showed that SOC had a significant positive correlation in July and August (0.17, 0.29) and a significant negative correlation in January, April, and December (−0.23, −0.27, and −0.23) with NDVI time series data. The best model for SOC prediction was generated by ANN, with the lowest RMSEP of 3.718 and highest R2P of 0.391, followed by SVM (RMSEP = 3.753, R2P = 0.361) and PLSR (RMSEP = 4.087, R2P = 0.283). The SLR model was the worst model, with the lowest R2P of 0.281 and highest RMSEP of 3.930. ANN and SVM were better than OK (RMSEP = 3.727, R2P = 0.372), whereas PLSR and SLR were worse than OK. Moreover, the prediction results using single-data NDVI or short time series NDVI showed low accuracy. The effect of the terrain factor on SOC prediction represented unsatisfactory results. All these results indicated that the NDVI time series data can be used for SOC mapping in plain areas and that the ANN model can maximally extract additional associated information between NDVI time series data and SOC. This study presented an effective method to overcome the selection of auxiliary variables for digital soil mapping in plain areas when the soil was covered with vegetation. This finding indicated that the time series characteristics of NDVI were conducive for predicting SOC in plains.


2020 ◽  
Vol 12 (4) ◽  
pp. 1313
Author(s):  
Leah M. Mungai ◽  
Joseph P. Messina ◽  
Sieglinde Snapp

This study aims to assess spatial patterns of Malawian agricultural productivity trends to elucidate the influence of weather and edaphic properties on Moderate Resolution Imaging Spectroradiometer (MODIS)-Normalized Difference Vegetation Index (NDVI) seasonal time series data over a decade (2006–2017). Spatially-located positive trends in the time series that can’t otherwise be accounted for are considered as evidence of farmer management and agricultural intensification. A second set of data provides further insights, using spatial distribution of farmer reported maize yield, inorganic and organic inputs use, and farmer reported soil quality information from the Malawi Integrated Household Survey (IHS3) and (IHS4), implemented between 2010–2011 and 2016–2017, respectively. Overall, remote-sensing identified areas of intensifying agriculture as not fully explained by biophysical drivers. Further, productivity trends for maize crop across Malawi show a decreasing trend over a decade (2006–2017). This is consistent with survey data, as national farmer reported yields showed low yields across Malawi, where 61% (2010–11) and 69% (2016–17) reported yields as being less than 1000 Kilograms/Hectare. Yields were markedly low in the southern region of Malawi, similar to remote sensing observations. Our generalized models provide contextual information for stakeholders on sustainability of productivity and can assist in targeting resources in needed areas. More in-depth research would improve detection of drivers of agricultural variability.


Sign in / Sign up

Export Citation Format

Share Document