scholarly journals A Deep Learning Trained Clear-Sky Mask Algorithm for VIIRS Radiometric Bias Assessment

2019 ◽  
Vol 12 (1) ◽  
pp. 78 ◽  
Author(s):  
Xingming Liang ◽  
Quanhua Liu ◽  
Banghua Yan ◽  
Ninghai Sun

Clear-sky mask (CSM) is a crucial influence on the calculating accuracy of the sensor radiometric biases for spectral bands of visible, infrared, and microwave regions. In this study, a fully connected deep neural network (FCDN) was proposed to generate CSM for the Visible Infrared Imaging Radiometer Suite (VIIRS) onboard Suomi National Polar-Orbiting Partnership (S-NPP) and NOAA-20 satellites. The model, well-trained by S-NPP data, was used to generate both S-NPP and NOAA-20 CSMs for the independent data, and the results were validated against the biases between the sensor observations and Community Radiative Transfer Model (CRTM) calculations (O-M). The preliminary result shows that the FCDN-CSM model works well for identifying clear-sky pixels. Both O-M mean biases and standard deviations were comparable with the Advance Clear-Sky Processor over Ocean (ACSPO) and were significantly better than a prototype cloud mask (PCM) and the case without a clear-sky check. In addition, by replacing CRTM brightness temperatures (BTs) with the atmosphere air temperature and water vapor contents as input features, the FCDN-CSM exhibits its potential to generate fast and accurate VIIRS CSM onboard follow-up Joint Polar Satellite System (JPSS) satellites for sensor calibration and validation before the physics-based CSM is available.

2010 ◽  
Vol 27 (10) ◽  
pp. 1609-1623 ◽  
Author(s):  
B. Petrenko ◽  
A. Ignatov ◽  
Y. Kihai ◽  
A. Heidinger

Abstract The Advanced Clear Sky Processor for Oceans (ACSPO) generates clear-sky products, such as SST, clear-sky radiances, and aerosol, from Advanced Very High Resolution Radiometer (AVHRR)-like measurements. The ACSPO clear-sky mask (ACSM) identifies clear-sky pixels within the ACSPO products. This paper describes the ACSM structure and compares the performances of ACSM and its predecessor, Clouds from AVHRR Extended Algorithm (CLAVRx). ACSM essentially employs online clear-sky radiative transfer simulations enabled within ACSPO with the Community Radiative Transfer Model (CRTM) in conjunction with numerical weather prediction atmospheric [Global Forecast System (GFS)] and SST [Reynolds daily high-resolution blended SST (DSST)] fields. The baseline ACSM tests verify the accuracy of fitting observed brightness temperatures with CRTM, check retrieved SST for consistency with Reynolds SST, and identify ambient cloudiness at the boundaries of cloudy systems. Residual cloud effects are screened out with several tests, adopted from CLAVRx, and with the SST spatial uniformity test designed to minimize misclassification of sharp SST gradients as clouds. Cross-platform and temporal consistencies of retrieved SSTs are maintained by accounting for SST and brightness temperature biases, estimated within ACSPO online and independently from ACSM. The performance of ACSM is characterized in terms of statistics of deviations of retrieved SST from the DSST. ACSM increases the amount of “clear” pixels by 30% to 40% and improves statistics of retrieved SST compared with CLAVRx. ACSM is also shown to be capable of producing satisfactory statistics of SST anomalies if the reference SST field for the exact date of observations is unavailable at the time of processing.


2020 ◽  
Vol 12 (20) ◽  
pp. 3279
Author(s):  
Bingkun Luo ◽  
Peter J. Minnett

The Sentinel-3 series satellites belong to the European Earth Observation satellite missions for supporting oceanography, land, and atmospheric studies. The Sea and Land Surface Temperature Radiometer (SLSTR) onboard the Sentinel-3 satellites was designed to provide a significant improvement in remote sensing of skin sea surface temperature (SSTskin). The successful application of SLSTR-derived SSTskin fields depends on their accuracies. Based on sensor-dependent radiative transfer model simulations, geostationary Geostationary Operational Environmental Satellite (GOES-16) Advanced Baseline Imagers (ABI) and Meteosat Second Generation (MSG-4) Spinning Enhanced Visible and Infrared Imager (SEVIRI) brightness temperatures (BT) have been transformed to SLSTR equivalents to permit comparisons at the pixel level in three ocean regions. The results show the averaged BT differences are on the order of 0.1 K and the existence of small biases between them are likely due to the uncertainties in cloud masking, satellite view angle, solar azimuth angle, and reflected solar light. This study demonstrates the feasibility of combining SSTskin retrievals from SLSTR with those of ABI and SEVIRI.


2011 ◽  
Vol 28 (10) ◽  
pp. 1228-1242 ◽  
Author(s):  
Xingming Liang ◽  
Alexander Ignatov

Abstract Monitoring of IR Clear-Sky Radiances over Oceans for SST (MICROS) is a Web-based tool to monitor “model minus observation” (M − O) biases in clear-sky brightness temperatures (BTs) and sea surface temperatures (SSTs) produced by the Advanced Clear-Sky Processor for Oceans (ACSPO). Currently, MICROS monitors M − O biases in three Advanced Very High Resolution Radiometer (AVHRR) bands centered at 3.7, 11, and 12 μm for five satellites, NOAA-16, -17, -18, -19 and Meteorological Operational (MetOp)-A. The fast Community Radiative Transfer Model (CRTM) is employed to simulate clear-sky BTs, using Reynolds SST and National Centers for Environmental Prediction Global Forecast System profiles as input. Simulated BTs are used in ACSPO for improving cloud screening, physical SST inversions, and monitoring and validating satellite BTs. The key MICROS objectives are to fully understand and reconcile CRTM and AVHRR BTs, and to minimize cross-platform biases through improvements to ACSPO algorithms, CRTM and its inputs, satellite radiances, and skin-bulk and diurnal SST modeling. Initially, MICROS was intended for internal use within the National Environmental Satellite, Data, and Information Service (NESDIS) SST team for testing and improving ACSPO products. However, it has quickly outgrown this initial objective and is now used by several research and applications groups. In particular, inclusion of double differences in MICROS has contributed to sensor-to-sensor monitoring within the Global Space-Based Intercalibration System, which is customarily performed using the well-established simultaneous nadir overpass technique. Also, CRTM scientists have made a number of critical improvements to CRTM using MICROS results. They now routinely use MICROS to continuously monitor M − O biases and validate and improve CRTM performance. MICROS is also instrumental in evaluating the accuracy of the first-guess SST and upper-air fields used as input to CRTM. This paper gives examples of these applications and discusses ongoing work and future plans.


2021 ◽  
Vol 13 (2) ◽  
pp. 222
Author(s):  
Xingming Liang ◽  
Quanhua Liu

A fully connected deep neural network (FCDN) clear-sky mask (CSM) algorithm (FCDN_CSM) was developed to assist the FCDN-based Community Radiative Transfer Model (FCDN_CRTM) to reproduce the Visible Infrared Imaging Radiometer Suite (VIIRS) clear-sky radiances in five thermal emission M (TEB/M) bands. The model design was referenced and enhanced from its earlier version (version 1), and was trained and tested in the global ocean clear-sky domain using six dispersion days’ data from 2019 to 2020 as inputs and a modified NOAA Advanced Clear-Sky Processor over Ocean (ACSPO) CSM product as reference labels. The improved FCDN_CSM (version 2) was further enhanced by including daytime data, which was not collected in version 1. The trained model was then employed to predict VIIRS CSM over multiple days in 2020 as an accuracy and stability check. The results were validated against the biases between the sensor observations and CRTM calculations (O-M). The objectives were to (1) enhance FCDN_CSM performance to include daytime analysis, and improve model stability, accuracy, and efficiency; and (2) further understand the model performance based on a combination of the statistics and physical interpretation. According to the analyses of the F-score, the prediction result showed ~96% and ~97% accuracy for day and night, respectively. The type Cloud was the most accurate, followed by Clear-Sky. The O-M mean biases are comparable to the ACSPO CSM for all bands, both day and night. The standard deviations (STD) were slightly degraded in long wave IRs (M14, M15, and M16), mainly due to contamination by a 3% misclassification of the type Cloud, which may require the model to be further fine-tuned to improve prediction accuracy in the future. However, the consistent O-M means and STDs persist throughout the prediction period, suggesting that FCDN_CSM version 2 is robust and does not have significant overfitting. Given its high F-scores, spatial and long-term stability for both day and night, high efficiency, and acceptable O-M means and STDs, FCDN_CSM version 2 is deemed to be ready for use in the FCDN_CRTM.


2016 ◽  
Author(s):  
Anne Garnier ◽  
Noëlle A. Scott ◽  
Jacques Pelon ◽  
Raymond Armante ◽  
Laurent Crépeau ◽  
...  

Abstract. The quality of the calibrated radiances of the medium-resolution Imaging Infrared Radiometer (IIR) on-board the CALIPSO satellite is quantitatively controlled since the beginning of the mission in June 2006. Two complementary “relative” and “stand-alone” approaches are used, which are related to comparisons of measured brightness temperatures, and to model-to-observations comparisons, respectively. In both cases, IIR channels 1 (8.65 μm), 2 (10.6 μm), and 3 (12.05 μm) are paired with MODIS/Aqua “companion” channels 29, 31, and 32, respectively, as well as with SEVIRI/Meteosat companion channels IR8.7, IR10.8 and IR12, respectively. These pairs were selected before launch to meet radiometric, geometric and space-time constraints. The pre-launch studies were based on simulations and sensitivity studies using the 4A/OP radiative transfer model fed with the more than 2300 atmospheres of the climatological TIGR dataset further sorted out in five air mass types. Over the 9.5 years of operation since launch, in a semi-operational process, collocated measurements of IIR and of its companion channels have been compared at all latitudes over ocean, during day and night, and for all types of scenes in a wide range of brightness temperatures when dealing with the relative approach. The relative approach shows an excellent stability of IIR2-MODIS31 and IIR3-MODIS32 brightness temperature differences (BTD) since launch A slight trend of the IIR1-MODIS29 BTD, equal to −0.02 K/year on average over 9.5 years, is detected by the relative approach at all latitudes and all scene temperatures. For the stand-alone approach, clear sky measurements only are considered, which are directly compared with simulations using 4A/OP and collocated ERA-Interim reanalyses. The clear sky mask is derived from collocated observations from IIR and the CALIPSO lidar. Simulations for clear sky pixels in the tropics reproduce the differences between IIR1 and MODIS29 within 0.02 K, and between IIR2 and MODIS31 within 0.04 K, whereas IIR3-MODIS32 is larger than simulated by 0.26 K. The stand-alone approach indicates that the trend identified from the relative approach originates from MODIS29, whereas no trend (less than ±0.004 K/year) is evidenced for any of the IIR channels. Finally, a year-by-year seasonal bias between nighttime and daytime IIR-MODIS BTDs was found at mid-latitude in the northern hemisphere by the relative approach. It is due to a nighttime IIR bias as determined by the stand-alone approach, which originates from a calibration drift during day-to-night transitions. The largest bias is in June/July with IIR2 and IIR3 too warm by 0.4 K on average, and IIR1 too warm by 0.2 K.


2020 ◽  
Vol 12 (22) ◽  
pp. 3825
Author(s):  
Xingming Liang ◽  
Quanhua Liu

A fully connected “deep” neural network algorithm with the Community Radiative Transfer Model (FCDN_CRTM) is proposed to explore the efficiency and accuracy of reproducing the Visible Infrared Imaging Radiometer Suite (VIIRS) radiances in five thermal emission M (TEB/M) bands. The model was trained and tested in the nighttime global ocean clear-sky domain, in which the VIIRS observation minus CRTM (O-M) biases have been well validated in recent years. The atmosphere profile from the European Centre for Medium-Range Weather Forecasts (ECMWF) and sea surface temperature (SST) from the Canadian Meteorology Centre (CMC) were used as FCDN_CRTM input, and the CRTM-simulated brightness temperatures (BTs) were defined as labels. Six dispersion days’ data from 2019 to 2020 were selected to train the FCDN_CRTM, and the clear-sky pixels were identified by an enhanced FCDN clear-sky mask (FCDN_CSM) model, which was demonstrated in Part 1. The trained model was then employed to predict CRTM BTs, which were further validated with the CRTM BTs and the VIIRS sensor data record (SDR) for both efficiency and accuracy. With iterative refinement of the model design and careful treatment of the input data, the agreement between the FCDN_CRTM and the CRTM was generally good, including the satellite zenith angle and column water vapor dependencies. The mean biases of the FCDN_CRTM minus CRTM (F-C) were typically ~0.01 K for all five bands, and the high accuracy persisted during the whole analysis period. Moreover, the standard deviations (STDs) were generally less than 0.1 K and were consistent for approximately half a year, before they significantly degraded. The validation with VIIRS SDR data revealed that both the predicted mean biases and the STD of the VIIRS observation minus FCDN_CRTM (V-F) were comparable with the VIIRS minus direct CRTM simulation (V-C). Meanwhile, both V-F and V-C exhibited consistent global geophysical and statistical distribution, as well as stable long-term performance. Furthermore, the FCDN_CRTM processing time was more than 40 times faster than CRTM simulation. The highly efficient, accurate, and stable performances indicate that the FCDN_CRTM is a potential solution for global and real-time monitoring of sensor observation minus model simulation, particularly for high-resolution sensors.


2017 ◽  
Vol 10 (4) ◽  
pp. 1403-1424 ◽  
Author(s):  
Anne Garnier ◽  
Noëlle A. Scott ◽  
Jacques Pelon ◽  
Raymond Armante ◽  
Laurent Crépeau ◽  
...  

Abstract. The quality of the calibrated radiances of the medium-resolution Imaging Infrared Radiometer (IIR) on-board the CALIPSO (Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation) satellite is quantitatively evaluated from the beginning of the mission in June 2006. Two complementary relative and stand-alone approaches are used, which are related to comparisons of measured brightness temperatures and to model-to-observations comparisons, respectively. In both cases, IIR channels 1 (8.65 µm), 2 (10.6 µm), and 3 (12.05 µm) are paired with the Moderate Resolution Imaging Spectroradiometer (MODIS)/Aqua Collection 5 companion channels 29, 31, and 32, respectively, as well as with the Spinning Enhanced Visible and Infrared Imager (SEVIRI)/Meteosat companion channels IR8.7, IR10.8, and IR12, respectively. These pairs were selected before launch to meet radiometric, geometric, and space-time constraints. The prelaunch studies were based on simulations and sensitivity studies using the 4A/OP radiative transfer model and the more than 2300 atmospheres of the climatological Thermodynamic Initial Guess Retrieval (TIGR) input dataset further sorted into five air mass types. Using data from over 9.5 years of on-orbit operation, and following the relative approach technique, collocated measurements of IIR and of its companion channels have been compared at all latitudes over ocean, during day and night, and for all types of scenes in a wide range of brightness temperatures. The relative approach shows an excellent stability of IIR2–MODIS31 and IIR3–MODIS32 brightness temperature differences (BTDs) since launch. A slight trend within the IIR1–MODIS29 BTD, that equals −0.02 K yr−1 on average over 9.5 years, is detected when using the relative approach at all latitudes and all scene temperatures. For very cold scene temperatures (190–200 K) in the tropics, each IIR channel is warmer than its MODIS companion channel by 1.6 K on average. For the stand-alone approach, clear sky measurements only are considered, which are directly compared with simulations using 4A/OP and collocated ERA-Interim (ERA-I) reanalyses. The clear sky mask is derived from collocated observations from IIR and the CALIPSO lidar. Simulations for clear sky pixels in the tropics reproduce the differences between IIR1 and MODIS29 within 0.02 K and between IIR2 and MODIS31 within 0.04 K, whereas IIR3–MODIS32 is larger than simulated by 0.26 K. The stand-alone approach indicates that the trend identified from the relative approach originates from MODIS29, whereas no trend (less than ±0.004 K yr−1) is identified for any of the IIR channels. Finally, using the relative approach, a year-by-year seasonal bias between nighttime and daytime IIR–MODIS BTD was found at mid-latitude in the Northern Hemisphere. It is due to a nighttime IIR bias as determined by the stand-alone approach, which originates from a calibration drift during day-to-night transitions. The largest bias is in June and July when IIR2 and IIR3 are warmer by 0.4 K on average, and IIR1 is warmer by 0.2 K.


2014 ◽  
Vol 31 (11) ◽  
pp. 2522-2529
Author(s):  
Quanhua Liu ◽  
Alexander Ignatov ◽  
Fuzhong Weng ◽  
XingMing Liang

AbstractOperational sea surface temperature (SST) retrieval algorithms are stratified into nighttime and daytime. The nighttime algorithm uses two split-window Visible Infrared Imaging Radiometer Suite (VIIRS) bands—M15 and M16, centered at ~11 and ~12 m, respectively—and a shortwave infrared band—M12, centered at ~3.7 m. The M12 is most transparent and critical for accurate SST retrievals. However, it is not used during the daytime because of contamination by solar radiation, which is reflected by the ocean surface and scattered by atmospheric aerosols. As a result, daytime VIIRS SST and cloud mask products and applications are degraded and inconsistent with their nighttime counterparts. This study proposes a method to remove the solar contamination from the VIIRS M12 based on theoretical radiative transfer model analyses. The method uses either of the two VIIRS shortwave bands, centered at 1.6 m (M10) or 2.25 m (M11), to correct for the effect of solar reflectance in M12. Subsequently, the corrected daytime brightness temperature in M12 can be used as input into nighttime cloud mask and SST algorithms. Preliminary comparisons with the European Centre for Medium-Range Weather Forecasts (ECMWF) SST analysis suggest that the daytime SST products can be improved and potentially reconciled with the nighttime SST product. However, more substantial case studies and assessments using different SST products are required before the transition of this research work into operational products.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Qinghong Zeng ◽  
Shengbo Chen ◽  
Yuanzhi Zhang ◽  
Yongling Mu ◽  
Rui Dai ◽  
...  

AbstractWe report on the mineralogical and chemical properties of materials investigated by the lunar rover Yutu-2, which landed on the Von Kármán crater in the pre-Nectarian South Pole–Aitken (SPA) basin. Yutu-2 carried several scientific payloads, including the Visible and Near-infrared Imaging Spectrometer (VNIS), which is used for mineral identification, offering insights into lunar evolution. We used 86 valid VNIS data for 21 lunar days, with mineral abundance obtained using the Hapke radiative transfer model and sparse unmixing algorithm and chemical compositions empirically estimated. The mineralogical properties of the materials at the Chang’E-4 (CE-4) site referred to as norite/gabbro, based on findings of mineral abundance, indicate that they may be SPA impact melt components excavated by a surrounding impact crater. We find that CE-4 materials are dominated by plagioclase and pyroxene and feature little olivine, with 50 of 86 observations showing higher LCP than HCP in pyroxene. In view of the effects of space weathering, olivine content may be underestimated, with FeO and TiO2 content estimated using the maturity-corrected method. Estimates of chemical content are 7.42–18.82 wt% FeO and 1.48–2.1 wt% TiO2, with a low-medium Mg number (Mg # ~ 55). Olivine-rich materials are not present at the CE-4 landing site, based on the low-medium Mg #. Multi-origin materials at the CE-4 landing site were analyzed with regard to concentrations of FeO and TiO2 content, supporting our conclusion that the materials at CE-4 do not have a single source but rather are likely a mixture of SPA impact melt components excavated by surrounding impact crater and volcanic product ejecta.


2009 ◽  
Vol 48 (11) ◽  
pp. 2284-2294 ◽  
Author(s):  
Eui-Seok Chung ◽  
Brian J. Soden

Abstract Consistency of upper-tropospheric water vapor measurements from a variety of state-of-the-art instruments was assessed using collocated Geostationary Operational Environmental Satellite-8 (GOES-8) 6.7-μm brightness temperatures as a common benchmark during the Atmospheric Radiation Measurement Program (ARM) First International Satellite Cloud Climatology Project (ISCCP) Regional Experiment (FIRE) Water Vapor Experiment (AFWEX). To avoid uncertainties associated with the inversion of satellite-measured radiances into water vapor quantity, profiles of temperature and humidity observed from in situ, ground-based, and airborne instruments are inserted into a radiative transfer model to simulate the brightness temperature that the GOES-8 would have observed under those conditions (i.e., profile-to-radiance approach). Comparisons showed that Vaisala RS80-H radiosondes and Meteolabor Snow White chilled-mirror dewpoint hygrometers are systemically drier in the upper troposphere by ∼30%–40% relative to the GOES-8 measured upper-tropospheric humidity (UTH). By contrast, two ground-based Raman lidars (Cloud and Radiation Test Bed Raman lidar and scanning Raman lidar) and one airborne differential absorption lidar agree to within 10% of the GOES-8 measured UTH. These results indicate that upper-tropospheric water vapor can be monitored by these lidars and well-calibrated, stable geostationary satellites with an uncertainty of less than 10%, and that correction procedures are required to rectify the inherent deficiencies of humidity measurements in the upper troposphere from these radiosondes.


Sign in / Sign up

Export Citation Format

Share Document