scholarly journals Understanding the Effects of Optimal Combination of Spectral Bands on Deep Learning Model Predictions: A Case Study Based on Permafrost Tundra Landform Mapping Using High Resolution Multispectral Satellite Imagery

2020 ◽  
Vol 6 (9) ◽  
pp. 97 ◽  
Author(s):  
Md Abul Ehsan Bhuiyan ◽  
Chandi Witharana ◽  
Anna K. Liljedahl ◽  
Benjamin M. Jones ◽  
Ronald Daanen ◽  
...  
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Satellite Imagery ◽  
Statistical Measures ◽  
Everyday Object ◽  
Model Predictions ◽  
The Impact ◽  
Band Combinations ◽  
Spectral Channels

Deep learning (DL) convolutional neural networks (CNNs) have been rapidly adapted in very high spatial resolution (VHSR) satellite image analysis. DLCNN-based computer visions (CV) applications primarily aim for everyday object detection from standard red, green, blue (RGB) imagery, while earth science remote sensing applications focus on geo object detection and classification from multispectral (MS) imagery. MS imagery includes RGB and narrow spectral channels from near- and/or middle-infrared regions of reflectance spectra. The central objective of this exploratory study is to understand to what degree MS band statistics govern DLCNN model predictions. We scaffold our analysis on a case study that uses Arctic tundra permafrost landform features called ice-wedge polygons (IWPs) as candidate geo objects. We choose Mask RCNN as the DLCNN architecture to detect IWPs from eight-band Worldview-02 VHSR satellite imagery. A systematic experiment was designed to understand the impact on choosing the optimal three-band combination in model prediction. We tasked five cohorts of three-band combinations coupled with statistical measures to gauge the spectral variability of input MS bands. The candidate scenes produced high model detection accuracies for the F1 score, ranging between 0.89 to 0.95, for two different band combinations (coastal blue, blue, green (1,2,3) and green, yellow, red (3,4,5)). The mapping workflow discerned the IWPs by exhibiting low random and systematic error in the order of 0.17–0.19 and 0.20–0.21, respectively, for band combinations (1,2,3). Results suggest that the prediction accuracy of the Mask-RCNN model is significantly influenced by the input MS bands. Overall, our findings accentuate the importance of considering the image statistics of input MS bands and careful selection of optimal bands for DLCNN predictions when DLCNN architectures are restricted to three spectral channels.

Social Distancing Using AI and Deep Learning

2021 ◽  
Vol 9 (VII) ◽  
pp. 1816-1822
Author(s):  
Mr. Kiran Mudaraddi
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Open Source ◽  
Suggested Method ◽  
Video Frame ◽  
Social Distancing ◽  
The Social ◽  
The Impact

The paper presents a deep learning-based methodology for detecting social distancing in order to assess the distance between people in order to mitigate the impact of the coronavirus pandemic. The input was a video frame from the camera, and the open-source object detection was pre-trained. The outcome demonstrates that the suggested method is capable of determining the social distancing measures between many participants in a video.

scholarly journals Numerical simulations of June 7, 2020 convective precipitation over Slovakia using deterministic, probabilistic, and convection-permitting approaches

Időjárás ◽  
2021 ◽  
Vol 125 (4) ◽  
pp. 571-607
Author(s):  
André Simon ◽  
Martin Belluš ◽  
Katarína Čatlošová ◽  
Mária Derková ◽  
Martin Dian ◽  
...  
Keyword(s):  
Satellite Imagery ◽  
Weather Prediction ◽  
Severe Weather ◽  
Precipitation Forecast ◽  
Convective Precipitation ◽  
Small Scale ◽  
Limited Area ◽  
Systematic Effect ◽  
The Impact

The paper presented is dedicated to the evaluation of the influence of various improvements to the numerical weather prediction (NWP) systems exploited at the Slovak Hydrometeorological Institute (SHMÚ). The impact was illustrated in a case study with multicell thunderstorms and the results were confronted with the reference analyses from the INCA nowcasting system, regional radar reflectivity data, and METEOSAT satellite imagery. The convective cells evolution was diagnosed in non-hydrostatic dynamics experiments to study weak mesoscale vortices and updrafts. The growth of simulated clouds and evolution of the temperature at their top were compared with the brightness temperature analyzed from satellite imagery. The results obtained indicated the potential for modeling and diagnostics of small-scale structures within the convective cloudiness, which could be related to severe weather. Furthermore, the non-hydrostatic dynamics experiments related to the stability and performance improvement of the time scheme led to the formulation of a new approach to linear operator definition for semi-implicit scheme (in text referred as NHHY). We demonstrate that the execution efficiency has improved by more than 20%. The exploitation of several high resolution measurement types in data assimilation contributed to more precise position of predicted patterns and precipitation representation in the case study. The non-hydrostatic dynamics provided more detailed structures. On the other hand, the potential of a single deterministic forecast of prefrontal heavy precipitation was not as high as provided by the ensemble system. The prediction of a regional ensemble system A-LAEF (ALARO Limited Area Ensemble Forecast) enhanced the localization of precipitation patterns. Though, this was rather due to the simulation of uncertainty in the initial conditions and also because of the stochastic perturbation of physics tendencies. The various physical parameterization setups of A-LAEF members did not exhibit a systematic effect on precipitation forecast in the evaluated case. Moreover, the ensemble system allowed an estimation of uncertainty in a rapidly developing severe weather case, which was high even at very short range.

scholarly journals Achieving 90% In Data-Centric Industry Deep Learning Task

2021 ◽  
Author(s):  
Tong Guo
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Noisy Data ◽  
Learning Task ◽  
Simple Method ◽  
Sequence Generation ◽  
Learning Tasks ◽  
Human Evaluation ◽  
Model Predictions ◽  
Click Through Rate

In industry deep learning application, our manually labeled data has a certain number of noisy data. To solve this problem and achieve more than 90 score in dev dataset, we present a simple method to find the noisy data and re-label the noisy data by human, given the model predictions as references in human labeling. In this paper, we illustrate our idea for a broad set of deep learning tasks, includes classification, sequence tagging, object detection, sequence generation, click-through rate prediction. The experimental results and human evaluation results verify our idea.

scholarly journals Object Detection and Image Segmentation with Deep Learning on Earth Observation Data: A Review—Part II: Applications

2020 ◽  
Vol 12 (18) ◽  
pp. 3053 ◽  
Author(s):  
Thorsten Hoeser ◽  
Felix Bachofer ◽  
Claudia Kuenzer
Keyword(s):  
Image Segmentation ◽  
Deep Learning ◽  
Object Detection ◽  
Land Surface ◽  
Large Scale ◽  
Earth Observation ◽  
Observation Data ◽  
Fine Grained ◽  
The Impact ◽  
Object Dynamics

In Earth observation (EO), large-scale land-surface dynamics are traditionally analyzed by investigating aggregated classes. The increase in data with a very high spatial resolution enables investigations on a fine-grained feature level which can help us to better understand the dynamics of land surfaces by taking object dynamics into account. To extract fine-grained features and objects, the most popular deep-learning model for image analysis is commonly used: the convolutional neural network (CNN). In this review, we provide a comprehensive overview of the impact of deep learning on EO applications by reviewing 429 studies on image segmentation and object detection with CNNs. We extensively examine the spatial distribution of study sites, employed sensors, used datasets and CNN architectures, and give a thorough overview of applications in EO which used CNNs. Our main finding is that CNNs are in an advanced transition phase from computer vision to EO. Upon this, we argue that in the near future, investigations which analyze object dynamics with CNNs will have a significant impact on EO research. With a focus on EO applications in this Part II, we complete the methodological review provided in Part I.

scholarly journals Using Satellite Imagery and Deep Learning to Evaluate the Impact of Anti-Poverty Programs

2021 ◽  
Author(s):  
Luna Yue Huang ◽  
Solomon Hsiang ◽  
Marco Gonzalez-Navarro
Keyword(s):  
Deep Learning ◽  
Satellite Imagery ◽  
The Impact

Improving multi-class Boosting-based object detection

2020 ◽  
Vol 28 (1) ◽  
pp. 81-96
Author(s):  
José Miguel Buenaposada ◽  
Luis Baumela
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Data Augmentation ◽  
Detection Performance ◽  
Significant Progress ◽  
Training Techniques ◽  
Multi Scale ◽  
Bounding Box ◽  
Open Issue ◽  
The Impact

In recent years we have witnessed significant progress in the performance of object detection in images. This advance stems from the use of rich discriminative features produced by deep models and the adoption of new training techniques. Although these techniques have been extensively used in the mainstream deep learning-based models, it is still an open issue to analyze their impact in alternative, and computationally more efficient, ensemble-based approaches. In this paper we evaluate the impact of the adoption of data augmentation, bounding box refinement and multi-scale processing in the context of multi-class Boosting-based object detection. In our experiments we show that use of these training advancements significantly improves the object detection performance.

scholarly journals Detection of acne by deep learning object detection

2021 ◽  
Author(s):  
Amandip Sangha ◽  
Mohammad Rizvi
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
State Of The Art ◽  
Average Precision ◽  
Single Class ◽  
Data Set ◽  
Detection Model ◽  
Model Predictions ◽  
Deep Learning Model ◽  
Facial Acne

AbstractImportanceState-of-the art performance is achieved with a deep learning object detection model for acne detection. There is little current research on object detection in dermatology and acne in particular. As such, this work is early in this field and achieves state of the art performance.ObjectiveTrain an object detection model on a publicly available data set of acne photos.Design, Setting, and ParticipantsA deep learning model is trained with cross validation on a data set of facial acne photos.Main Outcomes and MeasuresObject detection models for detecting acne for single-class (acne) and multi-class (four severity levels). We train and evaluate the models using standard metrics such as mean average precision (mAP). Then we manually evaluate the model predictions on the test set, and calculate accuracy in terms of precision, recall, F1, true and false positive and negative detections.ResultsWe achieve state-of-the art mean average precision [email protected] value of 37.97 for the single class acne detection task, and 26.50 for the 4-class acne detection task. Moreover, our manual evaluation shows that the single class detection model performs well on the validation set, achieving true positive 93.59 %, precision 96.45 % and recall 94.73 %.Conclusions and RelevanceWe are able to train a high-accuracy acne detection model using only a small publicly available data set of facial acne. Transfer learning on the pre-trained deep learning model yields good accuracy and high degree of transferability to patient submitted photographs. We also note that the training of standard architecture object detection models has given significantly better accuracy than more intricate and bespoke neural network architectures in the existing research literature.Key PointsQuestionCan deep learning-based acne detection models trained on a small data set of publicly available photos of patients with acne achieve high prediction accuracy?FindingsWe find that it is possible to train a reasonably good object detection model on a small, annotated data set of acne photos using standard deep learning architectures.MeaningDeep learning-based object detection models for acne detection can be a useful decision support tools for dermatologists treating acne patients in a digital clinical practice. It can prove a particularly useful tool for monitoring the time evolution of the acne disease state over prolonged time during follow-ups, as the model predictions give a quantifiable and comparable output for photographs over time. This is particularly helpful in teledermatological consultations, as a prediction model can be integrated in the patient-doctor remote communication.

Sign in / Sign up

Export Citation Format

Share Document