scholarly journals Scene understanding with discriminative structured prediction

2008 ◽  
Author(s):  
Jinhui Yuan ◽  
Jianmin Li ◽  
Bo Zhang
Keyword(s):  
Scene Understanding ◽  
Structured Prediction

Neuroscience-Enabled Complex Visual Scene Understanding

2012 ◽  
Author(s):  
Laurent Itti ◽  
Nader Noori ◽  
Lior Elazary
Keyword(s):  
Scene Understanding ◽  
Visual Scene ◽  
Visual Scene Understanding

Semantic Relation Model and Dataset for Remote Sensing Scene Understanding

2021 ◽  
Vol 10 (7) ◽  
pp. 488
Author(s):  
Peng Li ◽  
Dezheng Zhang ◽  
Aziguli Wulamu ◽  
Xin Liu ◽  
Peng Chen
Keyword(s):  
Remote Sensing ◽  
Scene Understanding ◽  
Deep Understanding ◽  
Remote Sensing Images ◽  
Convolutional Network ◽  
Scene Graph ◽  
Multi Scale ◽  
Relationship Extraction ◽  
High Level ◽  
Graph Generation

A deep understanding of our visual world is more than an isolated perception on a series of objects, and the relationships between them also contain rich semantic information. Especially for those satellite remote sensing images, the span is so large that the various objects are always of different sizes and complex spatial compositions. Therefore, the recognition of semantic relations is conducive to strengthen the understanding of remote sensing scenes. In this paper, we propose a novel multi-scale semantic fusion network (MSFN). In this framework, dilated convolution is introduced into a graph convolutional network (GCN) based on an attentional mechanism to fuse and refine multi-scale semantic context, which is crucial to strengthen the cognitive ability of our model Besides, based on the mapping between visual features and semantic embeddings, we design a sparse relationship extraction module to remove meaningless connections among entities and improve the efficiency of scene graph generation. Meanwhile, to further promote the research of scene understanding in remote sensing field, this paper also proposes a remote sensing scene graph dataset (RSSGD). We carry out extensive experiments and the results show that our model significantly outperforms previous methods on scene graph generation. In addition, RSSGD effectively bridges the huge semantic gap between low-level perception and high-level cognition of remote sensing images.

scholarly journals Semantics-Driven Remote Sensing Scene Understanding Framework for Grounded Spatio-Contextual Scene Descriptions

2021 ◽  
Vol 10 (1) ◽  
pp. 32
Author(s):  
Abhishek V. Potnis ◽  
Surya S. Durbha ◽  
Rajat C. Shinde
Keyword(s):  
Remote Sensing ◽  
Domain Knowledge ◽  
Situational Awareness ◽  
Scene Understanding ◽  
Graph Representation ◽  
Observation Data ◽  
Test Scenario ◽  
Semantic Web Technologies ◽  
Earth Observation Data ◽  
Contextual Domain

Earth Observation data possess tremendous potential in understanding the dynamics of our planet. We propose the Semantics-driven Remote Sensing Scene Understanding (Sem-RSSU) framework for rendering comprehensive grounded spatio-contextual scene descriptions for enhanced situational awareness. To minimize the semantic gap for remote-sensing-scene understanding, the framework puts forward the transformation of scenes by using semantic-web technologies to Remote Sensing Scene Knowledge Graphs (RSS-KGs). The knowledge-graph representation of scenes has been formalized through the development of a Remote Sensing Scene Ontology (RSSO)—a core ontology for an inclusive remote-sensing-scene data product. The RSS-KGs are enriched both spatially and contextually, using a deductive reasoner, by mining for implicit spatio-contextual relationships between land-cover classes in the scenes. The Sem-RSSU, at its core, constitutes novel Ontology-driven Spatio-Contextual Triple Aggregation and realization algorithms to transform KGs to render grounded natural language scene descriptions. Considering the significance of scene understanding for informed decision-making from remote sensing scenes during a flood, we selected it as a test scenario, to demonstrate the utility of this framework. In that regard, a contextual domain knowledge encompassing Flood Scene Ontology (FSO) has been developed. Extensive experimental evaluations show promising results, further validating the efficacy of this framework.

scholarly journals Understanding Natural Disaster Scenes from Mobile Images Using Deep Learning

2021 ◽  
Vol 11 (9) ◽  
pp. 3952
Author(s):  
Shimin Tang ◽  
Zhiqiang Chen
Keyword(s):  
Deep Learning ◽  
Natural Disaster ◽  
Scene Understanding ◽  
Computing Methods ◽  
Classification Model ◽  
Learning Approach ◽  
Learning Models ◽  
Damage Level ◽  
Feature Extractor ◽  
Mobile Imaging

With the ubiquitous use of mobile imaging devices, the collection of perishable disaster-scene data has become unprecedentedly easy. However, computing methods are unable to understand these images with significant complexity and uncertainties. In this paper, the authors investigate the problem of disaster-scene understanding through a deep-learning approach. Two attributes of images are concerned, including hazard types and damage levels. Three deep-learning models are trained, and their performance is assessed. Specifically, the best model for hazard-type prediction has an overall accuracy (OA) of 90.1%, and the best damage-level classification model has an explainable OA of 62.6%, upon which both models adopt the Faster R-CNN architecture with a ResNet50 network as a feature extractor. It is concluded that hazard types are more identifiable than damage levels in disaster-scene images. Insights are revealed, including that damage-level recognition suffers more from inter- and intra-class variations, and the treatment of hazard-agnostic damage leveling further contributes to the underlying uncertainties.

Sign in / Sign up

Export Citation Format

Share Document