Geospatial Data Streams

2017 ◽  
pp. 217-248
Author(s):  
Zdravko Galić
Keyword(s):  
Data Streams ◽  
Geospatial Data

Geospatial data streams: Formal framework and implementation

2014 ◽  
Vol 91 ◽  
pp. 1-16 ◽  
Author(s):  
Z. Galić ◽  
M. Baranović ◽  
K. Križanović ◽  
E. Mešković
Keyword(s):  
Data Streams ◽  
Geospatial Data ◽  
Formal Framework

scholarly journals TOWARDS THE DEVELOPMENT OF A TAXONOMY FOR VISUALISATION OF STREAMED GEOSPATIAL DATA

2016 ◽  
Vol III-2 ◽  
pp. 129-136 ◽  
Author(s):  
B. H. Sibolla ◽  
T. Van Zyl ◽  
S. Coetzee
Keyword(s):  
Open Source ◽  
Data Streams ◽  
Information Model ◽  
Streaming Data ◽  
Geospatial Data ◽  
Human Interaction ◽  
Two Dimensional ◽  
Design Phase ◽  
Data Visualisation ◽  
Library Development

Geospatial data has very specific characteristics that need to be carefully captured in its visualisation, in order for the user and the viewer to gain knowledge from it. The science of visualisation has gained much traction over the last decade as a response to various visualisation challenges. During the development of an open source based, dynamic two-dimensional visualisation library, that caters for geospatial streaming data, it was found necessary to conduct a review of existing geospatial visualisation taxonomies. The review was done in order to inform the design phase of the library development, such that either an existing taxonomy can be adopted or extended to fit the needs at hand. The major challenge in this case is to develop dynamic two dimensional visualisations that enable human interaction in order to assist the user to understand the data streams that are continuously being updated. This paper reviews the existing geospatial data visualisation taxonomies that have been developed over the years. Based on the review, an adopted taxonomy for visualisation of geospatial streaming data is presented. Example applications of this taxonomy are also provided. The adopted taxonomy will then be used to develop the information model for the visualisation library in a further study.

scholarly journals GEOSPATIAL DATA STREAM PROCESSING IN PYTHON USING FOSS4G COMPONENTS

2016 ◽  
Vol XLI-B7 ◽  
pp. 931-937
Author(s):  
G. McFerren ◽  
T. van Zyl
Keyword(s):  
Data Streams ◽  
Data Model ◽  
Data Stream ◽  
Stream Processing ◽  
Geospatial Data ◽  
Common Data Model ◽  
Spatial Relationships ◽  
Software Components ◽  
Data Stream Processing ◽  
Software Libraries

One viewpoint of current and future IT systems holds that there is an increase in the scale and velocity at which data are acquired and analysed from heterogeneous, dynamic sources. In the earth observation and geoinformatics domains, this process is driven by the increase in number and types of devices that report location and the proliferation of assorted sensors, from satellite constellations to oceanic buoy arrays. Much of these data will be encountered as self-contained messages on data streams - continuous, infinite flows of data. Spatial analytics over data streams concerns the search for spatial and spatio-temporal relationships within and amongst data “on the move”. In spatial databases, queries can assess a store of data to unpack spatial relationships; this is not the case on streams, where spatial relationships need to be established with the incomplete data available. Methods for spatially-based indexing, filtering, joining and transforming of streaming data need to be established and implemented in software components. This article describes the usage patterns and performance metrics of a number of well known FOSS4G Python software libraries within the data stream processing paradigm. In particular, we consider the RTree library for spatial indexing, the Shapely library for geometric processing and transformation and the PyProj library for projection and geodesic calculations over streams of geospatial data. We introduce a message oriented Python-based geospatial data streaming framework called Swordfish, which provides data stream processing primitives, functions, transports and a common data model for describing messages, based on the Open Geospatial Consortium Observations and Measurements (O&M) and Unidata Common Data Model (CDM) standards. We illustrate how the geospatial software components are integrated with the Swordfish framework. Furthermore, we describe the tight temporal constraints under which geospatial functionality can be invoked when processing high velocity, potentially infinite geospatial data streams. The article discusses the performance of these libraries under simulated streaming loads (size, complexity and volume of messages) and how they can be deployed and utilised with Swordfish under real load scenarios, illustrated by a set of Vessel Automatic Identification System (AIS) use cases. We conclude that the described software libraries are able to perform adequately under geospatial data stream processing scenarios - many real application use cases will be handled sufficiently by the software.

Sign in / Sign up

Export Citation Format

Share Document