scholarly journals ARGUS: Efficient Scalable Continuous Query Optimization for Large-Volume Data Streams

2006 ◽  
Author(s):  
Chun Jin ◽  
Jaime Carbonell
Keyword(s):  
Query Optimization ◽  
Large Volume ◽  
Data Streams ◽  
Continuous Query ◽  
Volume Data

scholarly journals Query Rewriting for Incremental Continuous Query Evaluation in HIFUN

Algorithms ◽  
2021 ◽  
Vol 14 (5) ◽  
pp. 149
Author(s):  
Petros Zervoudakis ◽  
Haridimos Kondylakis ◽  
Nicolas Spyratos ◽  
Dimitris Plexousakis
Keyword(s):  
Query Optimization ◽  
Query Language ◽  
Computational Cost ◽  
Continuous Queries ◽  
Continuous Query ◽  
Query Rewriting ◽  
Query Evaluation ◽  
Clear Separation ◽  
Complete Dataset ◽  
High Level

HIFUN is a high-level query language for expressing analytic queries of big datasets, offering a clear separation between the conceptual layer, where analytic queries are defined independently of the nature and location of data, and the physical layer, where queries are evaluated. In this paper, we present a methodology based on the HIFUN language, and the corresponding algorithms for the incremental evaluation of continuous queries. In essence, our approach is able to process the most recent data batch by exploiting already computed information, without requiring the evaluation of the query over the complete dataset. We present the generic algorithm which we translated to both SQL and MapReduce using SPARK; it implements various query rewriting methods. We demonstrate the effectiveness of our approach in temrs of query answering efficiency. Finally, we show that by exploiting the formal query rewriting methods of HIFUN, we can further reduce the computational cost, adding another layer of query optimization to our implementation.

Composite Event Processing for Data Streams and Domain Knowledge

2011 ◽  
Vol 219-220 ◽  
pp. 927-931
Author(s):  
Jun Qiang Liu ◽  
Xiao Ling Guan
Keyword(s):  
Query Optimization ◽  
Data Streams ◽  
Domain Knowledge ◽  
Semantic Information ◽  
Query Language ◽  
Processing System ◽  
Optimization Techniques ◽  
Research Attention ◽  
Composite Event ◽  
Solid Foundation

In recent years the processing of composite event queries over data streams has attracted a lot of research attention. Traditional database techniques were not designed for stream processing system. Furthermore, example continuous queries are often formulated in declarative query language without specifying the semantics. To overcome these deficiencies, this article presents the design, implementation, and evaluation of a system that executes data streams with semantic information. Then, a set of optimization techniques are proposed for handling query. So, our approach not only makes it possible to express queries with a sound semantics, but also provides a solid foundation for query optimization. Experiment results show that our approach is effective and efficient for data streams and domain knowledge.

scholarly journals Interactive Visualization and On-Demand Processing of Large Volume Data: A Fully GPU-Based Out-of-Core Approach

2020 ◽  
Vol 26 (10) ◽  
pp. 3008-3021 ◽  
Author(s):  
Jonathan Sarton ◽  
Nicolas Courilleau ◽  
Yannick Remion ◽  
Laurent Lucas
Keyword(s):  
Large Volume ◽  
Interactive Visualization ◽  
Volume Data ◽  
On Demand

APPHi: An automated photometry pipeline for high cadence, large volume data

2019 ◽  
Vol 26 ◽  
pp. 1-13 ◽  
Author(s):  
E. Sánchez ◽  
J.H. Castro-Chacón ◽  
J.S. Silva ◽  
J.B. Hernández-Águila ◽  
M. Reyes-Ruiz ◽  
...  
Keyword(s):  
Large Volume ◽  
Volume Data ◽  
High Cadence
Sign in / Sign up

Export Citation Format

Share Document