A-DSP: An Adaptive Join Algorithm for Dynamic Data Stream on Cloud System

2020 ◽  
pp. 1-1
Author(s):  
Junhua Fang ◽  
Rong Zhang ◽  
Yan Zhao ◽  
Kai Zheng ◽  
Xiaofang Zhou ◽  
...  
Keyword(s):  
Data Stream ◽  
Cloud System ◽  
Dynamic Data ◽  
Join Algorithm

scholarly journals HYBRIDJOIN for Near-Real-Time Data Warehousing

2011 ◽  
Vol 7 (4) ◽  
pp. 21-42 ◽  
Author(s):  
M. Asif Naeem ◽  
Gillian Dobbie ◽  
Gerald Weber
Keyword(s):  
Real Time ◽  
Data Stream ◽  
Time Integration ◽  
Synthetic Data ◽  
Performance Measurements ◽  
Time Data ◽  
Join Algorithm ◽  
Real Time Data ◽  
Set Up ◽  
Nested Loop

An important component of near-real-time data warehouses is the near-real-time integration layer. One important element in near-real-time data integration is the join of a continuous input data stream with a disk-based relation. For high-throughput streams, stream-based algorithms, such as Mesh Join (MESHJOIN), can be used. However, in MESHJOIN the performance of the algorithm is inversely proportional to the size of disk-based relation. The Index Nested Loop Join (INLJ) can be set up so that it processes stream input, and can deal with intermittences in the update stream but it has low throughput. This paper introduces a robust stream-based join algorithm called Hybrid Join (HYBRIDJOIN), which combines the two approaches. A theoretical result shows that HYBRIDJOIN is asymptotically as fast as the fastest of both algorithms. The authors present performance measurements of the implementation. In experiments using synthetic data based on a Zipfian distribution, HYBRIDJOIN performs significantly better for typical parameters of the Zipfian distribution, and in general performs in accordance with the theoretical model while the other two algorithms are unacceptably slow under different settings.

Design and Implementation of Driving Mechanism on Software Aerospace Measurement and Control System

2014 ◽  
Vol 989-994 ◽  
pp. 3084-3087
Author(s):  
Gang Fu ◽  
Ming Xin Kou ◽  
Ren Long Li
Keyword(s):  
Signal Processing ◽  
Control System ◽  
Data Stream ◽  
Driving Mechanism ◽  
Processing Unit ◽  
Dynamic Data ◽  
Measurement And Control System ◽  
And Control ◽  
Measurement And Control ◽  
Signal Processing Unit

According to the signal processing unit in aerospace measurement and control system between the flow of water features, this paper proposes a software suitable for aerospace measurement and control system of driving mechanism. This paper first introduces the basic structure of aerospace measurement and control system software, having studied the static and dynamic data stream driving mechanism on the basis of detailed discusses the design and implementation process of this kind of driving mechanism of data stream. It adopts the method of message control, according to the dynamic data flow driven mechanism, realize the process of the signal processing unit and each signal processing unit between the data flow between the internal thread. Compared the same sort of dynamic data stream driving mechanism, the drive mechanism possesses the advantages of flexibility and easy to implement.

Sign in / Sign up

Export Citation Format

Share Document