Duplicate detection in pay-per-click streams using temporal stateful Bloom filters

Chamila Walgampaya; Mehmed Kantardzic; Brent Wenerstrom

doi:10.1504/ijdats.2012.050405

Duplicate detection in pay-per-click streams using temporal stateful Bloom filters

International Journal of Data Analysis Techniques and Strategies ◽

10.1504/ijdats.2012.050405 ◽

2012 ◽

Vol 4 (4) ◽

pp. 340 ◽

Cited By ~ 2

Author(s):

Chamila Walgampaya ◽

Mehmed Kantardzic ◽

Brent Wenerstrom

Keyword(s):

Bloom Filters ◽

Duplicate Detection

Download Full-text

Advanced Algorithms for Efcient Approximate Duplicate Detection in Data Streams Using Bloom Filters

Large Scale and Big Data ◽

10.1201/b17112-17 ◽

2014 ◽

pp. 424-449

Keyword(s):

Data Streams ◽

Bloom Filters ◽

Duplicate Detection

Download Full-text

THE PROBLEM OF PROVIDING CACHE COHERENCE IN MULTIPROCESSOR SYSTEMS WITH MANY PROCESSORS

Issues of radio electronics ◽

10.21778/2218-5453-2018-5-47-53 ◽

2018 ◽

pp. 47-53

Author(s):

B. Z. Shmeylin ◽

E. A. Alekseeva

Keyword(s):

Cache Coherence ◽

Bloom Filters ◽

Multiprocessor Systems ◽

Cache Line ◽

Maintenance Systems ◽

Processor Caches ◽

Conventional Systems ◽

Additional Hardware

In this paper the tasks of managing the directory in coherence maintenance systems in multiprocessor systems with a large number of processors are solved. In microprocessor systems with a large number of processors (MSLP) the problem of maintaining the coherence of processor caches is significantly complicated. This is due to increased traffic on the memory buses and increased complexity of interprocessor communications. This problem is solved in various ways. In this paper, we propose the use of Bloom filters used to accelerate the determination of an element’s belonging to a certain array. In this article, such filters are used to establish the fact that the processor belongs to some subset of the processors and determine if the processor has a cache line in the set. In the paper, the processes of writing and reading information in the data shared between processors are discussed in detail, as well as the process of data replacement from private caches. The article also shows how the addresses of cache lines and processor numbers are removed from the Bloom filters. The system proposed in this paper allows significantly speeding up the implementation of operations to maintain cache coherence in the MSLP as compared to conventional systems. In terms of performance and additional hardware and software costs, the proposed system is not inferior to the most efficient of similar systems, but on some applications and significantly exceeds them.

Download Full-text