Code Generation for Distributed-Memory Architectures

2015 ◽  
pp. bxv077
Author(s):  
Jie Zhao ◽  
Rongcai Zhao ◽  
Jinchen Xu
Keyword(s):  
Code Generation ◽  
Distributed Memory ◽  
Memory Architectures

Implementing actor-based primitives on distributed-memory architectures

1991 ◽  
Vol 2 (2) ◽  
pp. 45-49 ◽  
Author(s):  
Michele Di Santo ◽  
Giulio Iannello
Keyword(s):  
Distributed Memory ◽  
Memory Architectures

scholarly journals An O(log2N) Fully-Balanced Resampling Algorithm for Particle Filters on Distributed Memory Architectures

Algorithms ◽  
2021 ◽  
Vol 14 (12) ◽  
pp. 342
Author(s):  
Alessandro Varsi ◽  
Simon Maskell ◽  
Paul G. Spirakis
Keyword(s):  
Parallel Computing ◽  
Shared Memory ◽  
Time Complexity ◽  
Distributed Memory ◽  
Particle Filters ◽  
Dynamic Models ◽  
State Of The Art ◽  
Novel Approach ◽  
Non Gaussian ◽  
Memory Architectures

Resampling is a well-known statistical algorithm that is commonly applied in the context of Particle Filters (PFs) in order to perform state estimation for non-linear non-Gaussian dynamic models. As the models become more complex and accurate, the run-time of PF applications becomes increasingly slow. Parallel computing can help to address this. However, resampling (and, hence, PFs as well) necessarily involves a bottleneck, the redistribution step, which is notoriously challenging to parallelize if using textbook parallel computing techniques. A state-of-the-art redistribution takes O((log2N)2) computations on Distributed Memory (DM) architectures, which most supercomputers adopt, whereas redistribution can be performed in O(log2N) on Shared Memory (SM) architectures, such as GPU or mainstream CPUs. In this paper, we propose a novel parallel redistribution for DM that achieves an O(log2N) time complexity. We also present empirical results that indicate that our novel approach outperforms the O((log2N)2) approach.

Sign in / Sign up

Export Citation Format

Share Document