The effect of limited network bandwidth and its utilization by latency hiding techniques in large-scale shared memory systems

Author(s):  
Sunil Kim ◽  
A.V. Veidenbaum
2017 ◽  
Vol 9 (1) ◽  
Author(s):  
Jiping Liu ◽  
Xiaochen Kang ◽  
Chun Dong ◽  
Shenghua Xu

AbstractSurface area estimation is a widely used tool for resource evaluation in the physical world. When processing large scale spatial data, the input/output (I/O) can easily become the bottleneck in parallelizing the algorithm due to the limited physical memory resources and the very slow disk transfer rate. In this paper, we proposed a stream tilling approach to surface area estimation that first decomposed a spatial data set into tiles with topological expansions. With these tiles, the one-to-one mapping relationship between the input and the computing process was broken. Then, we realized a streaming framework towards the scheduling of the I/O processes and computing units. Herein, each computing unit encapsulated a same copy of the estimation algorithm, and multiple asynchronous computing units could work individually in parallel. Finally, the performed experiment demonstrated that our stream tilling estimation can efficiently alleviate the heavy pressures from the I/O-bound work, and the measured speedup after being optimized have greatly outperformed the directly parallel versions in shared memory systems with multi-core processors.


Author(s):  
Isaac Sánchez Barrera ◽  
Miquel Moretó ◽  
Eduard Ayguadé ◽  
Jesús Labarta ◽  
Mateo Valero ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document