π-Hub: Large-scale video learning, storage, and retrieval on heterogeneous hardware platforms

2020 ◽  
Vol 102 ◽  
pp. 514-523
Author(s):  
Jie Tang ◽  
Shaoshan Liu ◽  
Jie Cao ◽  
Dawei Sun ◽  
Bolin Ding ◽  
...  
Keyword(s):  
Large Scale ◽  
Storage And Retrieval ◽  
Heterogeneous Hardware ◽  
Hardware Platforms

Transitioning Spiking Neural Network Simulators to Heterogeneous Hardware

2021 ◽  
Vol 31 (2) ◽  
pp. 1-26
Author(s):  
Quang Anh Pham Nguyen ◽  
Philipp Andelfinger ◽  
Wen Jun Tan ◽  
Wentong Cai ◽  
Alois Knoll
Keyword(s):  
Large Scale ◽  
Simulation Models ◽  
Performance Model ◽  
Model Code ◽  
Code Base ◽  
Heterogeneous Hardware ◽  
Computationally Intensive ◽  
The Many ◽  
Many Core ◽  
Hardware Platforms

Spiking neural networks (SNN) are among the most computationally intensive types of simulation models, with node counts on the order of up to 10 11 . Currently, there is intensive research into hardware platforms suitable to support large-scale SNN simulations, whereas several of the most widely used simulators still rely purely on the execution on CPUs. Enabling the execution of these established simulators on heterogeneous hardware allows new studies to exploit the many-core hardware prevalent in modern supercomputing environments, while still being able to reproduce and compare with results from a vast body of existing literature. In this article, we propose a transition approach for CPU-based SNN simulators to enable the execution on heterogeneous hardware (e.g., CPUs, GPUs, and FPGAs), with only limited modifications to an existing simulator code base and without changes to model code. Our approach relies on manual porting of a small number of core simulator functionalities as found in common SNN simulators, whereas the unmodified model code is analyzed and transformed automatically. We apply our approach to the well-known simulator NEST and make a version executable on heterogeneous hardware available to the community. Our measurements show that at full utilization, a single GPU achieves the performance of about 9 CPU cores. A CPU-GPU co-execution with load balancing is also demonstrated, which shows better performance compared to CPU-only or GPU-only execution. Finally, an analytical performance model is proposed to heuristically determine the optimal parameters to execute the heterogeneous NEST.

Digital Watermarking for Multimedia Security Management

2008 ◽  
pp. 1719-1726
Author(s):  
Chang-Tsun Li
Keyword(s):  
Digital Media ◽  
Copyright Protection ◽  
Large Scale ◽  
Security Management ◽  
Multimedia Security ◽  
Multimedia Database ◽  
Storage And Retrieval ◽  
Undesirable Characteristic ◽  
History Of ◽  
The Media

The availability of versatile multimedia processing software and the far-reaching coverage of the interconnected networks have facilitated flawless copying and manipulations of digital media. The ever-advancing storage and retrieval technologies also have smoothed the way for large-scale multimedia database applications. However, abuses of these facilities and technologies pose pressing threats to multimedia security management in general, and multimedia copyright protection and content integrity verification in particular. Although cryptography has a long history of application to information and multimedia security, the undesirable characteristic of providing no protection to the media once decrypted has limited the feasibility of its widespread use. For example, an adversary can obtain the decryption key by purchasing a legal copy of the media but then redistributing the decrypted copies of the original.

Digital Watermarking for Multimedia Security Management

2011 ◽  
pp. 213-218 ◽  
Author(s):  
Chang-Tsun Li
Keyword(s):  
Digital Media ◽  
Copyright Protection ◽  
Large Scale ◽  
Security Management ◽  
Multimedia Security ◽  
Multimedia Database ◽  
Storage And Retrieval ◽  
Undesirable Characteristic ◽  
History Of ◽  
The Media

The availability of versatile multimedia processing software and the far-reaching coverage of the interconnected networks have facilitated flawless copying and manipulations of digital media. The ever-advancing storage and retrieval technologies also have smoothed the way for large-scale multimedia database applications. However, abuses of these facilities and technologies pose pressing threats to multimedia security management in general, and multimedia copyright protection and content integrity verification in particular. Although cryptography has a long history of application to information and multimedia security, the undesirable characteristic of providing no protection to the media once decrypted has limited the feasibility of its widespread use. For example, an adversary can obtain the decryption key by purchasing a legal copy of the media but then redistributing the decrypted copies of the original.

scholarly journals MINIMIZING LATENCY AND JITTER FOR LARGE-SCALE MULTIMEDIA REPOSITORIES THROUGH PREFIX CACHING

2003 ◽  
Vol 03 (01) ◽  
pp. 95-117 ◽  
Author(s):  
SUNIL PRABHAKAR ◽  
RAHUL CHARI
Keyword(s):  
Large Scale ◽  
Data Access ◽  
Multimedia Data ◽  
Secondary Storage ◽  
Storage And Retrieval ◽  
Multiple User ◽  
Large Size ◽  
Tertiary Storage ◽  
Hierarchical Storage ◽  
Access Patterns

Multimedia data poses challenges for efficient storage and retrieval due to its large size and playback timing requirements. For applications that store very large volumes of multimedia data, hierarchical storage offers a scalable and economical alternative to store data on magnetic disks. In a hierarchical storage architecture data is stored on a tape or optical disk based tertiary storage layer with the secondary storage disks serving as a cache or buffer. Due to the need for swapping media on drives, retrieving multimedia data from tertiary storage can potentially result in large delays before playback (startup latency) begins as well as during playback (jitter). In this paper we address the important problem of reducing startup latency and jitter for very large multimedia repositories. We propose that secondary storage should not be used as a cache in the traditional manner — instead, most of the secondary storage should be used to permanently store partial objects. Furthermore, replication is employed at the tertiary storage level to avoid expensive media switching. In particular, we show that by saving the initial segments of documents permanently on secondary storage, and replicating them on tertiary storage, startup latency can be significantly reduced. Since we are effectively reducing the amount of secondary storage available for buffering the data from tertiary storage, an increase in jitter may be expected. However, our results show that the technique also reduces jitter, in contrast to the expected behavior. Our technique exploits the pattern of data access. Advance knowledge of the access pattern is helpful, but not essential. Lack of this information or changes in access patterns are handled through adaptive techniques. Our study addresses both single- and multiple-user scenarios. Our results show that startup latency can be reduced by as much as 75% and jitter practically eliminated through the use of these techniques.

Sign in / Sign up

Export Citation Format

Share Document