GPU Scheduling on the NVIDIA TX2: Hidden Details Revealed

2017 ◽  
Author(s):  
Tanya Amert ◽  
Nathan Otterness ◽  
Ming Yang ◽  
James H. Anderson ◽  
F. Donelson Smith
Keyword(s):  
Gpu Scheduling

A user mode CPU–GPU scheduling framework for hybrid workloads

2016 ◽  
Vol 63 ◽  
pp. 25-36 ◽  
Author(s):  
Bin Wang ◽  
Ruhui Ma ◽  
Zhengwei Qi ◽  
Jianguo Yao ◽  
Haibing Guan
Keyword(s):  
Gpu Scheduling

LaLaRAND: Flexible Layer-by-Layer CPU/GPU Scheduling for Real-Time DNN Tasks

2021 ◽  
Author(s):  
Woosung Kang ◽  
Kilho Lee ◽  
Jinkyu Lee ◽  
Insik Shin ◽  
Hoon Sung Chwa
Keyword(s):  
Real Time ◽  
Layer By Layer ◽  
Gpu Scheduling

Balancing Energy Efficiency and Real-Time Performance in GPU Scheduling

2021 ◽  
Author(s):  
Yidi Wang ◽  
Mohsen Karimi ◽  
Yecheng Xiang ◽  
Hyoseung Kim
Keyword(s):  
Energy Efficiency ◽  
Real Time ◽  
Time Performance ◽  
Balancing Energy ◽  
Gpu Scheduling

scholarly journals A GPU Scheduling Framework to Accelerate Hyper-Parameter Optimization in Deep Learning Clusters

Electronics ◽  
2021 ◽  
Vol 10 (3) ◽  
pp. 350
Author(s):  
Jaewon Son ◽  
Yonghyuk Yoo ◽  
Khu-rai Kim ◽  
Youngjae Kim ◽  
Kwonyong Lee ◽  
...  
Keyword(s):  
Deep Learning ◽  
Parameter Optimization ◽  
Round Robin ◽  
Time Sharing ◽  
Scheduling Policies ◽  
Scheduling Policy ◽  
Minimal Time ◽  
Gpu Scheduling ◽  
Early Phases

This paper proposes Hermes, a container-based preemptive GPU scheduling framework for accelerating hyper-parameter optimization in deep learning (DL) clusters. Hermes accelerates hyper-parameter optimization by time-sharing between DL jobs and prioritizing jobs with more promising hyper-parameter combinations. Hermes’s scheduling policy is grounded on the observation that good hyper-parameter combinations converge quickly in the early phases of training. By giving higher priority to fast-converging containers, Hermes’s GPU preemption mechanism can accelerate training. This enables users to find optimal hyper-parameters faster without losing the progress of a container. We have implemented Hermes over Kubernetes and compared its performance against existing scheduling frameworks. Experiments show that Hermes reduces the time for hyper-parameter optimization up to 4.04 times against previously proposed scheduling policies such as FIFO, round-robin (RR), and SLAQ, with minimal time-sharing overhead.

Processor Scheduling in High-Performance Computing (HPC) Environment

2020 ◽  
pp. 151-179 ◽  
Author(s):  
Annu Priya ◽  
Sudip Kumar Sahana
Keyword(s):  
High Performance ◽  
Large Scale ◽  
Gpu Programming ◽  
Primary Concern ◽  
Scheduling Problems ◽  
Processor Scheduling ◽  
Complex Problems ◽  
Programming Software ◽  
Gpu Scheduling ◽  
Future Technologies

Processor scheduling is one of the thrust areas in the field of computer science. The future technologies use a huge amount of processing for execution of their tasks like huge games, programming software, and in the field of quantum computing. In real-time, many complex problems are solved by GPU programming. The primary concern of scheduling is to reduce the time complexity and manpower. Several traditional techniques exit for processor scheduling. The performance of traditional techniques is reduced when it comes to the huge processing of tasks. Most scheduling problems are NP-hard in nature. Many of the complex problems are recently solved by GPU programming. GPU scheduling is another complex issue as it runs thousands of threads in parallel and needs to be scheduled efficiently. For such large-scale scheduling problems, the performance of state-of-the-art algorithms is very poor. It is observed that evolutionary and genetic-based algorithms exhibit better performance for large-scale combinatorial and internet of things (IoT) problems.

Multi-Processor Job Scheduling in High-Performance Computing (HPC) Systems

2020 ◽  
pp. 168-203
Author(s):  
Annu Priya ◽  
Sudip Kumar Sahana
Keyword(s):  
High Performance ◽  
Large Scale ◽  
Job Scheduling ◽  
Combinatorial Problems ◽  
Gpu Programming ◽  
Scheduling Problems ◽  
Processor Scheduling ◽  
Complex Problems ◽  
Gpu Scheduling ◽  
Hard Real Time

Processor scheduling is one of the thrust areas in the field of computer science. The future technologies use a huge amount of processors for execution of their tasks like huge games, programming software, and in the field of quantum computing. In hard real-time, many complex problems are solved by GPU programming. The primary concern of scheduling is to reduce the time complexity and manpower. There are several traditional techniques for processor scheduling. The performance of traditional techniques is reduced when it comes under huge processing of tasks. Most scheduling problems are NP-hard in nature. Many of the complex problems are recently solved by the GPU programming. GPU scheduling is another complex issue as it runs thousands of threads in parallel and needs to be scheduled efficiently. For such large-scale scheduling problem, the performance of state-of-the-art algorithms is very poor. It is observed that evolutionary and genetic-based algorithms exhibit better performance for large-scale combinatorial problems.

Sign in / Sign up

Export Citation Format

Share Document