scholarly journals Proactive Resource Management for LTE in Unlicensed Spectrum: A Deep Learning Perspective

2018 ◽  
Vol 17 (7) ◽  
pp. 4674-4689 ◽  
Author(s):  
Ursula Challita ◽  
Li Dong ◽  
Walid Saad
Keyword(s):  
Deep Learning ◽  
Resource Management ◽  
Unlicensed Spectrum

scholarly journals Revisiting Resource Management for Deep Learning Framework

Electronics ◽  
2019 ◽  
Vol 8 (3) ◽  
pp. 327
Author(s):  
Erci Xu ◽  
Shanshan Li
Keyword(s):  
Deep Learning ◽  
Resource Management ◽  
General Purpose ◽  
Resource Assignment ◽  
Data Intensive ◽  
Learning Framework ◽  
Network Layers ◽  
Resource Managers ◽  
Input Dataset ◽  
Efficient Resource

The recent adoption of deep learning for diverse applications has required infrastructures to be scaled horizontally and hybrid configured vertically. As a result, efficient resource management for distributed deep learning (DDL) frameworks is becoming increasingly important. However, existing techniques for scaling DDL applications rely on general-purpose resource managers originally designed for data intensive applications. In contrast, DDL applications present unique challenges for resource management as compared to traditional big data frameworks, such as a different master–slave communication paradigm, deeper ML models that are more computationally and network bounded than I/O, the use of heterogeneous resources (e.g., GPUs, TPUs) and the variable memory requirement. In addition, most DDL frameworks require data scientists to manually configure the task placement and resource assignment to execute DDL models. In this paper, we present Dike, an automatic resource management framework that transparently makes scheduling decisions for placement and resource assignment to DDL workers and parameter servers, based on the unique characteristics of the DDL model (number and type of parameters and neural network layers), node heterogeneity (CPU/GPU ratios), and input dataset. We implemented Dike as a resource manager for DDL jobs in Tensorflow on top of Apache Mesos. We show that Dike significantly outperformed both manual and static assignment of resource offers to Tensorflow tasks, and achieved at least 95% of the optimal throughput for different DDL models such as ResNet and Inception.

scholarly journals ThermoSim: Deep learning based framework for modeling and simulation of thermal-aware resource management for cloud computing environments

2020 ◽  
Vol 166 ◽  
pp. 110596 ◽  
Author(s):  
Sukhpal Singh Gill ◽  
Shreshth Tuli ◽  
Adel Nadjaran Toosi ◽  
Felix Cuadrado ◽  
Peter Garraghan ◽  
...  
Keyword(s):  
Cloud Computing ◽  
Deep Learning ◽  
Resource Management ◽  
Modeling And Simulation ◽  
Computing Environments
Sign in / Sign up

Export Citation Format

Share Document