Improving GPU Multitasking Efficiency Using Dynamic Resource Sharing

2019 ◽  
Vol 18 (1) ◽  
pp. 1-5 ◽  
Author(s):  
Jiho Kim ◽  
Jehee Cha ◽  
Jason Jong Kyu Park ◽  
Dongsuk Jeon ◽  
Yongjun Park
Keyword(s):  
Resource Sharing ◽  
Dynamic Resource ◽  
Dynamic Resource Sharing

scholarly journals Flexible device compositions and dynamic resource sharing in PCIe interconnected clusters using Device Lending

2019 ◽  
Vol 23 (2) ◽  
pp. 1211-1234
Author(s):  
Jonas Markussen ◽  
Lars Bjørlykke Kristiansen ◽  
Rune Johan Borgli ◽  
Håkon Kvale Stensland ◽  
Friedrich Seifert ◽  
...  
Keyword(s):  
Resource Sharing ◽  
Direct Access ◽  
Pci Express ◽  
Specific Distribution ◽  
Resource Virtualization ◽  
Virtualization Technology ◽  
Support Device ◽  
Dynamic Resource ◽  
Additional Support ◽  
Dynamic Resource Sharing

Abstract Modern workloads often exceed the processing and I/O capabilities provided by resource virtualization, requiring direct access to the physical hardware in order to reduce latency and computing overhead. For computers interconnected in a cluser, access to remote hardware resources often requires facilitation both in hardware and specialized drivers with virtualization support. This limits the availability of resources to specific devices and drivers that are supported by the virtualization technology being used, as well as what the interconnection technology supports. For PCI Express (PCIe) clusters, we have previously proposed Device Lending as a solution for enabling direct low latency access to remote devices. The method has extremely low computing overhead, and does not require any application- or device-specific distribution mechanisms. Any PCIe device, such as network cards disks, and GPUs, can easily be shared among the connected hosts. In this work, we have extended our solution with support for a virtual machine (VM) hypervisor. Physical remote devices can be “passed through” to VM guests, enabling direct access to physical resources while still retaining the flexibility of virtualization. Additionally, we have also implemented multi-device support, enabling shortest-path peer-to-peer transfers between remote devices residing in different hosts.Our experimental results prove that multiple remote devices can be used, achieving bandwidth and latency close to native PCIe, and without requiring any additional support in device drivers. I/O intensive workloads run seamlessly using both local and remote resources. With our added VM and multi-device support, Device Lending offers highly customizable configurations of remote devices that can be dynamically reassigned and shared to optimize resource utilization, thus enabling a flexible composable I/O infrastructure for VMs as well as bare-metal machines.

scholarly journals An efficient resource sharing technique for multi-tenant databases

2020 ◽  
Vol 10 (3) ◽  
pp. 3216
Author(s):  
Pallavi G. B. ◽  
P. Jayarekha
Keyword(s):  
Resource Sharing ◽  
Service Providers ◽  
Low Cost ◽  
Service Level Agreement ◽  
Cloud Service ◽  
Database Systems ◽  
Economic Benefits ◽  
Sorting Technique ◽  
Dynamic Resource ◽  
Dynamic Resource Sharing

Multi-tenancy is one of the key components of cloud computing environment. Multi-tenant database system in SaaS (Software as a Service) has gained a lot of attention in academics, research and business arena. These database systems provide scalability and economic benefits for both cloud service providers and customers(organizations/companies referred as tenants) by sharing same resources and infrastructure in isolation of shared databases, network and computing resources with Service level agreement (SLA) compliances. In a multitenant scenario, active tenants compete for resources in order to access the database. If one tenant blocks up the resources, the performance of all the other tenants may be restricted and a fair sharing of the resources may be compromised. The performance of tenants must not be affected by resource-intensive activities and volatile workloads of other tenants. Moreover, the prime goal of providers is to accomplish low cost of operation, satisfying specific schemas/SLAs of each tenant. Consequently, there is a need to design and develop effective and dynamic resource sharing algorithms which can handle above mentioned issues. This work presents a model embracing a query classification and worker sorting technique to efficiently share I/O, CPU and Memory thus enhancing dynamic resource sharing and improvising the utilization of idle instances proficiently. The model is referred as Multi-Tenant Dynamic Resource Scheduling Model (MTDRSM) .The MTDRSM support workload execution of different benchmark such as TPC-C(Transaction Processing Performance Council), YCSB(The Yahoo! Cloud Serving Benchmark)etc. and on different database such as MySQL, Oracle, H2 database etc. Experiments are conducted for different benchmarks with and without SLA compliances to evaluate the performance of MTDRSM in terms of latency and throughput achieved. The experiments show significant performance improvement over existing Mute Bench model in terms of latency and throughput.

Sign in / Sign up

Export Citation Format

Share Document