High Performance Computing (HPC) Wales and the Next Generation Workforce: Strategies to Ensure Propagation

2013 ◽  
Vol 1583 ◽  
Author(s):  
Laura M. Redfern

ABSTRACTHigh Performance Computing (HPC) Wales was launched in 2010 as a five year joint venture between Wales’ six Universities, working in partnership with a variety of academic and industrial stakeholders and funded by the EU, UK and Welsh Governments. The aim of HPC Wales is to deliver a pan-Wales HPC infrastructure: primarily to assist with economic regeneration in the Principality of Wales (which has a population of approximately 3.6 million) through the up-skilling of individuals and by promoting uptake of HPC in Welsh businesses, but also open to collaborations from outside Wales. It is the first national service of its kind in Europe.In order to encourage the uptake of HPC into small and medium sized enterprises (of up to 250 staff) in Wales, and for HPC Wales itself to become a sustainable business, the development of a strong skills base is vital. Successful delivery will be marked by the successful upskilling of individuals via accredited training programmes, and through outreach and engagement activities. Recognising that a significant amount of upskilling is required, further work is being undertaken by HPC Wales to develop workflows which can help to simplify the HPC job submission process for the end user. This will make it possible for businesses to achieve results without their needing to acquire a high level of specialist HPC skills in the short term.At a mid-point in this ambitious venture, this paper examines the strategies being developed by HPC Wales which will help to ensure propagation throughout the educational chain so that the requisite skills and workflows are in place which will benefit the next-generation workforce. Through this, HPC Wales hopes to assist in the overall advancement of scientific discovery which will, in turn, help Welsh businesses to become more competitive in the global marketplace.

2021 ◽  
Vol 13 (21) ◽  
pp. 11782
Author(s):  
Taha Al-Jody ◽  
Hamza Aagela ◽  
Violeta Holmes

There is a tradition at our university for teaching and research in High Performance Computing (HPC) systems engineering. With exascale computing on the horizon and a shortage of HPC talent, there is a need for new specialists to secure the future of research computing. Whilst many institutions provide research computing training for users within their particular domain, few offer HPC engineering and infrastructure-related courses, making it difficult for students to acquire these skills. This paper outlines how and why we are training students in HPC systems engineering, including the technologies used in delivering this goal. We demonstrate the potential for a multi-tenant HPC system for education and research, using novel container and cloud-based architecture. This work is supported by our previously published work that uses the latest open-source technologies to create sustainable, fast and flexible turn-key HPC environments with secure access via an HPC portal. The proposed multi-tenant HPC resources can be deployed on a “bare metal” infrastructure or in the cloud. An evaluation of our activities over the last five years is given in terms of recruitment metrics, skills audit feedback from students, and research outputs enabled by the multi-tenant usage of the resource.


Author(s):  
А.В. Баранов ◽  
Е.А. Киселёв

Организация облачных сервисов для высокопроизводительных вычислений затруднена, во-первых, по причине высоких накладных расходов на виртуализацию, во-вторых, из-за специфики систем управления заданиями и ресурсами в научных суперкомпьютерных центрах. В настоящей работе рассмотрен подход к построению облачных сервисов видов PaaS и SaaS, основанных на совместном функционировании облачной платформы Proxmox VE и системы управления прохождением параллельных заданий, применяемой в качестве менеджера ресурсов в Межведомственном суперкомпьютерном центре РАН. Purpose. The purpose of this paper is to develop methods and technologies for building high-performance computing cloud services in scientific supercomputer centers. Methodology.To build a cloud environment for high-performance scientific calculations (HPC), the corresponding three-level model and the method of combining flows of supercomputer tasks of various types were applied. Results.A high-level HPC cloud services technology based on the free Proxmox VE software platform has been developed. The Proxmox VE platform has been integrated with the domestic supercomputer job management system called SUPPZ. Experimental estimates of the overheads introduced in the high-performance computing process by the Proxmox components are obtained. Findings.An approach to the integration a supercomputer job management system and a virtualization platform is proposed. The presented approach is based on the representation of the supercomputer jobs as virtual machines or containers. Using the Proxmox VE platform as an example, the influence of a virtual environment on the execution time of parallel programs is investigated experimentally. The possibility of applying the proposed approach to building cloud services of the PaaS and SaaS type in scientific supercomputing centers of collective use is substantiated for a class of applications for which the overhead costs introduced by the Proxmox components are acceptable.


Sign in / Sign up

Export Citation Format

Share Document