Resource Provisioning for e-Science Environments

Author(s):  
Andrea Bosin

Recent works have proposed a number of models and tools to address the growing needs and expectations in the field of e-Science. At the same time, the availability and models of use of networked computing resources needed by e-Science are rapidly changing and see the coexistence of many disparate paradigms: high performance computing, grid and recently cloud, which brings very promising expectations due to its high flexibility. In this paper we suggest a model to promote the convergence and the integration of different computing paradigms and infrastructures for the dynamic on-demand provisioning of the resources needed by e-Science environments, leveraging the Service-Oriented Architecture model. In addition, its design aims at endorsing a flexible, modular, workflow-based collaborative environment for e-Science. A working implementation used to validate the proposed approach is described together with some performance tests.

2012 ◽  
Vol 2012 ◽  
pp. 1-19
Author(s):  
Andrea Bosin

In the last years, the availability and models of use of networked computing resources within reach of e-Science are rapidly changing and see the coexistence of many disparate paradigms: high-performance computing, grid, and recently cloud. Unfortunately, none of these paradigms is recognized as the ultimate solution, and a convergence of them all should be pursued. At the same time, recent works have proposed a number of models and tools to address the growing needs and expectations in the field of e-Science. In particular, they have shown the advantages and the feasibility of modeling e-Science environments and infrastructures according to the service-oriented architecture. In this paper, we suggest a model to promote the convergence and the integration of the different computing paradigms and infrastructures for the dynamic on-demand provisioning of resources from multiple providers as a cohesive aggregate, leveraging the service-oriented architecture. In addition, we propose a design aimed at endorsing a flexible, modular, workflow-based computing model for e-Science. The model is supplemented by a working prototype implementation together with a case study in the applicative domain of bioinformatics, which is used to validate the presented approach and to carry out some performance and scalability measurements.


2015 ◽  
Vol 12 (1) ◽  
pp. 1-15 ◽  
Author(s):  
Luis F. Castillo ◽  
Germán López-Gartner ◽  
Gustavo A. Isaza ◽  
Mariana Sánchez ◽  
Jeferson Arango ◽  
...  

Summary The need to process large quantities of data generated from genomic sequencing has resulted in a difficult task for life scientists who are not familiar with the use of command-line operations or developments in high performance computing and parallelization. This knowledge gap, along with unfamiliarity with necessary processes, can hinder the execution of data processing tasks. Furthermore, many of the commonly used bioinformatics tools for the scientific community are presented as isolated, unrelated entities that do not provide an integrated, guided, and assisted interaction with the scheduling facilities of computational resources or distribution, processing and mapping with runtime analysis. This paper presents the first approximation of a Web Services platform-based architecture (GITIRBio) that acts as a distributed front-end system for autonomous and assisted processing of parallel bioinformatics pipelines that has been validated using multiple sequences. Additionally, this platform allows integration with semantic repositories of genes for search annotations. GITIRBio is available at: http://c-head.ucaldas.edu.co:8080/gitirbio


Author(s):  
Geoffrey Fox ◽  
Shrideep Pallickara ◽  
Marlon Pierce ◽  
Harshawardhan Gadgil

Grid application frameworks have increasingly aligned themselves with the developments in Web services. Web services are currently the most popular infrastructure based on service-oriented architecture (SOA) paradigm. There are three core areas within the SOA framework: (i) a set of capabilities that are remotely accessible, (ii) communications using messages and (iii) metadata pertaining to the aforementioned capabilities. In this paper, we focus on issues related to the messaging substrate hosting these services; we base these discussions on the NaradaBrokering system. We outline strategies to leverage capabilities available within the substrate without the need to make any changes to the service implementations themselves. We also identify the set of services needed to build Grids of Grids. Finally, we discuss another technology, HPS earch , which facilitates the administration of the substrate and the deployment of applications via a scripting interface. These issues have direct relevance to scientific Grid applications, which need to go beyond remote procedure calls in client-server interactions to support integrated distributed applications that couple databases, high performance computing codes and visualization codes.


Author(s):  
Mohammed Nasser Al-Suqri ◽  
Esther O.A. Fatuyi

Deliberate exploitation of natural resources and excessive use of environmentally abhorrent materials have resulted in environmental disruptions threatening the life support systems. A human centric approach of development has already damaged nature to a large extent. This has attracted the attention of environmental specialists and policy makers. It has also led to discussions at various national and international conventions. The objective of protecting natural resources cannot be achieved without the involvement of professionals from multidisciplinary areas. This chapter recommends a model for the creation of knowledge-based systems for natural resources management. Further, it describes making use of unique capabilities of remote sensing satellites for conserving natural resources and managing natural disasters. It is exclusively for the people who are not familiar with the technology and who are given the task of framing policies.


Author(s):  
Tyng-Yeu Liang ◽  
Fu-Chun Lu ◽  
Jun-Yao Chiu

QoS and energy consumption are two important issues for Cloud computing. In this paper, the authors propose a hybrid resource reservation method to address these two issues for scientific workflows in the high-performance computing Clouds built on hybrid CPU/GPU architecture. As named, this method reserves proper CPU or GPU for executing different jobs in the same workflow based on the profile of execution time and energy consumption of each resource-to-program pair. They have implemented the proposed resource reservation method on a real service-oriented system. The experimental results show that the proposed resource reservation method can effectively maintain the QoS of workflows while simultaneously minimizing the energy consumption of executing the workflows.


2014 ◽  
Vol 4 (3) ◽  
Author(s):  
Jarmila Skrinarova

AbstractThis paper analyses basic concept of elastic cluster as a hybrid solution of high-performance computing tasks for computing grid and cloud. The analysis is focused on the context of managing resources and tasks in the elastic cluster. In this work design, model and implementation of scheduling algorithm is described. The scheduling algorithm is based on particle swarm optimization (PSO) and hill climbing (HC) optimization and it is appropriate combination of good features the both methods. The algorithm is implemented on HPC cluster into the resource manager Torque. There is included methodology of measurement and evaluation of the algorithm. The paper presents methods of verifying behaviour of algorithm for different tasks requirements, which are typical for grid or elastic cluster. We compare suitability of the proposed algorithm with known solutions. On the base of analysed results is confirmed that proposed algorithm better satisfies specific criteria of elastic cluster.


2014 ◽  
Vol 644-650 ◽  
pp. 2568-2571
Author(s):  
Li Bing Guo ◽  
Jin Biao Zhou ◽  
Yong Gang Li ◽  
Lin Qi Zhou ◽  
Sheng Ping Li

This paper introduces the service-oriented architecture technology, and proposes the architecture model of Out-trajectory Data Processing in distributed environment. According to the demand and features of Ship-borne Out-trajectory Data Processing flow, it describes how to carry out cross-platform service integration by using the Service Bus Middleware, and provides a kind of typical distributed deployment strategy.


Sign in / Sign up

Export Citation Format

Share Document