scholarly journals Scheduling Multilevel Deadline-Constrained Scientific Workflows on Clouds Based on Cost Optimization

2015 ◽  
Vol 2015 ◽  
pp. 1-13 ◽  
Author(s):  
Maciej Malawski ◽  
Kamil Figiela ◽  
Marian Bubak ◽  
Ewa Deelman ◽  
Jarek Nabrzyski
Keyword(s):  
Programming Languages ◽  
Cost Optimization ◽  
Workflow Management ◽  
Resource Planning ◽  
General Purpose ◽  
Scientific Workflows ◽  
Workflow Execution ◽  
Amazon Ec2 ◽  
Deadline Constraints ◽  
The Cost

This paper presents a cost optimization model for scheduling scientific workflows on IaaS clouds such as Amazon EC2 or RackSpace. We assume multiple IaaS clouds with heterogeneous virtual machine instances, with limited number of instances per cloud and hourly billing. Input and output data are stored on a cloud object store such as Amazon S3. Applications are scientific workflows modeled as DAGs as in the Pegasus Workflow Management System. We assume that tasks in the workflows are grouped into levels of identical tasks. Our model is specified using mathematical programming languages (AMPL and CMPL) and allows us to minimize the cost of workflow execution under deadline constraints. We present results obtained using our model and the benchmark workflows representing real scientific applications in a variety of domains. The data used for evaluation come from the synthetic workflows and from general purpose cloud benchmarks, as well as from the data measured in our own experiments with Montage, an astronomical application, executed on Amazon EC2 cloud. We indicate how this model can be used for scenarios that require resource planning for scientific workflows and their ensembles.

An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2

2012 ◽  
Vol 10 (1) ◽  
pp. 5-21 ◽  
Author(s):  
Gideon Juve ◽  
Ewa Deelman ◽  
G. Bruce Berriman ◽  
Benjamin P. Berman ◽  
Philip Maechling
Keyword(s):  
Scientific Workflows ◽  
Amazon Ec2 ◽  
And Performance ◽  
The Cost

The influence of VLSI technology on computer architecture

1988 ◽  
Vol 326 (1591) ◽  
pp. 377-393 ◽  
Keyword(s):  
Computer Architecture ◽  
Programming Languages ◽  
Large Scale ◽  
Parallel Computers ◽  
General Purpose ◽  
Parallel Computer ◽  
Vlsi Technology ◽  
Large Scale Integration ◽  
Scale Integration ◽  
The Cost

Very-large-scale integration (VLSI) offers new opportunities in computer architecture. The cost of a processor has been reduced to that of a few thousand bytes of memory, with the result that parallel computers can be constructed as easily and economically as their sequential predecessors. In particular, a parallel computer constructed by replication of a standard computing element is well suited to the mass-production economics of the technology. The emergence of the new parallel computers has stimulated the development of new programming languages and algorithms. One example is the Occam language which has been designed to enable applications to be expressed in a form suitable for execution on a variety of parallel architectures. Further developments in language and architecture will enable processing resources to be allocated and deallocated as freely as memory, giving rise to some hope that users of general-purpose parallel computers will be freed from the current need to design algorithms to suit specific architectures.

scholarly journals Constructing Workflows from Script Applications

2012 ◽  
Vol 20 (4) ◽  
pp. 359-377 ◽  
Author(s):  
Mikołaj Baranowski ◽  
Adam Belloum ◽  
Marian Bubak ◽  
Maciej Malawski
Keyword(s):  
Programming Languages ◽  
Source Code ◽  
General Purpose ◽  
Control Flow ◽  
Scientific Workflows ◽  
Collaborative Programming ◽  
Execution Environment ◽  
Grid Infrastructures ◽  
Grid Application ◽  
High Level

For programming and executing complex applications on grid infrastructures, scientific workflows have been proposed as convenient high-level alternative to solutions based on general-purpose programming languages, APIs and scripts. GridSpace is a collaborative programming and execution environment, which is based on a scripting approach and it extends Ruby language with a high-level API for invoking operations on remote resources. In this paper we describe a tool which enables to convert the GridSpace application source code into a workflow representation which, in turn, may be used for scheduling, provenance, or visualization. We describe how we addressed the issues of analyzing Ruby source code, resolving variable and method dependencies, as well as building workflow representation. The solutions to these problems have been developed and they were evaluated by testing them on complex grid application workflows such as CyberShake, Epigenomics and Montage. Evaluation is enriched by representing typical workflow control flow patterns.

scholarly journals Executing cyclic scientific workflows in the cloud

2021 ◽  
Vol 10 (1) ◽  
Author(s):  
Michel Krämer ◽  
Hendrik M. Würz ◽  
Christian Altenhofen
Keyword(s):  
Software Architecture ◽  
Open Source ◽  
Workflow Management ◽  
Directed Acyclic Graphs ◽  
Scientific Workflows ◽  
Workflow Management Systems ◽  
Workflow Execution ◽  
Acyclic Graphs ◽  
Process Chains ◽  
Speed Up

AbstractWe present an algorithm and a software architecture for a cloud-based system that executes cyclic scientific workflows whose structure may change during run time. Existing approaches either rely on workflow definitions based on directed acyclic graphs (DAGs) or require workarounds to implement cyclic structures. In contrast, our system supports cycles natively, avoids workarounds, and as such reduces the complexity of workflow modelling and maintenance. Our algorithm traverses workflow graphs and transforms them iteratively into linear sequences of executable actions. We call these sequences process chains. Our software architecture distributes the process chains to multiple compute nodes in the cloud and oversees their execution. We evaluate our approach by applying it to two practical use cases from the domains of astronomy and engineering. We also compare it with two existing workflow management systems. The evaluation demonstrates that our algorithm is able to execute dynamically changing workflows with cycles and that design and maintenance of complex workflows is easier than with existing solutions. It also shows that our software architecture can run process chains on multiple compute nodes in parallel to significantly speed up the workflow execution. An implementation of our algorithm and the software architecture is available with the Steep Workflow Management System that we released under an open-source license. The resources for the first practical use case are also available as open source for reproduction.

scholarly journals Are Multi-Language Design Smells Fault-Prone? An Empirical Study

2021 ◽  
Vol 30 (3) ◽  
pp. 1-56
Author(s):  
Mouna Abidi ◽  
Md Saidur Rahman ◽  
Moses Openja ◽  
Foutse Khomh
Keyword(s):  
Programming Languages ◽  
Language Design ◽  
Functional Requirements ◽  
Code Smells ◽  
Design And Implementation ◽  
Design Smells ◽  
The Cost ◽  
The Impact ◽  
Fault Proneness

Nowadays, modern applications are developed using components written in different programming languages and technologies. The cost benefits of reuse and the advantages of each programming language are two main incentives behind the proliferation of such systems. However, as the number of languages increases, so do the challenges related to the development and maintenance of these systems. In such situations, developers may introduce design smells (i.e., anti-patterns and code smells) which are symptoms of poor design and implementation choices. Design smells are defined as poor design and coding choices that can negatively impact the quality of a software program despite satisfying functional requirements. Studies on mono-language systems suggest that the presence of design smells may indicate a higher risk of future bugs and affects code comprehension, thus making systems harder to maintain. However, the impact of multi-language design smells on software quality such as fault-proneness is yet to be investigated. In this article, we present an approach to detect multi-language design smells in the context of JNI systems. We then investigate the prevalence of those design smells and their impacts on fault-proneness. Specifically, we detect 15 design smells in 98 releases of 9 open-source JNI projects. Our results show that the design smells are prevalent in the selected projects and persist throughout the releases of the systems. We observe that, in the analyzed systems, 33.95% of the files involving communications between Java and C/C++ contain occurrences of multi-language design smells. Some kinds of smells are more prevalent than others, e.g., Unused Parameters , Too Much Scattering , and Unused Method Declaration . Our results suggest that files with multi-language design smells can often be more associated with bugs than files without these smells, and that specific smells are more correlated to fault-proneness than others. From analyzing fault-inducing commit messages, we also extracted activities that are more likely to introduce bugs in smelly files. We believe that our findings are important for practitioners as it can help them prioritize design smells during the maintenance of multi-language systems.

Cost Optimization of Net-Zero Energy House

2007 ◽  
Author(s):  
George A. Mertz ◽  
Gregory S. Raffio ◽  
Kelly Kissock
Keyword(s):  
Energy Use ◽  
Cost Optimization ◽  
Building Design ◽  
Building Energy ◽  
Zero Energy ◽  
Resource Limitations ◽  
Net Zero Energy ◽  
Net Zero ◽  
Building Energy Use ◽  
The Cost

Environmental and resource limitations provide increased motivation for design of net-zero energy or net-zero CO2 buildings. The optimum building design will have the lowest lifecycle cost. This paper describes a method of performing and comparing lifecycle costs for standard, CO2-neutral and net-zero energy buildings. Costs of source energy are calculated based on the cost of photovoltaic systems, tradable renewable certificates, CO2 credits and conventional energy. Building energy simulation is used to determine building energy use. A case study is conducted on a proposed net-zero energy house. The paper identifies the least-cost net-zero energy house, the least-cost CO2 neutral house, and the overall least-cost house. The methodology can be generalized to different climates and buildings. The method and results may be of interest to builders, developers, city planners, or organizations managing multiple buildings.

Real-time MLton: A Standard ML runtime for real-time functional programs

2021 ◽  
Vol 31 ◽  
Author(s):  
BHARGAV SHIVKUMAR ◽  
JEFFREY MURPHY ◽  
LUKASZ ZIAREK
Keyword(s):  
Programming Languages ◽  
Real Time ◽  
Concurrency Control ◽  
General Purpose ◽  
Functional Languages ◽  
Control Mechanisms ◽  
Real Time Systems ◽  
Functional Programming Languages ◽  
Standard Ml ◽  
Time Systems

Abstract There is a growing interest in leveraging functional programming languages in real-time and embedded contexts. Functional languages are appealing as many are strictly typed, amenable to formal methods, have limited mutation, and have simple but powerful concurrency control mechanisms. Although there have been many recent proposals for specialized domain-specific languages for embedded and real-time systems, there has been relatively little progress on adapting more general purpose functional languages for programming embedded and real-time systems. In this paper, we present our current work on leveraging Standard ML (SML) in the embedded and real-time domains. Specifically, we detail our experiences in modifying MLton, a whole-program optimizing compiler for SML, for use in such contexts. We focus primarily on the language runtime, reworking the threading subsystem, object model, and garbage collector. We provide preliminary results over a radar-based aircraft collision detector ported to SML.

Sign in / Sign up

Export Citation Format

Share Document