DRIVE: A Distributed Economic Meta-Scheduler for the Federation of Grid and Cloud Systems

<p>The computational landscape is littered with islands of disjoint resource providers including commercial Clouds, private Clouds, national Grids, institutional Grids, clusters, and data centers. These providers are independent and isolated due to a lack of communication and coordination, they are also often proprietary without standardised interfaces, protocols, or execution environments. The lack of standardisation and global transparency has the effect of binding consumers to individual providers. With the increasing ubiquity of computation providers there is an opportunity to create federated architectures that span both Grid and Cloud computing providers effectively creating a global computing infrastructure. In order to realise this vision, secure and scalable mechanisms to coordinate resource access are required. This thesis proposes a generic meta-scheduling architecture to facilitate federated resource allocation in which users can provision resources from a range of heterogeneous (service) providers. Efficient resource allocation is difficult in large scale distributed environments due to the inherent lack of centralised control. In a Grid model, local resource managers govern access to a pool of resources within a single administrative domain but have only a local view of the Grid and are unable to collaborate when allocating jobs. Meta-schedulers act at a higher level able to submit jobs to multiple resource managers, however they are most often deployed on a per-client basis and are therefore concerned with only their allocations, essentially competing against one another. In a federated environment the widespread adoption of utility computing models seen in commercial Cloud providers has re-motivated the need for economically aware meta-schedulers. Economies provide a way to represent the different goals and strategies that exist in a competitive distributed environment. The use of economic allocation principles effectively creates an open service market that provides efficient allocation and incentives for participation. The major contributions of this thesis are the architecture and prototype implementation of the DRIVE meta-scheduler. DRIVE is a Virtual Organisation (VO) based distributed economic metascheduler in which members of the VO collaboratively allocate services or resources. Providers joining the VO contribute obligation services to the VO. These contributed services are in effect membership “dues” and are used in the running of the VOs operations – for example allocation, advertising, and general management. DRIVE is independent from a particular class of provider (Service, Grid, or Cloud) or specific economic protocol. This independence enables allocation in federated environments composed of heterogeneous providers in vastly different scenarios. Protocol independence facilitates the use of arbitrary protocols based on specific requirements and infrastructural availability. For instance, within a single organisation where internal trust exists, users can achieve maximum allocation performance by choosing a simple economic protocol. In a global utility Grid no such trust exists. The same meta-scheduler architecture can be used with a secure protocol which ensures the allocation is carried out fairly in the absence of trust. DRIVE establishes contracts between participants as the result of allocation. A contract describes individual requirements and obligations of each party. A unique two stage contract negotiation protocol is used to minimise the effect of allocation latency. In addition due to the co-op nature of the architecture and the use of secure privacy preserving protocols, DRIVE can be deployed in a distributed environment without requiring large scale dedicated resources. This thesis presents several other contributions related to meta-scheduling and open service markets. To overcome the perceived performance limitations of economic systems four high utilisation strategies have been developed and evaluated. Each strategy is shown to improve occupancy, utilisation and profit using synthetic workloads based on a production Grid trace. The gRAVI service wrapping toolkit is presented to address the difficulty web enabling existing applications. The gRAVI toolkit has been extended for this thesis such that it creates economically aware (DRIVE-enabled) services that can be transparently traded in a DRIVE market without requiring developer input. The final contribution of this thesis is the definition and architecture of a Social Cloud – a dynamic Cloud computing infrastructure composed of virtualised resources contributed by members of a Social network. The Social Cloud prototype is based on DRIVE and highlights the ease in which dynamic DRIVE markets can be created and used in different domains.</p>

DRIVE: A Distributed Economic Meta-Scheduler for the Federation of Grid and Cloud Systems

<p>The computational landscape is littered with islands of disjoint resource providers including commercial Clouds, private Clouds, national Grids, institutional Grids, clusters, and data centers. These providers are independent and isolated due to a lack of communication and coordination, they are also often proprietary without standardised interfaces, protocols, or execution environments. The lack of standardisation and global transparency has the effect of binding consumers to individual providers. With the increasing ubiquity of computation providers there is an opportunity to create federated architectures that span both Grid and Cloud computing providers effectively creating a global computing infrastructure. In order to realise this vision, secure and scalable mechanisms to coordinate resource access are required. This thesis proposes a generic meta-scheduling architecture to facilitate federated resource allocation in which users can provision resources from a range of heterogeneous (service) providers. Efficient resource allocation is difficult in large scale distributed environments due to the inherent lack of centralised control. In a Grid model, local resource managers govern access to a pool of resources within a single administrative domain but have only a local view of the Grid and are unable to collaborate when allocating jobs. Meta-schedulers act at a higher level able to submit jobs to multiple resource managers, however they are most often deployed on a per-client basis and are therefore concerned with only their allocations, essentially competing against one another. In a federated environment the widespread adoption of utility computing models seen in commercial Cloud providers has re-motivated the need for economically aware meta-schedulers. Economies provide a way to represent the different goals and strategies that exist in a competitive distributed environment. The use of economic allocation principles effectively creates an open service market that provides efficient allocation and incentives for participation. The major contributions of this thesis are the architecture and prototype implementation of the DRIVE meta-scheduler. DRIVE is a Virtual Organisation (VO) based distributed economic metascheduler in which members of the VO collaboratively allocate services or resources. Providers joining the VO contribute obligation services to the VO. These contributed services are in effect membership “dues” and are used in the running of the VOs operations – for example allocation, advertising, and general management. DRIVE is independent from a particular class of provider (Service, Grid, or Cloud) or specific economic protocol. This independence enables allocation in federated environments composed of heterogeneous providers in vastly different scenarios. Protocol independence facilitates the use of arbitrary protocols based on specific requirements and infrastructural availability. For instance, within a single organisation where internal trust exists, users can achieve maximum allocation performance by choosing a simple economic protocol. In a global utility Grid no such trust exists. The same meta-scheduler architecture can be used with a secure protocol which ensures the allocation is carried out fairly in the absence of trust. DRIVE establishes contracts between participants as the result of allocation. A contract describes individual requirements and obligations of each party. A unique two stage contract negotiation protocol is used to minimise the effect of allocation latency. In addition due to the co-op nature of the architecture and the use of secure privacy preserving protocols, DRIVE can be deployed in a distributed environment without requiring large scale dedicated resources. This thesis presents several other contributions related to meta-scheduling and open service markets. To overcome the perceived performance limitations of economic systems four high utilisation strategies have been developed and evaluated. Each strategy is shown to improve occupancy, utilisation and profit using synthetic workloads based on a production Grid trace. The gRAVI service wrapping toolkit is presented to address the difficulty web enabling existing applications. The gRAVI toolkit has been extended for this thesis such that it creates economically aware (DRIVE-enabled) services that can be transparently traded in a DRIVE market without requiring developer input. The final contribution of this thesis is the definition and architecture of a Social Cloud – a dynamic Cloud computing infrastructure composed of virtualised resources contributed by members of a Social network. The Social Cloud prototype is based on DRIVE and highlights the ease in which dynamic DRIVE markets can be created and used in different domains.</p>

Innovation to improve patient care in Australian Primary Health Network: an insider’s perspective

Purpose The purpose of this paper is to review the establishment of Primary Health Network (PHN) in Australia and its utility in commissioning Primary Health Care (PHC) services. Design/methodology/approach This study is an analysis of management practice about the establishment and development of a PHN as a case study over the three-year period. The PHN is the Hunter New England and Central Coast PHN (HNECCPHN). The study is based on “insiders perspectives” drawing from documentation, reports and evaluations undertaken. Findings HNECCPHN demonstrates a unique inclusive organisation across a substantial diverse geographic area. It has taken an innovative and evidence-based approach to its creation, governance and operation. HNECCPHN addresses the health challenges of a substantial Aboriginal and/or Torres Strait Islander population. It contains significant and diverse urban, coastal and distinct rural, regional and remote populations. It can be described as a “virtual” organisation, using a distributed network of practice approach to engage clinicians, communities and providers. The authors describe progress and learning in the context of theories of complex organisations, innovation, networks of practice, knowledge translation and social innovation. Research limitations/implications The study provides initial publication into the establishment phase of a PHN in Australia. Practical implications The study describes the implementation and progress in terms of relevant international practice and theoretical concepts. This paper demonstrates significant innovative practice in the short term. Social implications The study describes significant engagement and the importance of that with and between communities, service providers and health professionals. Originality/value This is the first study of the results of the implementation of an important change in the funding and delivery of PHC in Australia.

Main results of MONDILEX project

Main results of MONDILEX projectThe paper presents the results and recommendations of MONDILEX, a 7FP project that covered six Slavic languages: Bulgarian, Polish, Russian, Slovak, Slovene, and Ukrainian. The paper summarizes the research undertaken on standardisation and integration of Slavic language resources and on the establishment of a virtual organisation supporting research infrastructure for Slavic lexicography. The results should be useful for an implementation of a research infrastructure in the coming years.

The global rock art database: developing a rock art reference model for the RADB system using the CIDOC CRM and Australian heritage examples

The <i>Rock Art Database</i> (RADB) is a virtual organisation that aims to build a global rock art community. It brings together rock art enthusiasts and professionals from around the world in one centralized location through the deployed publicly available <i>RADB Management System</i>. This online platform allows users to share, manage and discuss rock art information and offers a new look at rock art data through the use of new technologies in rich media formats. Full access to the growing platform is currently only available for a selected group of users but it already links over 200 rock art projects around the globe. <br><br> This paper forms a part of the larger <i>Rock Art Database</i> (RADB) project. It discusses the design stage of the <i>RADB System</i> and the development of a conceptual <i>RADB Reference Model</i> (RARM) that is used to inform the design of the <i>Rock Art Database Management System</i>. It examines the success and failure of international and national systems and uses the Australian heritage sector and Australian rock art as a test model to develop a method for the <i>RADB System</i> design. The system aims to help improve rock art management by introducing the CIDOC CRM in conjunction with a rock art specific domain model. It seeks to improve data compatibility and data sharing to help with the integration of a variety of resources to create the global <i>Rock Art Database Management System</i>.

Organisational Architectures Modelling

The Virtual Organisation and Enterprise Modelling have become important topics starting with the mid 1990’s. This relevance comes from the positive combined effects expected by a business process reengineering and the particularities of the virtual organizations that fit very well to market challenges. A more advanced specialization, often found in the virtual organisations, gives a plus in terms of efficiency and productivity by an optimized business process. A particular well developed domain, for such type of organisations, is the informational system that can be seen as foundation for the business process reengineering. The paper presents relevant data and results for organisation architecture modelling. The architecture referred herein apply to enterprise and virtual organisation too, meaning that the improvements obtained by applying the business process reengineering for enterprise, can be foreseen, even with amplified effects, in the case of a virtual organisation.