Data Management in Large-Scale P2P Systems

Author(s):  
Patrick Valduriez ◽  
Esther Pacitti
SoftwareX ◽  
2021 ◽  
Vol 15 ◽  
pp. 100747
Author(s):  
José Daniel Lara ◽  
Clayton Barrows ◽  
Daniel Thom ◽  
Dheepak Krishnamurthy ◽  
Duncan Callaway

Author(s):  
Lechang Cheng ◽  
Norm Hutchinson ◽  
Mabo R. Ito
Keyword(s):  

Author(s):  
Ewa Deelman ◽  
Ann Chervenak

Scientific applications such as those in astronomy, earthquake science, gravitational-wave physics, and others have embraced workflow technologies to do large-scale science. Workflows enable researchers to collaboratively design, manage, and obtain results that involve hundreds of thousands of steps, access terabytes of data, and generate similar amounts of intermediate and final data products. Although workflow systems are able to facilitate the automated generation of data products, many issues still remain to be addressed. These issues exist in different forms in the workflow lifecycle. This chapter describes a workflow lifecycle as consisting of a workflow generation phase where the analysis is defined, the workflow planning phase where resources needed for execution are selected, the workflow execution part, where the actual computations take place, and the result, metadata, and provenance storing phase. The authors discuss the issues related to data management at each step of the workflow cycle. They describe challenge problems and illustrate them in the context of real-life applications. They discuss the challenges, possible solutions, and open issues faced when mapping and executing large-scale workflows on current cyberinfrastructure. They particularly emphasize the issues related to the management of data throughout the workflow lifecycle.


Author(s):  
Valentin Cristea ◽  
Ciprian Dobre ◽  
Corina Stratan ◽  
Florin Pop

This chapter covers the subject of application in LSDS. The chapter is organized in two parts. The chapter parts present two aspect of application in LSDS: the overview of applications in entire world and the method of applications development. It is also presented a description of current projects and applications in large scale distributed systems, like applications from OSG projects in USA, EGEE and SEE-GRID applications in Europe and Asia, DEISA initiative (Distributed European Infrastructure for Supercomputing Applications). This part also presents the relevant applications in LSDS, like Grids, P2P systems.


Sign in / Sign up

Export Citation Format

Share Document