scholarly journals How to bring together fault tolerance and data consistency to enable Grid data sharing

2006 ◽  
Vol 18 (13) ◽  
pp. 1705-1723 ◽  
Author(s):  
G. Antoniu ◽  
J.-F. Deverge ◽  
S. Monnet
2013 ◽  
pp. 294-321
Author(s):  
Alexandru Costan

To accommodate the needs of large-scale distributed systems, scalable data storage and management strategies are required, allowing applications to efficiently cope with continuously growing, highly distributed data. This chapter addresses the key issues of data handling in grid environments focusing on storing, accessing, managing and processing data. We start by providing the background for the data storage issue in grid environments. We outline the main challenges addressed by distributed storage systems: high availability which translates into high resilience and consistency, corruption handling regarding arbitrary faults, fault tolerance, asynchrony, fairness, access control and transparency. The core part of the chapter presents how existing solutions cope with these high requirements. The most important research results are organized along several themes: grid data storage, distributed file systems, data transfer and retrieval and data management. Important characteristics such as performance, efficient use of resources, fault tolerance, security, and others are strongly determined by the adopted system architectures and the technologies behind them. For each topic, we shortly present previous work, describe the most recent achievements, highlight their advantages and limitations, and indicate future research trends in distributed data storage and management.


2006 ◽  
pp. 133-152 ◽  
Author(s):  
Gabriel Antoniu ◽  
Marin Bertier ◽  
Luc Bougé ◽  
Eddy Caron ◽  
Frédéric Desprez ◽  
...  
Keyword(s):  

Author(s):  
Leonardo B. Oliveira ◽  
Isabela G. Siqueira ◽  
Daniel F. Macedo ◽  
José M. Nogueira ◽  
Antonio A.F. Loureiro

Both Mobile Ad hoc Networks (MANETs) and Peer-to-Peer (P2P) networks are decentralized self-organizing networks with a dynamic topology, used to route queries in a distributed environment. However, whilst MANETs are composed of resource-constrained devices susceptible to faults, P2P networks are popular for their resilience and fault-tolerance. This makes P2P networks the ideal data sharing system for MANETs. This chapter focuses on the integration of these networks. More specifically, the authors evaluate routing strategies of both the network layer and the application layer. Their results indicate that the performance of the protocols depends greatly on the environment and point out the need for new approaches.


2014 ◽  
Vol 548-549 ◽  
pp. 1557-1560
Author(s):  
Wen Chuan Yang ◽  
Rui Li ◽  
Zhi Dong Shang

Accompany the widely use of smart phone in China, all inputs and routes packets streams to the Telecommunication Content Distribution Service Switching Centers (TSC). There is a tendency to put more capability into the switch, such as retain or query passing by data. Thus we definitely need to think about what can be kept in working storage and how to analysis it. Obviously, the ordinary database cannot handle the massive dataset and complex ad-hoc query. In this paper, we propose MRTSC, a MapReduce deep service analysis system based on Hive/Hadoop frameworks. A distributed file system HDFS is used in MRTSC for fast data sharing and query. MRTSC also optimizes scheduling for switch analysis jobs and supports fault tolerance for the entire workflow. Our results show that the model achieves a higher efficiency.


Author(s):  
Daniel Germanus ◽  
Ioanna Dionysiou ◽  
Harald Gjermundrod ◽  
Abdelmajid Khelil ◽  
Neeraj Suri ◽  
...  

2020 ◽  
Vol 17 (5) ◽  
pp. 2402-2404
Author(s):  
G. Subathra ◽  
A. Antonidoss

The Blockchain technology brings a rapid growth in the industry, It emphasizes the service to lead the complexity of software and malicious attack in the network. This technology is used to monitor the highly vulnerable services and it is used to increase the complexity of the warehouse data. It assures the security and consistency of data, The warehouse data has been replicated the availability and the enhancement of security in the services. This technology originated from internet sector as a decentralized, distributed ledger for data transaction. Nowadays, it is visualised as a backbone or frame work for decentralized data processing in open source network. Blockchain uses variety of consensus protocol which is reliable for nodes and communication resources that is used for data consistency. Byzantine fault tolerance algorithm has been proposed for computational cost and security also for consensus efficiency. This paper deals by proposing practical byzantine fault tolerance on edge computing networks paves away for reducing storage overhead also security purpose on edge devices. The proposed model is simulated in the constrain environment and the results are discussed. It shows that the proposed method has increase the availability and security of the stored data.


2013 ◽  
Vol 340 ◽  
pp. 999-1002
Author(s):  
Su Kang Li ◽  
Yuan Xu ◽  
Jian Sheng Mei ◽  
Jun Zhang

The purpose is to implement data sharing and exchange of each application system, establish integrated & technology-supported platform for regional grid dispatching, build data source based on EMS system and platform of visual panoramic model and interoperation centered on CIM, realize visual and unified management of regional grid data and basic resource sharing and exchange, promote construction and development of application integration system and intelligent grid management in Nanchang area.


Sign in / Sign up

Export Citation Format

Share Document