scholarly journals On-demand Overlay Networks for Large Scientific Data Transfers

2010 ◽  
Author(s):  
Lavanya Ramakrishnan ◽  
Chin Guok ◽  
Keith Jackson ◽  
Ezra Kissel ◽  
D. Martin Swany ◽  
...  
Keyword(s):  
Overlay Networks ◽  
Scientific Data ◽  
On Demand ◽  
Data Transfers

scholarly journals Dataclient: a simple interface for scientific data transfers hiding x.509 complexities

2019 ◽  
Vol 214 ◽  
pp. 04003
Author(s):  
Vincenzo Ciaschini ◽  
Lucia Morganti ◽  
Matteo Tenti ◽  
Carmelo Pellegrino
Keyword(s):  
User Experience ◽  
Scientific Data ◽  
Current Data ◽  
The Other ◽  
Data Infrastructure ◽  
Client Server ◽  
Other Hand ◽  
Simple Interface ◽  
Data Transfers ◽  
General Architecture

Since the current data infrastructure of the HEP experiments is based on GridFTP, most computing centres have adapted and based their own access to the data on the X.509. This is an issue for smaller experiments that do not have the resources to train their researchers in the complexities of X.509 certificates and that would prefer an approach based on username/password. On the other hand, asking computing centres to support different access strategies is not so straightforward, as this would require a significant investment of effort and manpower. At CNAF-INFN Tier1 we tackled this problem by creating a layer on top of the gridftp client/server, that completely hides the X.509 infrastructure under an authentication/authorization process based on the Kerberos realm of our centre, and therefore based on username/password. We called this Dataclient. In this article we will describe both the principles that drove its design and its general architecture, together with the measures undertaken to simplify the user experience and maintenance burden.

A P2P Home-Box Overlay for Efficient Content Distribution

2016 ◽  
pp. 199-220 ◽  
Author(s):  
Evangelos Markakis ◽  
Daniel Negru ◽  
Joachim Bruneau-Queyreix ◽  
Evangelos Pallis ◽  
George Mastorakis ◽  
...  
Keyword(s):  
Overlay Networks ◽  
Content Distribution ◽  
Video On Demand ◽  
Resource Usage ◽  
Caching Strategy ◽  
Content Caching ◽  
On Demand ◽  
Cost Efficient ◽  
Client Side ◽  
Distribution Cost

The overlay networks composed of residential gateways (i.e. home-box) leverage their storage and upload capacity to achieve scalable and cost-efficient content distribution. In this chapter, we present the architecture of the home-box overlay for video on demand services, with the network-aware request redirection and content caching strategy that optimizes the resource usage at both network and client side, for reducing the overall distribution cost. The proposed system is compared with existing solutions through comprehensive simulations. The results demonstrate the advantage of network-aware and popularity-based caching strategy, with reduced the overall cost of the VoD services.

Optimizing Deadline-Driven Bulk Data Transfers in Overlay Networks

2009 ◽  
Author(s):  
Andrei Agapi ◽  
Sebastien Soudan ◽  
Marcelo Pasin ◽  
Pascale Vicat-Blanc Primet ◽  
Thilo Kielmann
Keyword(s):  
Overlay Networks ◽  
Bulk Data ◽  
Data Transfers

scholarly journals A Novel Video Sharing Solution Based on Demand-Aware Resource Caching Optimization in Wireless Mobile Networks

2017 ◽  
Vol 2017 ◽  
pp. 1-14 ◽  
Author(s):  
Shijie Jia ◽  
Ruiling Zhang ◽  
Shengli Jiang ◽  
Mingchuan Zhang
Keyword(s):  
Mobile Networks ◽  
Resource Sharing ◽  
Overlay Networks ◽  
High Efficiency ◽  
Video Sharing ◽  
On Demand ◽  
Wireless Mobile Networks ◽  
Network Load ◽  
Wireless Mobile ◽  
Video Dissemination

The video services in wireless mobile networks attract massive mobile video users, which triggers the demand for huge network traffic. In order to reduce network load and ensure user quality of experience (QoE), the MP2P-based video systems need to implement high-efficiency management and scheduling of video resources to optimize distribution and promote sharing with offloading traffic in underlaying networks. The traditional solutions do not efficiently address the problems caused by demand variation and node mobility for distribution optimization and resource sharing, so that promotion of video sharing performance in wireless mobile networks for user QoE and reduction of network load still is a significant challenge. This paper proposes a novel video sharing solution based on Demand-aware Resource Caching Optimization in wireless mobile networks (VDRCO). VDRCO models the process of video dissemination in overlay networks in terms of the epidemic model and discusses the main influence factors for video dissemination. By estimation for user demand and video distribution variation, VDRCO makes use of clustering nodes with similar video demand and movement behaviors to achieve distribution optimization and efficient video sharing. Extensive tests show how VDRCO achieves much better performance results in comparison with a state-of-the-art solution.

Sign in / Sign up

Export Citation Format

Share Document