Hash routing for collections of shared Web caches

K.W. Ross

doi:10.1109/65.642358

Performance Study of Satellite-Linked Web Caches and Filtering Policies

Networking 2000 Broadband Communications, High Performance Networking, and Performance of Communication Networks - Lecture Notes in Computer Science ◽

10.1007/3-540-45551-5_49 ◽

2000 ◽

pp. 580-595 ◽

Cited By ~ 2

Author(s):

Xiao-Yu Hu ◽

Pablo Rodriguez ◽

Ernst W. Biersack

Keyword(s):

Performance Study ◽

Web Caches

Download Full-text

Delay sensitive least frequently used algorithm for replacement in web caches

Computer Communications ◽

10.1016/s0140-3664(03)00215-9 ◽

2004 ◽

Vol 27 (3) ◽

pp. 322-326 ◽

Cited By ~ 2

Author(s):

S. Selvakumar ◽

Swarup Kumar Sahoo ◽

Vijay Venkatasubramani

Keyword(s):

Delay Sensitive ◽

Web Caches

Download Full-text

Adaptive semantics-aware management for web caches and wikis

Proceedings of the 12th International Workshop on Adaptive and Reflective Middleware - ARM '13 ◽

10.1145/2541583.2541584 ◽

2013 ◽

Author(s):

Carlos Roque ◽

Paulo Ferreira ◽

Luís Veiga

Keyword(s):

Web Caches

Download Full-text

The Open High Throughput Computing Content Delivery Network

EPJ Web of Conferences ◽

10.1051/epjconf/201921404023 ◽

2019 ◽

Vol 214 ◽

pp. 04023

Author(s):

Dave Dykstra ◽

Brian Bockelman ◽

Jakob Blomer ◽

Laurence Field

Keyword(s):

High Throughput ◽

Distributed Database ◽

Local Area ◽

Content Delivery ◽

Content Delivery Network ◽

High Throughput Computing ◽

Software Distribution ◽

Proxy Caches ◽

Web Caches ◽

Delivery Network

LHC experiments make extensive use of web proxy caches, especially for software distribution via the CernVM File System and for conditions data via the Frontier Distributed Database Caching system. Since many jobs read the same data, cache hit rates are high and hence most of the traffic flows efficiently over Local Area Networks. However, it is not always possible to have local web caches, particularly for opportunistic cases where experiments have little control over site services. The Open High Throughput Computing (HTC) Content Delivery Network (CDN), openhtc.io, aims to address this by using web proxy caches from a commercial CDN provider. Cloudflare provides a simple interface for registering DNS aliases of any web server and does reverse proxy web caching on those aliases. The openhtc.io domain is hosted on Cloudflare's free tier CDN which has no bandwidth limit and makes use of data centers throughout the world, so the average performance for clients is much improved compared to reading from CERN or a Tier 1. The load on WLCG servers is also significantly reduced. WLCG Web Proxy Auto Discovery is used to select local web caches when they are available and otherwise select openhtc.io caching. This paper describes the Open HTC CDN in detail and provides initial results from its use for LHC@Home and USCMS opportunistic computing.

Download Full-text