scholarly journals Efficient Load Balancing Using Active Replica Management in a Storage System

2016 ◽  
Vol 2016 ◽  
pp. 1-9
Author(s):  
Jui-Pin Yang
Keyword(s):  
Load Balancing ◽  
Storage System ◽  
Data Access ◽  
Optimal Number ◽  
Load Imbalance ◽  
Dynamic Replication ◽  
Optimal Load ◽  
Replica Management ◽  
Replication Scheme ◽  
Efficient Scheme

Many algorithms can uniformly distribute data to storage nodes in a storage system. However, it cannot avoid load imbalance because data has different popularity. To resolve this issue, we propose a novel dynamic replication scheme, namely, Active Replica Management (ARM). ARM actively establishes optimal number of copies for hotspot data according to data access behaviors and then efficiently distributes copies to other storage nodes based on current amount of copies related to hotspot data. To improve storage utilization, ARM automatically and gradually dereplicates the useless copies of hotspot data when they become nonhotspot data. ARM resolves load imbalance by allocating dynamic copies to adequate storage nodes, and hence it can prevent partial storage nodes from overburdening. Simulation results demonstrate that ARM is an efficient scheme with excellent performance on load balancing, significantly closer to Optimal Load Balancing (OLB). In addition, ARM’s performance outperforms both Static Load Balancing (SLB) and No Replica schemes.

Coarse-grain replica management strategies for dynamic replication of Web contents

2004 ◽  
Vol 45 (1) ◽  
pp. 19-34 ◽  
Author(s):  
Norihito Fujita ◽  
Yuichi Ishikawa ◽  
Atsushi Iwata ◽  
Rauf Izmailov
Keyword(s):  
Management Strategies ◽  
Coarse Grain ◽  
Dynamic Replication ◽  
Web Contents ◽  
Replica Management

scholarly journals Optimal Load-Balancing for Heterogeneous Clusters

2015 ◽  
Vol 43 (3) ◽  
pp. 43-43 ◽  
Author(s):  
Anshul Gandhi ◽  
Naman Mittal ◽  
Xi Zhang
Keyword(s):  
Load Balancing ◽  
Heterogeneous Clusters ◽  
Optimal Load

scholarly journals The ATLAS EventIndex for LHC Run 3

2020 ◽  
Vol 245 ◽  
pp. 04017
Author(s):  
Dario Barberis ◽  
Igor Aleksandrov ◽  
Evgeny Alexandrov ◽  
Zbigniew Baranowski ◽  
Gancho Dimitrov ◽  
...  
Keyword(s):  
Event Detection ◽  
Storage System ◽  
Data Access ◽  
Use Cases ◽  
Production Rates ◽  
Global Event ◽  
Storage Service ◽  
Data Ingestion ◽  
Core Storage ◽  
Metadata Integration

The ATLAS EventIndex was designed in 2012-2013 to provide a global event catalogue and limited event-level metadata for ATLAS analysis groups and users during the LHC Run 2 (2015-2018). It provides a good and reliable service for the initial use cases (mainly event picking) and several additional ones, such as production consistency checks, duplicate event detection and measurements of the overlaps of trigger chains and derivation datasets. The LHC Run 3, starting in 2021, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This proceeding describes the implementation of a new core storage service that will be able to provide at least the same functionality as the current one for increased data ingestion and search rates, and with increasing volumes of stored data. It is based on a set of HBase tables, with schemas derived from the current Oracle implementation, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, allowing to re-use most of the existing code for metadata integration.

scholarly journals THE LOAD BALANCING OF SELF-SIMILAR TRAFFIC IN NETWORK INTRUSION DETECTION SYSTEMS

2020 ◽  
Vol 3 (7) ◽  
pp. 17-30
Author(s):  
Tamara Radivilova ◽  
Lyudmyla Kirichenko ◽  
Maksym Tawalbeh ◽  
Petro Zinchenko ◽  
Vitalii Bulakh
Keyword(s):  
Load Balancing ◽  
Intrusion Detection ◽  
Intrusion Detection System ◽  
Detection System ◽  
Intrusion Detection Systems ◽  
Deep Packet Inspection ◽  
Detection Systems ◽  
Network Intrusion ◽  
Load Imbalance ◽  
Packet Inspection

The problem of load balancing in intrusion detection systems is considered in this paper. The analysis of existing problems of load balancing and modern methods of their solution are carried out. Types of intrusion detection systems and their description are given. A description of the intrusion detection system, its location, and the functioning of its elements in the computer system are provided. Comparative analysis of load balancing methods based on packet inspection and service time calculation is performed. An analysis of the causes of load imbalance in the intrusion detection system elements and the effects of load imbalance is also presented. A model of a network intrusion detection system based on packet signature analysis is presented. This paper describes the multifractal properties of traffic. Based on the analysis of intrusion detection systems, multifractal traffic properties and load balancing problem, the method of balancing is proposed, which is based on the funcsioning of the intrusion detection system elements and analysis of multifractal properties of incoming traffic. The proposed method takes into account the time of deep packet inspection required to compare a packet with signatures, which is calculated based on the calculation of the information flow multifractality degree. Load balancing rules are generated by the estimated average time of deep packet inspection and traffic multifractal parameters. This paper presents the simulation results of the proposed load balancing method compared to the standard method. It is shown that the load balancing method proposed in this paper provides for a uniform load distribution at the intrusion detection system elements. This allows for high speed and accuracy of intrusion detection with high-quality multifractal load balancing.

Optimal Load Balancing and Energy Cost Management for Internet Data Centers in Deregulated Electricity Markets

2014 ◽  
Vol 25 (10) ◽  
pp. 2659-2669 ◽  
Author(s):  
Huajie Shao ◽  
Lei Rao ◽  
Zhi Wang ◽  
Xue Liu ◽  
Zhibo Wang ◽  
...  
Keyword(s):  
Load Balancing ◽  
Electricity Markets ◽  
Energy Cost ◽  
Data Centers ◽  
Cost Management ◽  
Optimal Load
Sign in / Sign up

Export Citation Format

Share Document