A model of Erasure-Coding-Based Distributed File System

2012 ◽  
Author(s):  
Yuanbo Han ◽  
Hui Li ◽  
Hanxu Hou
Keyword(s):  
File System ◽  
Distributed File System ◽  
Erasure Coding

scholarly journals Implementation and Performance Measuring of Erasure Coding of Distributed File System

2016 ◽  
Vol 41 (11) ◽  
pp. 1515-1527
Author(s):  
Cheiyol Kim ◽  
Youngchul Kim ◽  
Dongoh Kim ◽  
Hongyeon Kim ◽  
Youngkyun Kim ◽  
...  
Keyword(s):  
File System ◽  
Distributed File System ◽  
Erasure Coding ◽  
And Performance

scholarly journals Erasure-Coding-Based Storage and Recovery for Distributed Exascale Storage Systems

2021 ◽  
Vol 11 (8) ◽  
pp. 3298
Author(s):  
Jeong-Joon Kim
Keyword(s):  
File System ◽  
File Systems ◽  
Data Availability ◽  
Distributed File System ◽  
Distributed File Systems ◽  
Erasure Coding ◽  
Input Output ◽  
Space Efficiency ◽  
Random Block ◽  
Replication Technique

Various techniques have been used in distributed file systems for data availability and stability. Typically, a method for storing data in a replication technique-based distributed file system is used, but due to the problem of space efficiency, an erasure-coding (EC) technique has been utilized more recently. The EC technique improves the space efficiency problem more than the replication technique does. However, the EC technique has various performance degradation factors, such as encoding and decoding and input and output (I/O) degradation. Thus, this study proposes a buffering and combining technique in which various I/O requests that occurred during encoding in an EC-based distributed file system are combined into one and processed. In addition, it proposes four recovery measures (disk input/output load distribution, random block layout, multi-thread-based parallel recovery, and matrix recycle technique) to distribute the disk input/output loads generated during decoding.

Energy-Efficient Algorithms for Distributed File System HDFS

2014 ◽  
Vol 36 (5) ◽  
pp. 1047-1064 ◽  
Author(s):  
Bin LIAO ◽  
Jiong YU ◽  
Tao ZHANG ◽  
Xing-Yao YANG
Keyword(s):  
Energy Efficient ◽  
File System ◽  
Efficient Algorithms ◽  
Distributed File System

Performance Testing and Analysis to Storage Medium of Distributed File System

2010 ◽  
Vol 33 (10) ◽  
pp. 1873-1880 ◽  
Author(s):  
Chun-Cong XU ◽  
Xiao-Meng HUANG ◽  
Nuo WU ◽  
Ning-Wei SUN ◽  
Guang-Wen YANG
Keyword(s):  
File System ◽  
Performance Testing ◽  
Distributed File System ◽  
Storage Medium

Improving downloading performance in hadoop distributed file system

2010 ◽  
Vol 30 (8) ◽  
pp. 2060-2065 ◽  
Author(s):  
Ning CAO ◽  
Zhong-hai WU ◽  
Hong-zhi LIU ◽  
Qi-xun ZHANG
Keyword(s):  
File System ◽  
Distributed File System ◽  
Hadoop Distributed File System
Sign in / Sign up

Export Citation Format

Share Document