Memory Based Metadata Server for Cluster File Systems

2008 ◽  
Author(s):  
Jing Xing ◽  
Jin Xiong ◽  
Jie Ma ◽  
Ninghui Sun
Keyword(s):  
File Systems ◽  
Metadata Server ◽  
Cluster File

scholarly journals Scalable Distributed Metadata Server Based on Nonblocking Transactions

2020 ◽  
Vol 26 (1) ◽  
pp. 89-106
Author(s):  
Kohei Hiraga ◽  
Osamu Tatebe ◽  
Hideyuki Kawashima
Keyword(s):  
High Performance ◽  
File Systems ◽  
Software Transactional Memory ◽  
Server Side ◽  
Multiple Servers ◽  
Distributed Transaction ◽  
Lock Mode ◽  
Dynamic Software ◽  
Metadata Server ◽  
Performance Computing

Metadata performance scalability is critically important in high-performance computing when accessing many small files from millions of clients. This paper proposes a design of a scalable distributed metadata server, PPMDS, for parallel file systems using multiple key-value servers. In PPMDS, hierarchical namespace of a file system is efficiently managed by multiple servers. Multiple entries can be atomically updated using a nonblocking distributed transaction based on an algorithm of dynamic software transactional memory. This paper also proposes optimizations to further improve the metadata performance by introducing a server-side transaction processing, multiple readers, and a shared lock mode, which reduce the number of remote procedure calls and prevent unnecessary blocking. Performance evaluation shows the scalable performance up to 3 servers, and achieves 62,000 operations per second, which is 2.58x performance improvement compared to a single metadata performance.

Cluster File Systems

2011 ◽  
pp. 289-289
Author(s):  
Guy L. Steele ◽  
Xiaowei Shen ◽  
Josep Torrellas ◽  
Mark Tuckerman ◽  
Eric J. Bohm ◽  
...  
Keyword(s):  
File Systems ◽  
Cluster File

An Efficient Metadata Distribution Policy for Cluster File Systems

2005 ◽  
Author(s):  
Jin Xiong ◽  
Rongfeng Tang ◽  
Sining Wu ◽  
Dan Meng ◽  
Ninghui Sun
Keyword(s):  
File Systems ◽  
Cluster File

Energy Efficient Prefetching with Buffer Disks for Cluster File Systems

2010 ◽  
Author(s):  
Adam Manzanares ◽  
Xiaojun Ruan ◽  
Shu Yin ◽  
Jiong Xie ◽  
Zhiyang Ding ◽  
...  
Keyword(s):  
Energy Efficient ◽  
File Systems ◽  
Cluster File

Metadata Distribution and Consistency Techniques for Large-Scale Cluster File Systems

2011 ◽  
Vol 22 (5) ◽  
pp. 803-816 ◽  
Author(s):  
Jin Xiong ◽  
Yiming Hu ◽  
Guojie Li ◽  
Rongfeng Tang ◽  
Zhihua Fan
Keyword(s):  
Large Scale ◽  
File Systems ◽  
Cluster File

scholarly journals Parallel network file systems using authenticated key exchange protocols

2017 ◽  
Vol 2 (3) ◽  
pp. 161
Author(s):  
S. Sathya ◽  
M. Ranjith Kumar ◽  
K. Madheswaran
Keyword(s):  
Large Scale ◽  
File Systems ◽  
Key Exchange ◽  
Distributed File Systems ◽  
Authenticated Key Exchange ◽  
Forward Secrecy ◽  
Storage Devices ◽  
Key Exchange Protocols ◽  
Parallel Network ◽  
Metadata Server

The keyestablishment for secure many-to-many communications is very important nowadays. The problem is inspired by the proliferation of large-scale distributed file systems supporting parallel access to multiple storage devices. In this, a variety of authenticated key exchange protocols that are designed to address the issues. This shows that these protocols are capable of reducing the workload of the metadata server and concurrently supporting forward secrecy and escrow-freeness. All this requires only a small fraction of increased computation overhead at the client. This proposed three authenticated key exchange protocols for parallel network file system (pNFS). The protocols offer three appealing advantages over the existing Kerberos-based protocol. First, the metadata server executing these protocols has much lower workload than that of the Kerberos-based approach. Second, two of these protocols provide forward secrecy: one is partially forward secure (with respect to multiple sessions within a time period), while the other is fully forward secure (with respect to a session). Third, designed a protocol which not only provides forward secrecy, but is also escrow-free.

Sign in / Sign up

Export Citation Format

Share Document