Measuring file access patterns in UNIX

In this paper, we present a new methodology for managing read-write filesets across multiple file servers of a Distributed File System, thus balancing the load of file access requests across servers. The proposed methodology is based on a rule-based data mining technique and graph theory algorithms. The rule-based technique generates rules from access request data to identify present file access patterns in the system. We then use the rules, graph analysis and statistical information (usage and size of the filesets) to relocate the filesets between different file servers. The algorithm for fileset relocation is based on the graph coloring problem. We tested our algorithms on data collected for five months on DFS file servers in a production environment. Experiments with the data show that our methodology can make intelligent decisions about file system transfers in order to balance the access request load across DFS servers.

Download Full-text

Characterizing parallel file-access patterns on a large-scale multiprocessor

Proceedings of 9th International Parallel Processing Symposium ◽

10.1109/ipps.1995.395928 ◽

2002 ◽

Cited By ~ 21

Author(s):

A. Purakayastha ◽

C. Ellis ◽

D. Kotz ◽

N. Nieuwejaar ◽

M.L. Best

Keyword(s):

Large Scale ◽

File Access ◽

Parallel File ◽

Access Patterns

Download Full-text

A model for optimizing file access patterns using spatio-temporal parallelism

Proceedings of the 8th International Workshop on Ultrascale Visualization - UltraVis '13 ◽

10.1145/2535571.2535593 ◽

2013 ◽

Author(s):

Boonthanome Nouanesengsy ◽

John Patchett ◽

James Ahrens ◽

Andrew Bauer ◽

Aashish Chaudhary ◽

...

Keyword(s):

File Access ◽

Spatio Temporal ◽

Access Patterns

Download Full-text

File Type and Access Pattern Aware Buffer Cache Management for Rendering Systems

Electronics ◽

10.3390/electronics9010164 ◽

2020 ◽

Vol 9 (1) ◽

pp. 164 ◽

Cited By ~ 1

Author(s):

Donghee Shin ◽

Kyungwoon Cho ◽

Hyokyung Bahn

Keyword(s):

General Purpose ◽

Cache Management ◽

Computing Systems ◽

File Access ◽

Management Scheme ◽

Buffer Cache ◽

Significant Performance ◽

High Resolution Images ◽

Access Patterns ◽

Cache System

Rendering is the process of generating high-resolution images by software, which is widely used in animation, video games and visual effects in movies. Although rendering is a computation-intensive job, we observe that storage accesses may become another performance bottleneck in desktop-rendering systems. In this article, we present a new buffer cache management scheme specialized for rendering systems. Unlike general-purpose computing systems, rendering systems exhibit specific file access patterns, and we show that this results in significant performance degradation in the buffer cache system. To cope with this situation, we collect various file input/output (I/O) traces of rendering workloads and analyze their access patterns. The results of this analysis show that file I/Os in rendering processes consist of long loops for configuration, short loops for texture input, random reads for input, and single-writes for output. Based on this observation, we propose a new buffer cache management scheme for improving the storage performance of rendering systems. Experimental results show that the proposed scheme improves the storage I/O performance by an average of 19% and a maximum of 55% compared to the conventional buffer cache system.

Download Full-text

How file access patterns influence interference among cluster applications

2014 IEEE International Conference on Cluster Computing (CLUSTER) ◽

10.1109/cluster.2014.6968743 ◽

2014 ◽

Cited By ~ 7

Author(s):

Chih-Song Kuo ◽

Aamer Shah ◽

Akihiro Nomura ◽

Satoshi Matsuoka ◽

Felix Wolf

Keyword(s):

File Access ◽

Access Patterns

Download Full-text