xfs
[Top] [All Lists]

Re: file system defragmentation

To: Cosmo Nova <cs_mcc98@xxxxxxxxxxx>
Subject: Re: file system defragmentation
From: David Chatterton <chatz@xxxxxxxxxxxxxxxxx>
Date: Mon, 17 Jul 2006 19:32:30 +1000
Cc: linux-xfs@xxxxxxxxxxx
In-reply-to: <5356806.post@xxxxxxxxxxxxxxx>
Organization: SGI
References: <4f52331f050826001612f8e323@xxxxxxxxxxxxxx> <20050826101131.GA24544@xxxxxxxxx> <4f52331f0508260848782f240a@xxxxxxxxxxxxxx> <43128F82.4010004@xxxxxxxxx> <4312913F.6040205@xxxxxxxxxxxxxxx> <43311567.3060208@xxxxxxxxx> <5356806.post@xxxxxxxxxxxxxxx>
Reply-to: chatz@xxxxxxxxxxxxxxxxx
Sender: xfs-bounce@xxxxxxxxxxx
User-agent: Mozilla Thunderbird 1.0.6 (Windows/20050716)


Cosmo Nova wrote:
Hi, you mentioned delayed allocation. What is the size of the buffer holding
the data, before they're actually written to disk? How can it tackle growing
files?

I'll leave the details for Nathan/Dave...


If I have a DVR system of 16 channels. They keep writing data to the disk in
pieces of video files. I read some spec of xfs. Apart from extend-based
allocation, there're allocaiton groups in xfs. I would like to ask, does
XFS's allocation groups work similar as JFS's, which would lock an
allocation group for individual file write? How does the allocation group in
XFS work? And how would it help the fragmentation problem?


Locking down an allocation group is part of what a new "filestream"
mount option will provide. This feature is already in use at a
number of IRIX sites with media apps (mainly in conjunction with CXFS
since you have more writers in a clustered filesystem and more need to
lock down contiguous space), and is coming to Linux XFS soon.

The best way to tackle fragementation with streaming data is to
preallocate space for the files. This allows the allocator to
try to find the space you require using as large contiguous chunks
as it can find. See xfsctl(3).

David

--
David Chatterton                   Phone: +61 3 9963 1934
XFS Engineering Manager            Mobile: +61 409 154 121
SGI Australia          http://www.sgi.com/products/storage


<Prev in Thread] Current Thread [Next in Thread>