X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,J_CHICKENPOX_43 autolearn=no version=3.4.0-r929098 Received: from cuda.sgi.com (cuda2.sgi.com [192.48.176.25]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id q0RAiJmE162639 for ; Fri, 27 Jan 2012 04:44:19 -0600 X-ASG-Debug-ID: 1327661054-04cbb01fb416bb90001-NocioJ Received: from bombadil.infradead.org (173-166-109-252-newengland.hfc.comcastbusiness.net [173.166.109.252]) by cuda.sgi.com with ESMTP id yIINvLAM8c2ldNkx (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Fri, 27 Jan 2012 02:44:14 -0800 (PST) X-Barracuda-Envelope-From: BATV+cb6efe93f59108224520+3078+infradead.org+hch@bombadil.srs.infradead.org X-Barracuda-Apparent-Source-IP: 173.166.109.252 Received: from hch by bombadil.infradead.org with local (Exim 4.76 #1 (Red Hat Linux)) id 1RqjHx-0004As-Qy; Fri, 27 Jan 2012 10:44:13 +0000 Date: Fri, 27 Jan 2012 05:44:13 -0500 From: Christoph Hellwig To: Manny Cc: xfs@oss.sgi.com Subject: Re: Insane file system overhead on large volume Message-ID: <20120127104413.GA12347@infradead.org> X-ASG-Orig-Subj: Re: Insane file system overhead on large volume References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-SRS-Rewrite: SMTP reverse-path rewritten from by bombadil.infradead.org See http://www.infradead.org/rpr.html X-Barracuda-Connect: 173-166-109-252-newengland.hfc.comcastbusiness.net[173.166.109.252] X-Barracuda-Start-Time: 1327661054 X-Barracuda-Encrypted: AES256-SHA X-Barracuda-URL: http://192.48.176.25:80/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at sgi.com X-Barracuda-Spam-Score: 0.10 X-Barracuda-Spam-Status: No, SCORE=0.10 using per-user scores of TAG_LEVEL=2.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.1 tests=RDNS_DYNAMIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.86827 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.10 RDNS_DYNAMIC Delivered to trusted network by host with dynamic-looking rDNS On Fri, Jan 27, 2012 at 08:50:38AM +0100, Manny wrote: > Hi there, > > I'm not sure if this is intended behavior, but I was a bit stumped > when I formatted a 30TB volume (12x3TB minus 2x3TB for parity in RAID > 6) with XFS and noticed that there were only 22 TB left. I just called > mkfs.xfs with default parameters - except for swith and sunit which > match the RAID setup. > > Is it normal that I lost 8TB just for the file system? That's almost > 30% of the volume. Should I set the block size higher? Or should I > increase the number of allocation groups? Would that make a > difference? Whats the preferred method for handling such large > volumes? Where did you get the sizes for the raw volume and the filesystem usage from?