X-Spam-Checker-Version: SpamAssassin 3.4.0-r929098 (2010-03-30) on oss.sgi.com X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham version=3.4.0-r929098 Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id oAGD540B050328 for ; Tue, 16 Nov 2010 07:05:05 -0600 X-ASG-Debug-ID: 1289912795-488d002c0000-NocioJ X-Barracuda-URL: http://cuda.sgi.com:80/cgi-bin/mark.cgi Received: from moutng.kundenserver.de (localhost [127.0.0.1]) by cuda.sgi.com (Spam Firewall) with ESMTP id 54C601C46572 for ; Tue, 16 Nov 2010 05:06:35 -0800 (PST) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.171]) by cuda.sgi.com with ESMTP id SHTqd2ztKSs5IHPf for ; Tue, 16 Nov 2010 05:06:35 -0800 (PST) Received: from [192.168.243.36] (83-238-22-2.ip.netia.com.pl [83.238.22.2]) by mrelayeu.kundenserver.de (node=mrbap1) with ESMTP (Nemesis) id 0M9NGg-1PCLEi3pd8-00D2kE; Tue, 16 Nov 2010 14:06:35 +0100 Message-ID: <4CE282DB.8060200@open-e.com> Date: Tue, 16 Nov 2010 14:10:51 +0100 From: Piotr Kandziora User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.15) Gecko/20101027 Thunderbird/3.0.10 MIME-Version: 1.0 To: xfs@oss.sgi.com CC: Janusz Bak , Artur Piechocki , lukasz.wittig@open-e.com X-ASG-Orig-Subj: XFS: I/O Error Detected / 2.6.27.39 Subject: XFS: I/O Error Detected / 2.6.27.39 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Provags-ID: V02:K0:LzB7ArObNIgxPzq1gUhAk/XCTvt66pQarKDtWsiaZ+6 Njsv1zug7zAggoAuWpwQ8MBmU9iJwAfbzJ+tytFIgKwenR0k7F PYG0O8dQ7Q3ZDkGNRc66C/FGyZB+HLrZF+fSMZ5Nar4Fvhfj6T vxl1iVE0m0qasNKag9WlzROLyLN424uWw8Onz1iFrWeQoNHCZ8 ixfz94DEgF0CeVWk0XJ2+e3Siaopy6yv8NFe0tF1zI= X-Barracuda-Connect: moutng.kundenserver.de[212.227.126.171] X-Barracuda-Start-Time: 1289912796 X-Barracuda-Bayes: INNOCENT GLOBAL 0.0000 1.0000 -2.0210 X-Barracuda-Virus-Scanned: by cuda.sgi.com at sgi.com X-Barracuda-Spam-Score: -2.02 X-Barracuda-Spam-Status: No, SCORE=-2.02 using per-user scores of TAG_LEVEL=2.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=2.1 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.46794 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- X-Virus-Scanned: ClamAV version 0.94.2, clamav-milter version 0.94.2 on oss.sgi.com X-Virus-Status: Clean Hi, Our environment is following: - we have 24GB RAM, - we are using 3ware controller (and it does not report any errors), - we have one big logical volume (20TB) exported via NFS with large amount of small files (about 150k), - we are doing periodically backup of this logical volume using rsync to another server. - we have kernel 2.6.27.39, Unfortunately our system is freezing unexpectedly without reason. We started investigating this problem and noticed that cache memory is slowly increasing. We tried to dump this cache memory using: /bin/echo "3" > /proc/sys/vm/drop_caches In a result, cache was dumped, but in logs we noticed a lot of errors with XFS: [kern.warning] kernel: xfs_iunlink_remove: xfs_inotobp() returned an error 22 on dm-16. Returning error. [kern.notice] kernel: xfs_inactive:\011xfs_ifree() returned an error = 22 on dm-16 [kern.notice] kernel: xfs_force_shutdown(dm-16,0x1) called from line 1406 of file fs/xfs/xfs_vnodeops.c. Return address = 0x [kern.alert] kernel: Filesystem \"dm-16\": I/O Error Detected. Shutting down filesystem: dm-16 [kern.alert] kernel: Please umount the filesystem, and rectify the problem(s) [kern.warning] kernel: xfs_imap_to_bp: xfs_trans_read_buf()returned an error 5 on dm-16. Returning error. [kern.warning] kernel: xfs_imap_to_bp: xfs_trans_read_buf()returned an error 5 on dm-16. Returning error. [kern.warning] kernel: xfs_imap_to_bp: xfs_trans_read_buf()returned an error 5 on dm-16. Returning error. We are wondering if this is problem connected to hardware or rather this is XFS problem (if yes, was it fixed?). Best regards Piotr K