[OpenIndiana-discuss] Zfs ignoring spares?
Roy Sigurd Karlsbakk
roy at karlsbakk.net
Sun Dec 5 20:22:33 UTC 2010
Hi all
I have installed a new server with 77 2TB drives in 11 7-drive RAIDz2 VDEVs, all on WD Black drives. Now, it seems two of these drives were bad, one of them had a bunch of errors, the other was very slow. After zfs offlining these and then zfs replacing them with online spares, resilver ended and I thought it'd be ok. Appearently not. Albeit the resilver succeeds, the pool status is still degraded. A test with iozone also shows that the two degraded VDEVs are not used (much) during the test. See below for zpool -xv output.
I have done a few test on another system, and it showed, with raidz2 with a spare, removing one drive, waiting for it to resilver, same degraded status. zpool clear doesn't help. Removing another drive (not the spare) leaves it in the same degraded status. Removing a third (which should work, since the spare is in action) faults the pool.
Can someone help me how to fix this, or should I file a bug about this?
roy
root at prv-backup:~# zpool status -xv
pool: pbpool
state: DEGRADED
status: One or more devices has been taken offline by the administrator.
Sufficient replicas exist for the pool to continue functioning in a
degraded state.
action: Online the device using 'zpool online' or replace the device with
'zpool replace'.
scan: resilvered 385M in 0h12m with 0 errors on Sun Dec 5 21:06:38 2010
config:
NAME STATE READ WRITE CKSUM
pbpool DEGRADED 0 0 0
raidz2-0 ONLINE 0 0 0
c8t2d0 ONLINE 0 0 0
c8t3d0 ONLINE 0 0 0
c8t4d0 ONLINE 0 0 0
c8t5d0 ONLINE 0 0 0
c8t6d0 ONLINE 0 0 0
c8t7d0 ONLINE 0 0 0
c8t8d0 ONLINE 0 0 0
raidz2-1 DEGRADED 0 0 0
c8t9d0 ONLINE 0 0 0
c8t10d0 ONLINE 0 0 0
c8t11d0 ONLINE 0 0 0
c8t12d0 ONLINE 0 0 0
spare-4 DEGRADED 0 0 0
c8t13d0 OFFLINE 0 0 0
c4t43d0 ONLINE 0 0 0
c8t14d0 ONLINE 0 0 0
c8t15d0 ONLINE 0 0 0
raidz2-2 ONLINE 0 0 0
c8t16d0 ONLINE 0 0 0
c8t17d0 ONLINE 0 0 0
c8t18d0 ONLINE 0 0 0
c8t19d0 ONLINE 0 0 0
c8t20d0 ONLINE 0 0 0
c8t21d0 ONLINE 0 0 0
c8t22d0 ONLINE 0 0 0
raidz2-3 ONLINE 0 0 0
c8t23d0 ONLINE 0 0 0
c8t24d0 ONLINE 0 0 0
c8t25d0 ONLINE 0 0 0
c8t26d0 ONLINE 0 0 0
c8t27d0 ONLINE 0 0 0
c8t28d0 ONLINE 0 0 0
c8t29d0 ONLINE 0 0 0
raidz2-4 ONLINE 0 0 0
c8t30d0 ONLINE 0 0 0
c8t31d0 ONLINE 0 0 0
c8t32d0 ONLINE 0 0 0
c8t33d0 ONLINE 0 0 0
c8t34d0 ONLINE 0 0 0
c8t35d0 ONLINE 0 0 0
c4t0d0 ONLINE 0 0 0
raidz2-5 ONLINE 0 0 0
c4t1d0 ONLINE 0 0 0
c4t2d0 ONLINE 0 0 0
c4t3d0 ONLINE 0 0 0
c4t4d0 ONLINE 0 0 0
c4t5d0 ONLINE 0 0 0
c4t6d0 ONLINE 0 0 0
c4t7d0 ONLINE 0 0 0
raidz2-6 ONLINE 0 0 0
c4t8d0 ONLINE 0 0 0
c4t9d0 ONLINE 0 0 0
c4t10d0 ONLINE 0 0 0
c4t11d0 ONLINE 0 0 0
c4t12d0 ONLINE 0 0 0
c4t13d0 ONLINE 0 0 0
c4t14d0 ONLINE 0 0 0
raidz2-7 DEGRADED 0 0 0
c4t15d0 ONLINE 0 0 0
c4t16d0 ONLINE 0 0 0
spare-2 DEGRADED 0 0 0
c4t17d0 OFFLINE 0 0 0
c4t44d0 ONLINE 0 0 0
c4t18d0 ONLINE 0 0 0
c4t19d0 ONLINE 0 0 0
c4t20d0 ONLINE 0 0 0
c4t21d0 ONLINE 0 0 0
raidz2-8 ONLINE 0 0 0
c4t22d0 ONLINE 0 0 0
c4t23d0 ONLINE 0 0 0
c4t24d0 ONLINE 0 0 0
c4t25d0 ONLINE 0 0 0
c4t26d0 ONLINE 0 0 0
c4t27d0 ONLINE 0 0 0
c4t28d0 ONLINE 0 0 0
raidz2-9 ONLINE 0 0 0
c4t29d0 ONLINE 0 0 0
c4t30d0 ONLINE 0 0 0
c4t31d0 ONLINE 0 0 0
c4t32d0 ONLINE 0 0 0
c4t33d0 ONLINE 0 0 0
c4t34d0 ONLINE 0 0 0
c4t35d0 ONLINE 0 0 0
raidz2-10 ONLINE 0 0 0
c4t36d0 ONLINE 0 0 0
c4t37d0 ONLINE 0 0 0
c4t38d0 ONLINE 0 0 0
c4t39d0 ONLINE 0 0 0
c4t40d0 ONLINE 0 0 0
c4t41d0 ONLINE 0 0 0
c4t42d0 ONLINE 0 0 0
cache
c8t0d0 ONLINE 0 0 0
c8t1d0 ONLINE 0 0 0
spares
c4t43d0 INUSE currently in use
c4t44d0 INUSE currently in use
errors: No known data errors
root at prv-backup:~#
--
Vennlige hilsener / Best regards
roy
--
Roy Sigurd Karlsbakk
(+47) 97542685
roy at karlsbakk.net
http://blogg.karlsbakk.net/
--
I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk.
More information about the OpenIndiana-discuss
mailing list