[OpenIndiana-discuss] [zfs] damaged rpool c < SPA_MAXBLOCKSIZE >> SPA_MINBLOCKSHIFT
George Wilson
george.wilson at delphix.com
Wed Sep 12 19:06:05 UTC 2012
Ray,
It looks like that it's trying to allocate a block that is larger that
what ZFS supports. You may want to use the 32-bit version of zdb
(/usr/sbin/i86/zdb) so that the corefile will display all the arguments.
Then can you post the stack trace by running 'mdb core' and at the mdb
prompt type $c.
Thanks,
George
On 9/12/12 2:31 PM, Ray Arachelian wrote:
> So last week, my server's rpool got damaged, the last thing I did on
> there was pkg install squid - I don't believe this caused the issue.
> This ran oi151a5.
>
> The machine was stuck in a reboot loop, would load up grub, show the
> splash screen, reboot. If I pressed ESC, or passed -s to grub, it never
> got to single user mode, so I don't even think it got as far as actually
> loading the kernel all the way through.
>
> Attempting to boot off the mirror drive produced the same results.
> format-analyze-read shows no block errors, so this is a bug. At some
> point I had dedupe turned on, but later turned it off, so some of the
> files are deduped. I don't think this was related.
>
> This rpool had a cache drive on a 60G SSD, which I wiped off and
> installed and upgraded to the latest oi151a6 on it to use as a recovery
> OS. I then tried to import it read only with zfs_recovery=1 and aok=1
> in (with a new name.) It churned for a while and then *rebooted* this
> new oi151a6 install. Trying to run zdb against it from there failed,
> saying that rpool was already imported (I used the zpool ID number, and
> that had the same effect.)
>
> Went back to the live 151a5 DVD, and I finally got zdb to spit out a
> message indicating the error.
>
> Attempting to import off the live DVD even with zfs_recover set, it
> still panics the machine.
>
> What can I do to get it fixed? (Yes, I know, restore from backup is
> going to be the default answer, what can I do other than restore from
> backup, and more importantly, for the health of zfs, what bug caused
> this issue in the first place?)
>
> Only thing I've not attempted to do is roll back to older txg's, which
> I'll try tonight.
>
>
> 1 root at openindiana:/jack# zdb -e -bcsvLF 6427596636711879020
> 2 Assertion failed: c < SPA_MAXBLOCKSIZE >> SPA_MINBLOCKSHIFT,
> file ../../../uts/common/fs/zfs/zio.c, line 217, function zio_buf_alloc
> 3 Abort (core dumped)
> 4 root at openindiana:/jack#
> 5
> 6 root at openindiana:/jack# zdb -e -bcsvLX 6427596636711879020
> 7 Assertion failed: c < SPA_MAXBLOCKSIZE >> SPA_MINBLOCKSHIFT,
> file ../../../uts/common/fs/zfs/zio.c, line 217, function zio_buf_alloc
> 8 Abort (core dumped)
> 9 root at openindiana:/jack# ls -Fla core
> 10 -rw------- 1 root root 36143325 2012-09-12 08:24 core
> 11
> 12 root at openindiana:/jack# uname -a
> 13 SunOS openindiana 5.11 oi_151a5 i86pc i386 i86pc Solaris
> 14 root at openindiana:/jack# cat /etc/motd
> 15 OpenIndiana (powered by illumos) SunOS 5.11 oi_151a5
> June 2012
> 16 root at openindiana:/jack#
> 17
> 18 root at openindiana:/jack# zdb -l /dev/rdsk/c0d0s0
> 19 --------------------------------------------
> 20 LABEL 0
> 21 --------------------------------------------
> 22 version: 28
> 23 name: 'rpool'
> 24 state: 0
> 25 txg: 180765347
> 26 pool_guid: 6427596636711879020
> 27 hostid: 12891326
> 28 hostname: ''
> 29 top_guid: 117359753547582566
> 30 guid: 15559342679365141622
> 31 vdev_children: 1
> 32 vdev_tree:
> 33 type: 'mirror'
> 34 id: 0
> 35 guid: 117359753547582566
> 36 whole_disk: 0
> 37 metaslab_array: 23
> 38 metaslab_shift: 34
> 39 ashift: 9
> 40 asize: 2000152952832
> 41 is_log: 0
> 42 create_txg: 4
> 43 children[0]:
> 44 type: 'disk'
> 45 id: 0
> 46 guid: 15559342679365141622
> 47 path: '/dev/dsk/c5d0s0'
> 48 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
> 49 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
> 50 whole_disk: 0
> 51 DTL: 259
> 52 create_txg: 4
> 53 children[1]:
> 54 type: 'disk'
> 55 id: 1
> 56 guid: 7925602396183002753
> 57 path: '/dev/dsk/c6d0s0'
> 58 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
> 59 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
> 60 whole_disk: 0
> 61 DTL: 85
> 62 create_txg: 4
> 63 resilvering: 1
> 64 features_for_read:
> 65 --------------------------------------------
> 66 LABEL 1
> 67 --------------------------------------------
> 68 version: 28
> 69 name: 'rpool'
> 70 state: 0
> 71 txg: 180765347
> 72 pool_guid: 6427596636711879020
> 73 hostid: 12891326
> 74 hostname: ''
> 75 top_guid: 117359753547582566
> 76 guid: 15559342679365141622
> 77 vdev_children: 1
> 78 vdev_tree:
> 79 type: 'mirror'
> 80 id: 0
> 81 guid: 117359753547582566
> 82 whole_disk: 0
> 83 metaslab_array: 23
> 84 metaslab_shift: 34
> 85 ashift: 9
> 86 asize: 2000152952832
> 87 is_log: 0
> 88 create_txg: 4
> 89 children[0]:
> 90 type: 'disk'
> 91 id: 0
> 92 guid: 15559342679365141622
> 93 path: '/dev/dsk/c5d0s0'
> 94 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
> 95 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
> 96 whole_disk: 0
> 97 DTL: 259
> 98 create_txg: 4
> 99 children[1]:
> 100 type: 'disk'
> 101 id: 1
> 102 guid: 7925602396183002753
> 103 path: '/dev/dsk/c6d0s0'
> 104 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
> 105 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
> 106 whole_disk: 0
> 107 DTL: 85
> 108 create_txg: 4
> 109 resilvering: 1
> 110 features_for_read:
> 111 --------------------------------------------
> 112 LABEL 2
> 113 --------------------------------------------
> 114 version: 28
> 115 name: 'rpool'
> 116 state: 0
> 117 txg: 180765347
> 118 pool_guid: 6427596636711879020
> 119 hostid: 12891326
> 120 hostname: ''
> 121 top_guid: 117359753547582566
> 122 guid: 15559342679365141622
> 123 vdev_children: 1
> 124 vdev_tree:
> 125 type: 'mirror'
> 126 id: 0
> 127 guid: 117359753547582566
> 128 whole_disk: 0
> 129 metaslab_array: 23
> 130 metaslab_shift: 34
> 131 ashift: 9
> 132 asize: 2000152952832
> 133 is_log: 0
> 134 create_txg: 4
> 135 children[0]:
> 136 type: 'disk'
> 137 id: 0
> 138 guid: 15559342679365141622
> 139 path: '/dev/dsk/c5d0s0'
> 140 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
> 141 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
> 142 whole_disk: 0
> 143 DTL: 259
> 144 create_txg: 4
> 145 children[1]:
> 146 type: 'disk'
> 147 id: 1
> 148 guid: 7925602396183002753
> 149 path: '/dev/dsk/c6d0s0'
> 150 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
> 151 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
> 152 whole_disk: 0
> 153 DTL: 85
> 154 create_txg: 4
> 155 resilvering: 1
> 156 features_for_read:
> 157 --------------------------------------------
> 158 LABEL 3
> 159 --------------------------------------------
> 160 version: 28
> 161 name: 'rpool'
> 162 state: 0
> 163 txg: 180765347
> 164 pool_guid: 6427596636711879020
> 165 hostid: 12891326
> 166 hostname: ''
> 167 top_guid: 117359753547582566
> 168 guid: 15559342679365141622
> 169 vdev_children: 1
> 170 vdev_tree:
> 171 type: 'mirror'
> 172 id: 0
> 173 guid: 117359753547582566
> 174 whole_disk: 0
> 175 metaslab_array: 23
> 176 metaslab_shift: 34
> 177 ashift: 9
> 178 asize: 2000152952832
> 179 is_log: 0
> 180 create_txg: 4
> 181 children[0]:
> 182 type: 'disk'
> 183 id: 0
> 184 guid: 15559342679365141622
> 185 path: '/dev/dsk/c5d0s0'
> 186 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
> 187 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
> 188 whole_disk: 0
> 189 DTL: 259
> 190 create_txg: 4
> 191 children[1]:
> 192 type: 'disk'
> 193 id: 1
> 194 guid: 7925602396183002753
> 195 path: '/dev/dsk/c6d0s0'
> 196 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
> 197 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
> 198 whole_disk: 0
> 199 DTL: 85
> 200 create_txg: 4
> 201 resilvering: 1
> 202 features_for_read:
> 203 root at openindiana:/jack#
> 204
> 205 root at openindiana:/jack# zdb -l /dev/rdsk/c1d0s0
> 206 --------------------------------------------
> 207 LABEL 0
> 208 --------------------------------------------
> 209 version: 28
> 210 name: 'rpool'
> 211 state: 0
> 212 txg: 180765347
> 213 pool_guid: 6427596636711879020
> 214 hostid: 12891326
> 215 hostname: ''
> 216 top_guid: 117359753547582566
> 217 guid: 7925602396183002753
> 218 vdev_children: 1
> 219 vdev_tree:
> 220 type: 'mirror'
> 221 id: 0
> 222 guid: 117359753547582566
> 223 whole_disk: 0
> 224 metaslab_array: 23
> 225 metaslab_shift: 34
> 226 ashift: 9
> 227 asize: 2000152952832
> 228 is_log: 0
> 229 create_txg: 4
> 230 children[0]:
> 231 type: 'disk'
> 232 id: 0
> 233 guid: 15559342679365141622
> 234 path: '/dev/dsk/c5d0s0'
> 235 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
> 236 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
> 237 whole_disk: 0
> 238 DTL: 259
> 239 create_txg: 4
> 240 children[1]:
> 241 type: 'disk'
> 242 id: 1
> 243 guid: 7925602396183002753
> 244 path: '/dev/dsk/c6d0s0'
> 245 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
> 246 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
> 247 whole_disk: 0
> 248 DTL: 85
> 249 create_txg: 4
> 250 resilvering: 1
> 251 features_for_read:
> 252 --------------------------------------------
> 253 LABEL 1
> 254 --------------------------------------------
> 255 version: 28
> 256 name: 'rpool'
> 257 state: 0
> 258 txg: 180765347
> 259 pool_guid: 6427596636711879020
> 260 hostid: 12891326
> 261 hostname: ''
> 262 top_guid: 117359753547582566
> 263 guid: 7925602396183002753
> 264 vdev_children: 1
> 265 vdev_tree:
> 266 type: 'mirror'
> 267 id: 0
> 268 guid: 117359753547582566
> 269 whole_disk: 0
> 270 metaslab_array: 23
> 271 metaslab_shift: 34
> 272 ashift: 9
> 273 asize: 2000152952832
> 274 is_log: 0
> 275 create_txg: 4
> 276 children[0]:
> 277 type: 'disk'
> 278 id: 0
> 279 guid: 15559342679365141622
> 280 path: '/dev/dsk/c5d0s0'
> 281 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
> 282 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
> 283 whole_disk: 0
> 284 DTL: 259
> 285 create_txg: 4
> 286 children[1]:
> 287 type: 'disk'
> 288 id: 1
> 289 guid: 7925602396183002753
> 290 path: '/dev/dsk/c6d0s0'
> 291 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
> 292 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
> 293 whole_disk: 0
> 294 DTL: 85
> 295 create_txg: 4
> 296 resilvering: 1
> 297 features_for_read:
> 298 --------------------------------------------
> 299 LABEL 2
> 300 --------------------------------------------
> 301 version: 28
> 302 name: 'rpool'
> 303 state: 0
> 304 txg: 180765347
> 305 pool_guid: 6427596636711879020
> 306 hostid: 12891326
> 307 hostname: ''
> 308 top_guid: 117359753547582566
> 309 guid: 7925602396183002753
> 310 vdev_children: 1
> 311 vdev_tree:
> 312 type: 'mirror'
> 313 id: 0
> 314 guid: 117359753547582566
> 315 whole_disk: 0
> 316 metaslab_array: 23
> 317 metaslab_shift: 34
> 318 ashift: 9
> 319 asize: 2000152952832
> 320 is_log: 0
> 321 create_txg: 4
> 322 children[0]:
> 323 type: 'disk'
> 324 id: 0
> 325 guid: 15559342679365141622
> 326 path: '/dev/dsk/c5d0s0'
> 327 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
> 328 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
> 329 whole_disk: 0
> 330 DTL: 259
> 331 create_txg: 4
> 332 children[1]:
> 333 type: 'disk'
> 334 id: 1
> 335 guid: 7925602396183002753
> 336 path: '/dev/dsk/c6d0s0'
> 337 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
> 338 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
> 339 whole_disk: 0
> 340 DTL: 85
> 341 create_txg: 4
> 342 resilvering: 1
> 343 features_for_read:
> 344 --------------------------------------------
> 345 LABEL 3
> 346 --------------------------------------------
> 347 version: 28
> 348 name: 'rpool'
> 349 state: 0
> 350 txg: 180765347
> 351 pool_guid: 6427596636711879020
> 352 hostid: 12891326
> 353 hostname: ''
> 354 top_guid: 117359753547582566
> 355 guid: 7925602396183002753
> 356 vdev_children: 1
> 357 vdev_tree:
> 358 type: 'mirror'
> 359 id: 0
> 360 guid: 117359753547582566
> 361 whole_disk: 0
> 362 metaslab_array: 23
> 363 metaslab_shift: 34
> 364 ashift: 9
> 365 asize: 2000152952832
> 366 is_log: 0
> 367 create_txg: 4
> 368 children[0]:
> 369 type: 'disk'
> 370 id: 0
> 371 guid: 15559342679365141622
> 372 path: '/dev/dsk/c5d0s0'
> 373 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
> 374 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
> 375 whole_disk: 0
> 376 DTL: 259
> 377 create_txg: 4
> 378 children[1]:
> 379 type: 'disk'
> 380 id: 1
> 381 guid: 7925602396183002753
> 382 path: '/dev/dsk/c6d0s0'
> 383 devid:
> 'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
> 384 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
> 385 whole_disk: 0
> 386 DTL: 85
> 387 create_txg: 4
> 388 resilvering: 1
> 389 features_for_read:
> 390 root at openindiana:/jack#
> 391
>
>
>
> -------------------------------------------
> illumos-zfs
> Archives: https://www.listbox.com/member/archive/182191/=now
> RSS Feed: https://www.listbox.com/member/archive/rss/182191/22008002-db9ec66f
> Modify Your Subscription: https://www.listbox.com/member/?member_id=22008002&id_secret=22008002-ca573e68
> Powered by Listbox: http://www.listbox.com
More information about the OpenIndiana-discuss
mailing list