[OpenIndiana-discuss] damaged rpool c < SPA_MAXBLOCKSIZE >> SPA_MINBLOCKSHIFT

Ray Arachelian ray at arachelian.com
Wed Sep 12 18:31:52 UTC 2012


So last week, my server's rpool got damaged, the last thing I did on
there was pkg install squid - I don't believe this caused the issue. 
This ran oi151a5.

The machine was stuck in a reboot loop, would load up grub, show the
splash screen, reboot.  If I pressed ESC, or passed -s to grub, it never
got to single user mode, so I don't even think it got as far as actually
loading the kernel all the way through.

Attempting to boot off the mirror drive produced the same results. 
format-analyze-read shows no block errors, so this is a bug.  At some
point I had dedupe turned on, but later turned it off, so some of the
files are deduped.  I don't think this was related.

This rpool had a cache drive on a 60G SSD, which I wiped off and
installed and upgraded to the latest oi151a6 on it to use as a recovery
OS.  I then tried to import it read only with zfs_recovery=1 and aok=1
in (with a new name.)  It churned for a while and then *rebooted* this
new oi151a6 install.  Trying to run zdb against it from there failed,
saying that rpool was already imported (I used the zpool ID number, and
that had the same effect.)

Went back to the live 151a5 DVD, and I finally got zdb to spit out a
message indicating the error.

Attempting to import off the live DVD even with zfs_recover set, it
still panics the machine.

What can I do to get it fixed?  (Yes, I know, restore from backup is
going to be the default answer, what can I do other than restore from
backup, and more importantly, for the health of zfs, what bug caused
this issue in the first place?)

Only thing I've not attempted to do is roll back to older txg's, which
I'll try tonight.


      1 root at openindiana:/jack# zdb -e -bcsvLF          6427596636711879020
      2 Assertion failed: c < SPA_MAXBLOCKSIZE >> SPA_MINBLOCKSHIFT,
file ../../../uts/common/fs/zfs/zio.c, line 217, function zio_buf_alloc
      3 Abort (core dumped)
      4 root at openindiana:/jack#
      5
      6 root at openindiana:/jack# zdb -e -bcsvLX          6427596636711879020
      7 Assertion failed: c < SPA_MAXBLOCKSIZE >> SPA_MINBLOCKSHIFT,
file ../../../uts/common/fs/zfs/zio.c, line 217, function zio_buf_alloc
      8 Abort (core dumped)
      9 root at openindiana:/jack# ls -Fla core
     10 -rw------- 1 root root 36143325 2012-09-12 08:24 core
     11
     12 root at openindiana:/jack# uname -a
     13 SunOS openindiana 5.11 oi_151a5 i86pc i386 i86pc Solaris
     14 root at openindiana:/jack# cat /etc/motd
     15 OpenIndiana (powered by illumos)    SunOS 5.11    oi_151a5   
June 2012
     16 root at openindiana:/jack#
     17
     18 root at openindiana:/jack# zdb -l /dev/rdsk/c0d0s0
     19 --------------------------------------------
     20 LABEL 0
     21 --------------------------------------------
     22     version: 28
     23     name: 'rpool'
     24     state: 0
     25     txg: 180765347
     26     pool_guid: 6427596636711879020
     27     hostid: 12891326
     28     hostname: ''
     29     top_guid: 117359753547582566
     30     guid: 15559342679365141622
     31     vdev_children: 1
     32     vdev_tree:
     33         type: 'mirror'
     34         id: 0
     35         guid: 117359753547582566
     36         whole_disk: 0
     37         metaslab_array: 23
     38         metaslab_shift: 34
     39         ashift: 9
     40         asize: 2000152952832
     41         is_log: 0
     42         create_txg: 4
     43         children[0]:
     44             type: 'disk'
     45             id: 0
     46             guid: 15559342679365141622
     47             path: '/dev/dsk/c5d0s0'
     48             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
     49             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
     50             whole_disk: 0
     51             DTL: 259
     52             create_txg: 4
     53         children[1]:
     54             type: 'disk'
     55             id: 1
     56             guid: 7925602396183002753
     57             path: '/dev/dsk/c6d0s0'
     58             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
     59             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
     60             whole_disk: 0
     61             DTL: 85
     62             create_txg: 4
     63             resilvering: 1
     64     features_for_read:
     65 --------------------------------------------
     66 LABEL 1
     67 --------------------------------------------
     68     version: 28
     69     name: 'rpool'
     70     state: 0
     71     txg: 180765347
     72     pool_guid: 6427596636711879020
     73     hostid: 12891326
     74     hostname: ''
     75     top_guid: 117359753547582566
     76     guid: 15559342679365141622
     77     vdev_children: 1
     78     vdev_tree:
     79         type: 'mirror'
     80         id: 0
     81         guid: 117359753547582566
     82         whole_disk: 0
     83         metaslab_array: 23
     84         metaslab_shift: 34
     85         ashift: 9
     86         asize: 2000152952832
     87         is_log: 0
     88         create_txg: 4
     89         children[0]:
     90             type: 'disk'
     91             id: 0
     92             guid: 15559342679365141622
     93             path: '/dev/dsk/c5d0s0'
     94             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
     95             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
     96             whole_disk: 0
     97             DTL: 259
     98             create_txg: 4
     99         children[1]:
    100             type: 'disk'
    101             id: 1
    102             guid: 7925602396183002753
    103             path: '/dev/dsk/c6d0s0'
    104             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
    105             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
    106             whole_disk: 0
    107             DTL: 85
    108             create_txg: 4
    109             resilvering: 1
    110     features_for_read:
    111 --------------------------------------------
    112 LABEL 2
    113 --------------------------------------------
    114     version: 28
    115     name: 'rpool'
    116     state: 0
    117     txg: 180765347
    118     pool_guid: 6427596636711879020
    119     hostid: 12891326
    120     hostname: ''
    121     top_guid: 117359753547582566
    122     guid: 15559342679365141622
    123     vdev_children: 1
    124     vdev_tree:
    125         type: 'mirror'
    126         id: 0
    127         guid: 117359753547582566
    128         whole_disk: 0
    129         metaslab_array: 23
    130         metaslab_shift: 34
    131         ashift: 9
    132         asize: 2000152952832
    133         is_log: 0
    134         create_txg: 4
    135         children[0]:
    136             type: 'disk'
    137             id: 0
    138             guid: 15559342679365141622
    139             path: '/dev/dsk/c5d0s0'
    140             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
    141             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
    142             whole_disk: 0
    143             DTL: 259
    144             create_txg: 4
    145         children[1]:
    146             type: 'disk'
    147             id: 1
    148             guid: 7925602396183002753
    149             path: '/dev/dsk/c6d0s0'
    150             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
    151             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
    152             whole_disk: 0
    153             DTL: 85
    154             create_txg: 4
    155             resilvering: 1
    156     features_for_read:
    157 --------------------------------------------
    158 LABEL 3
    159 --------------------------------------------
    160     version: 28
    161     name: 'rpool'
    162     state: 0
    163     txg: 180765347
    164     pool_guid: 6427596636711879020
    165     hostid: 12891326
    166     hostname: ''
    167     top_guid: 117359753547582566
    168     guid: 15559342679365141622
    169     vdev_children: 1
    170     vdev_tree:
    171         type: 'mirror'
    172         id: 0
    173         guid: 117359753547582566
    174         whole_disk: 0
    175         metaslab_array: 23
    176         metaslab_shift: 34
    177         ashift: 9
    178         asize: 2000152952832
    179         is_log: 0
    180         create_txg: 4
    181         children[0]:
    182             type: 'disk'
    183             id: 0
    184             guid: 15559342679365141622
    185             path: '/dev/dsk/c5d0s0'
    186             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
    187             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
    188             whole_disk: 0
    189             DTL: 259
    190             create_txg: 4
    191         children[1]:
    192             type: 'disk'
    193             id: 1
    194             guid: 7925602396183002753
    195             path: '/dev/dsk/c6d0s0'
    196             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
    197             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
    198             whole_disk: 0
    199             DTL: 85
    200             create_txg: 4
    201             resilvering: 1
    202     features_for_read:
    203 root at openindiana:/jack#
    204
    205 root at openindiana:/jack# zdb -l /dev/rdsk/c1d0s0
    206 --------------------------------------------
    207 LABEL 0
    208 --------------------------------------------
    209     version: 28
    210     name: 'rpool'
    211     state: 0
    212     txg: 180765347
    213     pool_guid: 6427596636711879020
    214     hostid: 12891326
    215     hostname: ''
    216     top_guid: 117359753547582566
    217     guid: 7925602396183002753
    218     vdev_children: 1
    219     vdev_tree:
    220         type: 'mirror'
    221         id: 0
    222         guid: 117359753547582566
    223         whole_disk: 0
    224         metaslab_array: 23
    225         metaslab_shift: 34
    226         ashift: 9
    227         asize: 2000152952832
    228         is_log: 0
    229         create_txg: 4
    230         children[0]:
    231             type: 'disk'
    232             id: 0
    233             guid: 15559342679365141622
    234             path: '/dev/dsk/c5d0s0'
    235             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
    236             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
    237             whole_disk: 0
    238             DTL: 259
    239             create_txg: 4
    240         children[1]:
    241             type: 'disk'
    242             id: 1
    243             guid: 7925602396183002753
    244             path: '/dev/dsk/c6d0s0'
    245             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
    246             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
    247             whole_disk: 0
    248             DTL: 85
    249             create_txg: 4
    250             resilvering: 1
    251     features_for_read:
    252 --------------------------------------------
    253 LABEL 1
    254 --------------------------------------------
    255     version: 28
    256     name: 'rpool'
    257     state: 0
    258     txg: 180765347
    259     pool_guid: 6427596636711879020
    260     hostid: 12891326
    261     hostname: ''
    262     top_guid: 117359753547582566
    263     guid: 7925602396183002753
    264     vdev_children: 1
    265     vdev_tree:
    266         type: 'mirror'
    267         id: 0
    268         guid: 117359753547582566
    269         whole_disk: 0
    270         metaslab_array: 23
    271         metaslab_shift: 34
    272         ashift: 9
    273         asize: 2000152952832
    274         is_log: 0
    275         create_txg: 4
    276         children[0]:
    277             type: 'disk'
    278             id: 0
    279             guid: 15559342679365141622
    280             path: '/dev/dsk/c5d0s0'
    281             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
    282             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
    283             whole_disk: 0
    284             DTL: 259
    285             create_txg: 4
    286         children[1]:
    287             type: 'disk'
    288             id: 1
    289             guid: 7925602396183002753
    290             path: '/dev/dsk/c6d0s0'
    291             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
    292             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
    293             whole_disk: 0
    294             DTL: 85
    295             create_txg: 4
    296             resilvering: 1
    297     features_for_read:
    298 --------------------------------------------
    299 LABEL 2
    300 --------------------------------------------
    301     version: 28
    302     name: 'rpool'
    303     state: 0
    304     txg: 180765347
    305     pool_guid: 6427596636711879020
    306     hostid: 12891326
    307     hostname: ''
    308     top_guid: 117359753547582566
    309     guid: 7925602396183002753
    310     vdev_children: 1
    311     vdev_tree:
    312         type: 'mirror'
    313         id: 0
    314         guid: 117359753547582566
    315         whole_disk: 0
    316         metaslab_array: 23
    317         metaslab_shift: 34
    318         ashift: 9
    319         asize: 2000152952832
    320         is_log: 0
    321         create_txg: 4
    322         children[0]:
    323             type: 'disk'
    324             id: 0
    325             guid: 15559342679365141622
    326             path: '/dev/dsk/c5d0s0'
    327             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
    328             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
    329             whole_disk: 0
    330             DTL: 259
    331             create_txg: 4
    332         children[1]:
    333             type: 'disk'
    334             id: 1
    335             guid: 7925602396183002753
    336             path: '/dev/dsk/c6d0s0'
    337             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
    338             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
    339             whole_disk: 0
    340             DTL: 85
    341             create_txg: 4
    342             resilvering: 1
    343     features_for_read:
    344 --------------------------------------------
    345 LABEL 3
    346 --------------------------------------------
    347     version: 28
    348     name: 'rpool'
    349     state: 0
    350     txg: 180765347
    351     pool_guid: 6427596636711879020
    352     hostid: 12891326
    353     hostname: ''
    354     top_guid: 117359753547582566
    355     guid: 7925602396183002753
    356     vdev_children: 1
    357     vdev_tree:
    358         type: 'mirror'
    359         id: 0
    360         guid: 117359753547582566
    361         whole_disk: 0
    362         metaslab_array: 23
    363         metaslab_shift: 34
    364         ashift: 9
    365         asize: 2000152952832
    366         is_log: 0
    367         create_txg: 4
    368         children[0]:
    369             type: 'disk'
    370             id: 0
    371             guid: 15559342679365141622
    372             path: '/dev/dsk/c5d0s0'
    373             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
    374             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
    375             whole_disk: 0
    376             DTL: 259
    377             create_txg: 4
    378         children[1]:
    379             type: 'disk'
    380             id: 1
    381             guid: 7925602396183002753
    382             path: '/dev/dsk/c6d0s0'
    383             devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
    384             phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
    385             whole_disk: 0
    386             DTL: 85
    387             create_txg: 4
    388             resilvering: 1
    389     features_for_read:
    390 root at openindiana:/jack#
    391




More information about the OpenIndiana-discuss mailing list