[OpenIndiana-discuss] damaged rpool c < SPA_MAXBLOCKSIZE >> SPA_MINBLOCKSHIFT
Ray Arachelian
ray at arachelian.com
Wed Sep 12 18:31:52 UTC 2012
So last week, my server's rpool got damaged, the last thing I did on
there was pkg install squid - I don't believe this caused the issue.
This ran oi151a5.
The machine was stuck in a reboot loop, would load up grub, show the
splash screen, reboot. If I pressed ESC, or passed -s to grub, it never
got to single user mode, so I don't even think it got as far as actually
loading the kernel all the way through.
Attempting to boot off the mirror drive produced the same results.
format-analyze-read shows no block errors, so this is a bug. At some
point I had dedupe turned on, but later turned it off, so some of the
files are deduped. I don't think this was related.
This rpool had a cache drive on a 60G SSD, which I wiped off and
installed and upgraded to the latest oi151a6 on it to use as a recovery
OS. I then tried to import it read only with zfs_recovery=1 and aok=1
in (with a new name.) It churned for a while and then *rebooted* this
new oi151a6 install. Trying to run zdb against it from there failed,
saying that rpool was already imported (I used the zpool ID number, and
that had the same effect.)
Went back to the live 151a5 DVD, and I finally got zdb to spit out a
message indicating the error.
Attempting to import off the live DVD even with zfs_recover set, it
still panics the machine.
What can I do to get it fixed? (Yes, I know, restore from backup is
going to be the default answer, what can I do other than restore from
backup, and more importantly, for the health of zfs, what bug caused
this issue in the first place?)
Only thing I've not attempted to do is roll back to older txg's, which
I'll try tonight.
1 root at openindiana:/jack# zdb -e -bcsvLF 6427596636711879020
2 Assertion failed: c < SPA_MAXBLOCKSIZE >> SPA_MINBLOCKSHIFT,
file ../../../uts/common/fs/zfs/zio.c, line 217, function zio_buf_alloc
3 Abort (core dumped)
4 root at openindiana:/jack#
5
6 root at openindiana:/jack# zdb -e -bcsvLX 6427596636711879020
7 Assertion failed: c < SPA_MAXBLOCKSIZE >> SPA_MINBLOCKSHIFT,
file ../../../uts/common/fs/zfs/zio.c, line 217, function zio_buf_alloc
8 Abort (core dumped)
9 root at openindiana:/jack# ls -Fla core
10 -rw------- 1 root root 36143325 2012-09-12 08:24 core
11
12 root at openindiana:/jack# uname -a
13 SunOS openindiana 5.11 oi_151a5 i86pc i386 i86pc Solaris
14 root at openindiana:/jack# cat /etc/motd
15 OpenIndiana (powered by illumos) SunOS 5.11 oi_151a5
June 2012
16 root at openindiana:/jack#
17
18 root at openindiana:/jack# zdb -l /dev/rdsk/c0d0s0
19 --------------------------------------------
20 LABEL 0
21 --------------------------------------------
22 version: 28
23 name: 'rpool'
24 state: 0
25 txg: 180765347
26 pool_guid: 6427596636711879020
27 hostid: 12891326
28 hostname: ''
29 top_guid: 117359753547582566
30 guid: 15559342679365141622
31 vdev_children: 1
32 vdev_tree:
33 type: 'mirror'
34 id: 0
35 guid: 117359753547582566
36 whole_disk: 0
37 metaslab_array: 23
38 metaslab_shift: 34
39 ashift: 9
40 asize: 2000152952832
41 is_log: 0
42 create_txg: 4
43 children[0]:
44 type: 'disk'
45 id: 0
46 guid: 15559342679365141622
47 path: '/dev/dsk/c5d0s0'
48 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
49 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
50 whole_disk: 0
51 DTL: 259
52 create_txg: 4
53 children[1]:
54 type: 'disk'
55 id: 1
56 guid: 7925602396183002753
57 path: '/dev/dsk/c6d0s0'
58 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
59 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
60 whole_disk: 0
61 DTL: 85
62 create_txg: 4
63 resilvering: 1
64 features_for_read:
65 --------------------------------------------
66 LABEL 1
67 --------------------------------------------
68 version: 28
69 name: 'rpool'
70 state: 0
71 txg: 180765347
72 pool_guid: 6427596636711879020
73 hostid: 12891326
74 hostname: ''
75 top_guid: 117359753547582566
76 guid: 15559342679365141622
77 vdev_children: 1
78 vdev_tree:
79 type: 'mirror'
80 id: 0
81 guid: 117359753547582566
82 whole_disk: 0
83 metaslab_array: 23
84 metaslab_shift: 34
85 ashift: 9
86 asize: 2000152952832
87 is_log: 0
88 create_txg: 4
89 children[0]:
90 type: 'disk'
91 id: 0
92 guid: 15559342679365141622
93 path: '/dev/dsk/c5d0s0'
94 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
95 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
96 whole_disk: 0
97 DTL: 259
98 create_txg: 4
99 children[1]:
100 type: 'disk'
101 id: 1
102 guid: 7925602396183002753
103 path: '/dev/dsk/c6d0s0'
104 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
105 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
106 whole_disk: 0
107 DTL: 85
108 create_txg: 4
109 resilvering: 1
110 features_for_read:
111 --------------------------------------------
112 LABEL 2
113 --------------------------------------------
114 version: 28
115 name: 'rpool'
116 state: 0
117 txg: 180765347
118 pool_guid: 6427596636711879020
119 hostid: 12891326
120 hostname: ''
121 top_guid: 117359753547582566
122 guid: 15559342679365141622
123 vdev_children: 1
124 vdev_tree:
125 type: 'mirror'
126 id: 0
127 guid: 117359753547582566
128 whole_disk: 0
129 metaslab_array: 23
130 metaslab_shift: 34
131 ashift: 9
132 asize: 2000152952832
133 is_log: 0
134 create_txg: 4
135 children[0]:
136 type: 'disk'
137 id: 0
138 guid: 15559342679365141622
139 path: '/dev/dsk/c5d0s0'
140 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
141 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
142 whole_disk: 0
143 DTL: 259
144 create_txg: 4
145 children[1]:
146 type: 'disk'
147 id: 1
148 guid: 7925602396183002753
149 path: '/dev/dsk/c6d0s0'
150 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
151 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
152 whole_disk: 0
153 DTL: 85
154 create_txg: 4
155 resilvering: 1
156 features_for_read:
157 --------------------------------------------
158 LABEL 3
159 --------------------------------------------
160 version: 28
161 name: 'rpool'
162 state: 0
163 txg: 180765347
164 pool_guid: 6427596636711879020
165 hostid: 12891326
166 hostname: ''
167 top_guid: 117359753547582566
168 guid: 15559342679365141622
169 vdev_children: 1
170 vdev_tree:
171 type: 'mirror'
172 id: 0
173 guid: 117359753547582566
174 whole_disk: 0
175 metaslab_array: 23
176 metaslab_shift: 34
177 ashift: 9
178 asize: 2000152952832
179 is_log: 0
180 create_txg: 4
181 children[0]:
182 type: 'disk'
183 id: 0
184 guid: 15559342679365141622
185 path: '/dev/dsk/c5d0s0'
186 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
187 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
188 whole_disk: 0
189 DTL: 259
190 create_txg: 4
191 children[1]:
192 type: 'disk'
193 id: 1
194 guid: 7925602396183002753
195 path: '/dev/dsk/c6d0s0'
196 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
197 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
198 whole_disk: 0
199 DTL: 85
200 create_txg: 4
201 resilvering: 1
202 features_for_read:
203 root at openindiana:/jack#
204
205 root at openindiana:/jack# zdb -l /dev/rdsk/c1d0s0
206 --------------------------------------------
207 LABEL 0
208 --------------------------------------------
209 version: 28
210 name: 'rpool'
211 state: 0
212 txg: 180765347
213 pool_guid: 6427596636711879020
214 hostid: 12891326
215 hostname: ''
216 top_guid: 117359753547582566
217 guid: 7925602396183002753
218 vdev_children: 1
219 vdev_tree:
220 type: 'mirror'
221 id: 0
222 guid: 117359753547582566
223 whole_disk: 0
224 metaslab_array: 23
225 metaslab_shift: 34
226 ashift: 9
227 asize: 2000152952832
228 is_log: 0
229 create_txg: 4
230 children[0]:
231 type: 'disk'
232 id: 0
233 guid: 15559342679365141622
234 path: '/dev/dsk/c5d0s0'
235 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
236 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
237 whole_disk: 0
238 DTL: 259
239 create_txg: 4
240 children[1]:
241 type: 'disk'
242 id: 1
243 guid: 7925602396183002753
244 path: '/dev/dsk/c6d0s0'
245 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
246 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
247 whole_disk: 0
248 DTL: 85
249 create_txg: 4
250 resilvering: 1
251 features_for_read:
252 --------------------------------------------
253 LABEL 1
254 --------------------------------------------
255 version: 28
256 name: 'rpool'
257 state: 0
258 txg: 180765347
259 pool_guid: 6427596636711879020
260 hostid: 12891326
261 hostname: ''
262 top_guid: 117359753547582566
263 guid: 7925602396183002753
264 vdev_children: 1
265 vdev_tree:
266 type: 'mirror'
267 id: 0
268 guid: 117359753547582566
269 whole_disk: 0
270 metaslab_array: 23
271 metaslab_shift: 34
272 ashift: 9
273 asize: 2000152952832
274 is_log: 0
275 create_txg: 4
276 children[0]:
277 type: 'disk'
278 id: 0
279 guid: 15559342679365141622
280 path: '/dev/dsk/c5d0s0'
281 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
282 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
283 whole_disk: 0
284 DTL: 259
285 create_txg: 4
286 children[1]:
287 type: 'disk'
288 id: 1
289 guid: 7925602396183002753
290 path: '/dev/dsk/c6d0s0'
291 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
292 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
293 whole_disk: 0
294 DTL: 85
295 create_txg: 4
296 resilvering: 1
297 features_for_read:
298 --------------------------------------------
299 LABEL 2
300 --------------------------------------------
301 version: 28
302 name: 'rpool'
303 state: 0
304 txg: 180765347
305 pool_guid: 6427596636711879020
306 hostid: 12891326
307 hostname: ''
308 top_guid: 117359753547582566
309 guid: 7925602396183002753
310 vdev_children: 1
311 vdev_tree:
312 type: 'mirror'
313 id: 0
314 guid: 117359753547582566
315 whole_disk: 0
316 metaslab_array: 23
317 metaslab_shift: 34
318 ashift: 9
319 asize: 2000152952832
320 is_log: 0
321 create_txg: 4
322 children[0]:
323 type: 'disk'
324 id: 0
325 guid: 15559342679365141622
326 path: '/dev/dsk/c5d0s0'
327 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
328 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
329 whole_disk: 0
330 DTL: 259
331 create_txg: 4
332 children[1]:
333 type: 'disk'
334 id: 1
335 guid: 7925602396183002753
336 path: '/dev/dsk/c6d0s0'
337 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
338 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
339 whole_disk: 0
340 DTL: 85
341 create_txg: 4
342 resilvering: 1
343 features_for_read:
344 --------------------------------------------
345 LABEL 3
346 --------------------------------------------
347 version: 28
348 name: 'rpool'
349 state: 0
350 txg: 180765347
351 pool_guid: 6427596636711879020
352 hostid: 12891326
353 hostname: ''
354 top_guid: 117359753547582566
355 guid: 7925602396183002753
356 vdev_children: 1
357 vdev_tree:
358 type: 'mirror'
359 id: 0
360 guid: 117359753547582566
361 whole_disk: 0
362 metaslab_array: 23
363 metaslab_shift: 34
364 ashift: 9
365 asize: 2000152952832
366 is_log: 0
367 create_txg: 4
368 children[0]:
369 type: 'disk'
370 id: 0
371 guid: 15559342679365141622
372 path: '/dev/dsk/c5d0s0'
373 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX0BD/a'
374 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 0/cmdk at 0,0:a'
375 whole_disk: 0
376 DTL: 259
377 create_txg: 4
378 children[1]:
379 type: 'disk'
380 id: 1
381 guid: 7925602396183002753
382 path: '/dev/dsk/c6d0s0'
383 devid:
'id1,cmdk at AHitachi_HDS5C3020ALA632=______ML0220F30XX3BD/a'
384 phys_path: '/pci at 0,0/pci-ide at 1f,2/ide at 1/cmdk at 0,0:a'
385 whole_disk: 0
386 DTL: 85
387 create_txg: 4
388 resilvering: 1
389 features_for_read:
390 root at openindiana:/jack#
391
More information about the OpenIndiana-discuss
mailing list