[OpenIndiana-discuss] Build 147 ZFS / NFS / iSCSI system reboot
stevej at doyenz.com
Fri Feb 18 22:54:53 UTC 2011
We're using ietd 220.127.116.11 for the iSCSI target software with a very basic configuration:
Lun 0 Path=/dev/sdc,Type=blockio
Lun 1 Path=/dev/sdd,Type=blockio
Lun 2 Path=/dev/sde,Type=blockio
Lun 3 Path=/dev/sdf,Type=blockio
Lun 4 Path=/dev/sdg,Type=blockio
We're not using multipathing.
We've been testing a bunch of configs trying to nail this down, and our current theory is that there's a bug on the Ubuntu target side which causes an iSCSI reset on the initiator side. When this reset is occurring, we're getting the mutex_panic from what the iscsi initiator is doing with iscsi_handle_reset. We have some similar systems which work just fine, so we're trying to isolate the differences. One difference is that we are using 802.1q VLAN tagging on the new setups, and we're not on the old. We think that might be what's contributing to the reset call. Regardless, though, the panic on OI is our biggest concern.
Steve Jacobson | Director of Operations | Doyenz, Inc.
11245 SE 6th Street, Suite 120 | Bellevue, Wash. | 98004
Main: 206.905.4713 | Mobile: 206.310.7760 | Fax: 206.260.9129
From: Pasi Kärkkäinen [mailto:pasik at iki.fi]
Sent: Friday, February 18, 2011 1:57 AM
To: Discussion list for OpenIndiana
Subject: Re: [OpenIndiana-discuss] Build 147 ZFS / NFS / iSCSI system reboot
On Fri, Feb 18, 2011 at 07:43:47PM +1300, Mark wrote:
> On 18/02/2011 10:19 a.m., Steve Jacobson wrote:
>> Sure - the shelves are SuperMicro systems running Ubuntu 10.10. There are 36 Seagate Constellation ES 2TB drives connected to 5 LSI 8888ELP controllers. The drives are arranged in four groups of eight drives in RAID6 and one group of four drives in RAID5. These five RAID groups are set up as iSCSI targets on the Ubuntu system. There are two of these SuperMicro shelves. So, there are ten LUNs available by iSCSI to OpenIndiana. The tank is created with one VDEV for the ten LUNs.
> Sas or Sata version of drive, which model chassis and dual or single
> port connections?
OI/ZFS won't see the disk chassis or disk types at all, all it sees are the iSCSI LUNs exported by the Linux boxes.
So you mentioned you're using Ubuntu 10.10. What iSCSI target are you using? which exact version?
What's your iSCSI target configuration?
Are you using iSCSI multipathing from OI ? Did you try without?
OpenIndiana-discuss mailing list
OpenIndiana-discuss at openindiana.org
More information about the OpenIndiana-discuss