[OpenIndiana-discuss] Build 147 ZFS / NFS / iSCSI system reboot

[Steve Jacobson]

Sure - the shelves are SuperMicro systems running Ubuntu 10.10.  There are 36 Seagate Constellation ES 2TB drives connected to 5 LSI 8888ELP controllers.  The drives are arranged in four groups of eight drives in RAID6 and one group of four drives in RAID5.  These five RAID groups are set up as iSCSI targets on the Ubuntu system.  There are two of these SuperMicro shelves.  So, there are ten LUNs available by iSCSI to OpenIndiana.  The tank is created with one VDEV for the ten LUNs.



--
Steve Jacobson | Director of Operations | Doyenz, Inc.
11245 SE 6th Street, Suite 120 | Bellevue, Wash. | 98004
Main: 206.905.4713 | Mobile: 206.310.7760 | Fax: 206.260.9129


-----Original Message-----
From: Mark [mailto:mark0x01 at gmail.com] 
Sent: Wednesday, February 16, 2011 11:15 PM
To: openindiana-discuss at openindiana.org
Subject: Re: [OpenIndiana-discuss] Build 147 ZFS / NFS / iSCSI system reboot

Hi Steve,

some more info on the shelves would help.
SCSI, FC , SAS, brands etc.

Mark.


On 17/02/2011 3:19 p.m., Steve Jacobson wrote:
> All,
>
> We have some systems that we're prototyping that use an OpenIndiana (b147) server with two disk shelves running Ubuntu linux 10.10 and iSCSI.  When we work with a single shelf with the head system, everything works perfectly.  When we add a second shelf, we are seeing frequent server reboots.  There is nothing showing up in /var/crash when this happens.  The last message that shows up in /var/adm/messages is:
>
>
> Feb 15 15:58:08 inp-production-zfs-archive-10 scsi: [ID 107833 kern.warning] WARNING: /iscsi/disk at 0000iqn.2007-07.com.doyenz%3Ainp-production-dshelf-09.megaraid00001,4 (sd19):
> Feb 15 15:58:08 inp-production-zfs-archive-10   incomplete write- retrying
> Feb 15 16:04:22 inp-production-zfs-archive-10 genunix: [ID 429879 kern.notice] ^MOpenIndiana Build oi_147 64-bit
>
> There are no disk or other types of errors showing up in the Linux systems' logs.  When the head system comes back, it appears to be just fine, but at some point in the future, when there is i/o, it will reboot again.
>
> Has anyone seen behavior like this before, or does anyone have any advice on how to debug / resolve this?
>
> Thanks!
>
> -Steve J
>
>
> --
> Steve Jacobson | Director of Operations | Doyenz, Inc.
> 11245 SE 6th Street, Suite 120 | Bellevue, Wash. | 98004
> Main: 206.905.4713 | Mobile: 206.310.7760 | Fax: 206.260.9129
>
> _______________________________________________
> OpenIndiana-discuss mailing list
> OpenIndiana-discuss at openindiana.org
> http://openindiana.org/mailman/listinfo/openindiana-discuss


_______________________________________________
OpenIndiana-discuss mailing list
OpenIndiana-discuss at openindiana.org
http://openindiana.org/mailman/listinfo/openindiana-discuss