[OpenIndiana-discuss] Dell R510 SAS2 Backplane with SAS2008 (PERC H200)

Wed Nov 30 22:57:22 UTC 2011

I dont think its the controller card so much as I think its something to do
with the disks/backplane/power management even.  It works fine if I create
raid volumes.  if you wanted to be similar to Rich, you could just do a
bunch of raid 0's with a perc 600.  Using any type of raid with ZFS creates
its own challenges in both performance tuning as well as recovery.

I would buy a 1U pizza box and a SAS HBA and JBOD.. In the past I had the
1078 chips connected to a AIC JBOD, never had issues, but then again it was
solaris 10..  Made expansion super easy.  I do miss my thumper still though
:)

Oracle says pretty clear that they dont support any type of expanders,
funny cause the J45xx series are all expanders..

I will try the illumos lists again..

On Wed, Nov 30, 2011 at 5:13 PM, Geoff Flarity <geoff.flarity at gmail.com>wrote:

> On Wed, Nov 30, 2011 at 5:02 PM, Andy Lubel <alubel at gmail.com> wrote:
> > Yeah, and you are probably exporting each disk as a raid 0, pseudo jbod
> > with some BBC.. I suppose that's an option for us but it
> > really shouldn't be that way.  The H200 can only create 2 raid disks
> > anyways.
> >
> > Is there any other lists that may be of help?
> >
>
> You might try the Illumos mailing list. I'm sure there's some nexenta
> people watching that one.
>
> Eventually I'm going to try to install OI on an R410. I figure worst
> case, maybe buy a different controller card?
>
>
>
> > On Wed, Nov 30, 2011 at 4:35 PM, Rich <rercola at acm.jhu.edu> wrote:
> >
> >> I'm on a Dell R710 and haven't seen any such issues.
> >>
> >> Then again, I'm using a different controller than you are (PERC 6/i,
> >> please don't ask me why).
> >>
> >> - Rich
> >>
> >> On Wed, Nov 30, 2011 at 4:17 PM, Andy Lubel <alubel at gmail.com> wrote:
> >> > I have a feeling that my culprit here could be the disks:
> ST2000NM0001.
> >> >  But its strange because again, everything works just fine in Solaris
> 10,
> >> > but in OI/Sol11 I get the errors.
> >> >
> >> > I have tried muddling with
> >> > stmsboot -d
> >> > /kernel/drv/scsi_vhci.conf
> >> > /kernel/drv/mpt.conf
> >> > /kernel/drv/mpt_sas.conf
> >> >
> >> > To no avail..  I'm working on getting new drives to try out, but it
> still
> >> > leaves some questions as to why this would work in solaris 10 and not
> in
> >> > the newer better IO/Sol11.  Any further ideas would really help!
> >> >
> >> > link to drives (dell branded, latest FW):
> >> >
> >>
> http://www.seagate.com/ww/v/index.jsp?name=st2000nm0001-constellation-es-sas-6gbs-2-tb-hd&vgnextoid=22eb82388ec0e210VgnVCM1000001a48090aRCRD&locale=en-US&pf=1
> >> >
> >> > -Andy
> >> >
> >> > On Tue, Nov 22, 2011 at 5:33 PM, Andy Lubel <alubel at gmail.com> wrote:
> >> >
> >> >> Yep just an r510 with an h200 and 10x 2tb unraided/ 2x raided
> internal
> >> >> 146gb drives. What drives are you using in the front?  Pure jbod with
> >> Zfs?
> >> >>
> >> >> On Nov 22, 2011, at 17:03, Rich <rercola at acm.jhu.edu> wrote:
> >> >>
> >> >> > Dell Rx10 works fine for me on S11. This is just the drives on the
> >> >> > front, not an external MD1200 or similar, right?
> >> >> >
> >> >> > - Rich
> >> >> >
> >> >> > On Tue, Nov 22, 2011 at 4:30 PM, Andy Lubel <alubel at gmail.com>
> wrote:
> >> >> >> FYI solaris 10 works great but I really need dedup.  Going to go
> >> crazy
> >> >> and
> >> >> >> try to copy the kernel drivers from solaris 10 over to b151 and
> see
> >> what
> >> >> >> happens.  Saw a great article stating that expanders were not
> >> supported
> >> >> in
> >> >> >> solaris 11.. so i wonder how they work the j series and HBA cards
> >> that
> >> >> are
> >> >> >> only 8 ports..
> >> >> >>
> >> >> >> On Mon, Nov 21, 2011 at 11:51 PM, Andy Lubel <alubel at gmail.com>
> >> wrote:
> >> >> >>
> >> >> >>> So yeah an expander aka backplane in play here. What next?  I
> really
> >> >> don't
> >> >> >>> want to abandon the effort to hopefully use the best distribution
> >> >> available
> >> >> >>> for our needs.
> >> >> >>>
> >> >> >>> On Nov 18, 2011, at 16:22, "Jason J. W. Williams" <
> >> >> >>> jasonjwwilliams at gmail.com> wrote:
> >> >> >>>
> >> >> >>>> If you've only got 2 ports on the LSI card for 12 drives, then
> an
> >> >> >>> expander
> >> >> >>>> has to be in play.
> >> >> >>>>
> >> >> >>>> -J
> >> >> >>>>
> >> >> >>>> On Fri, Nov 18, 2011 at 2:15 PM, Andy Lubel <alubel at gmail.com>
> >> wrote:
> >> >> >>>>
> >> >> >>>>> I'm betting there is an expander, it looks fancy and some
> >> enclosure
> >> >> >>> device
> >> >> >>>>> shows up in the lsi firmware as well as cfgadm output..  Its
> also
> >> >> dual
> >> >> >>>>> ported (and I have tried unplugging one cable with no different
> >> >> >>> behavior).
> >> >> >>>>> I may or may not be able to test these drives in another
> system..
> >> >> let me
> >> >> >>>>> try some shuffling and I will report my findings.  I knew this
> >> R510
> >> >> was
> >> >> >>>>> going to be a challenge, but I didn't think for the backplane..
> >> >> >>>>>
> >> >> >>>>> On Fri, Nov 18, 2011 at 4:09 PM, Jason J. W. Williams <
> >> >> >>>>> jasonjwwilliams at gmail.com> wrote:
> >> >> >>>>>
> >> >> >>>>>> On Fri, Nov 18, 2011 at 1:59 PM, Andy Lubel <alubel at gmail.com
> >
> >> >> wrote:
> >> >> >>>>>>
> >> >> >>>>>>> IT firmware didn't work, same issue.  I am really leaning
> >> towards
> >> >> some
> >> >> >>>>>> sort
> >> >> >>>>>>> of enclosure problem (backplane) - any ideas how to
> troubleshoot
> >> >> that?
> >> >> >>>>>>>
> >> >> >>>>>>
> >> >> >>>>>> Do the 2TB 2.5" drives work in other systems? Have you tried
> >> other
> >> >> >>> drives
> >> >> >>>>>> you might have lying around to narrow it down to just the 2TB
> >> >> drives?
> >> >> >>> Are
> >> >> >>>>>> there SAS expanders in the backplane?
> >> >> >>>>>>
> >> >> >>>>>> -J
> >> >> >>>>>> _______________________________________________
> >> >> >>>>>> OpenIndiana-discuss mailing list
> >> >> >>>>>> OpenIndiana-discuss at openindiana.org
> >> >> >>>>>> http://openindiana.org/mailman/listinfo/openindiana-discuss
> >> >> >>>>>>
> >> >> >>>>> _______________________________________________
> >> >> >>>>> OpenIndiana-discuss mailing list
> >> >> >>>>> OpenIndiana-discuss at openindiana.org
> >> >> >>>>> http://openindiana.org/mailman/listinfo/openindiana-discuss
> >> >> >>>>>
> >> >> >>>> _______________________________________________
> >> >> >>>> OpenIndiana-discuss mailing list
> >> >> >>>> OpenIndiana-discuss at openindiana.org
> >> >> >>>> http://openindiana.org/mailman/listinfo/openindiana-discuss
> >> >> >>>
> >> >> >> _______________________________________________
> >> >> >> OpenIndiana-discuss mailing list
> >> >> >> OpenIndiana-discuss at openindiana.org
> >> >> >> http://openindiana.org/mailman/listinfo/openindiana-discuss
> >> >> >>
> >> >> >
> >> >> > _______________________________________________
> >> >> > OpenIndiana-discuss mailing list
> >> >> > OpenIndiana-discuss at openindiana.org
> >> >> > http://openindiana.org/mailman/listinfo/openindiana-discuss
> >> >>
> >> > _______________________________________________
> >> > OpenIndiana-discuss mailing list
> >> > OpenIndiana-discuss at openindiana.org
> >> > http://openindiana.org/mailman/listinfo/openindiana-discuss
> >>
> >> _______________________________________________
> >> OpenIndiana-discuss mailing list
> >> OpenIndiana-discuss at openindiana.org
> >> http://openindiana.org/mailman/listinfo/openindiana-discuss
> >>
> > _______________________________________________
> > OpenIndiana-discuss mailing list
> > OpenIndiana-discuss at openindiana.org
> > http://openindiana.org/mailman/listinfo/openindiana-discuss
>
> _______________________________________________
> OpenIndiana-discuss mailing list
> OpenIndiana-discuss at openindiana.org
> http://openindiana.org/mailman/listinfo/openindiana-discuss
>