[OpenIndiana-discuss] format and cfgadm show different controllers / disks??
Richard Elling
richard.elling at richardelling.com
Fri Jul 20 01:13:05 UTC 2012
On Jul 19, 2012, at 11:41 AM, steve at linuxsuite.org wrote:
>> On Jul 19, 2012, at 9:03 AM, steve at linuxsuite.org wrote:
>>
>>> c3::dsk/c3t3d0 disk connected configured
>>> unknown
>>> c4 scsi-sas connected configured
>>> unknown
>>> c4::dsk/c4t5003048001AC5957d0 disk connected configured
>>> unknown
>>> c4::es/ses1 ESI connected configured
>>> unknown
>>> c4::smp/expd1 smp connected configured
>>> unknown
>>> c4::w5000c5000bc44a5d,0 disk-path connected configured
>>> unknown
>>
>> This is one disk path that leads to c2t5000C5000BC44A5Fd0 (as seen in the
>> device tree and by format) Note that the last nibble is munged.
>> -- richard
>
> Ok, so why would one disk on c4 show up as
>
> c4::dsk/c4t5003048001AC5957d0 disk connected configured
>
> 44. c4t5003048001AC5957d0 <ATA-ST3750640AS-E-698.64GB>
> /pci at 0,0/pci8086,340d at 6/pci1000,3080 at 0/iport at f0/disk at w5003048001ac5957,0
I'm not sure of the sequence of events, but I can say that this disk is not
recognized as being multipath-capable. The device tree path does not
include scsi_vhci, which is the multipath driver. Indeed, the ST3750640AS
is described by Seagate as a SATA disk -- not multipath capable.
> and these others don't?
>
> c4::w5000c5000bc44a5d,0 disk-path connected configured
>
> 0. c2t5000C5000BC44A5Fd0 <SEAGATE-ST3300655SS-0004-279.40GB>
> /scsi_vhci/disk at g5000c5000bc44a5f
Clearly, this is a multipath-capable disk. Seagate model number for a SAS disk.
>
> c4::w5000c500525c2f91,0 disk-path connected configured unknown
>
> 8. c2t5000C500525C2F91d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
> /scsi_vhci/disk at g5000c500525c2f91
Here we have another SATA disk, but one that was detected as multipath capable.
Is this confusing? Yep, it surely is. Somewhere in the middle, unseen by the OS, is
the SATA Tunnel Protocol (STP). This is often implemented in HBAs and coordinates
with expanders. All I can say is that there is some combination of disk, HBA, and
expander firmware that causes the scsi_vhci multipath detectors to see those disks
differently.
-- richard
>
>>
>>> c4::w5000c5000bc44cfd,0 disk-path connected configured
>>> unknown
>>> c4::w5000c5000bc44d61,0 disk-path connected configured
>>> unknown
>>> c4::w5000c5000bc4490d,0 disk-path connected configured
>>> unknown
>>> c4::w5000c5000bc44925,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500016a9369,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500016ae0fd,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500525bfb31,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500525c2f91,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500525c72b1,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500525c9673,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500525eb0ac,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500525eb2b9,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500525f2297,0 disk-path connected configured
>>> unknown
>>> c4::w5000c50001621dc5,0 disk-path connected configured
>>> unknown
>>> c4::w5000c50045561cea,0 disk-path connected configured
>>> unknown
>>> c4::w5000c50048990be6,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500489947a8,0 disk-path connected configured
>>> unknown
>>> c4::w5000c500489956c1,0 disk-path connected configured
>>> unknown
>>> c6 scsi-sas connected configured
>>> unknown
>>> c6::es/ses0 ESI connected configured
>>> unknown
>>> c6::smp/expd0 smp connected configured
>>> unknown
>>> c6::w5000cca216c4d4b3,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216c50088,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216cd8947,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216cda7e7,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216cdabb4,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce3dc0,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce3dcb,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce3ec3,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce3f6a,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce4cb3,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce4eae,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce4edd,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce17ce,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce52c4,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce52e8,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce512e,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce517f,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce0752,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca216ce5079,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca222c7c200,0 disk-path connected configured
>>> unknown
>>> c6::w5000cca222c8254c,0 disk-path connected configured
>>> unknown
>>> c7 scsi-sas connected unconfigured
>>> unknown
>>> usb0/1 unknown empty unconfigured ok
>>> usb0/2 unknown empty unconfigured ok
>>> usb1/1 unknown empty unconfigured ok
>>> usb1/2 unknown empty unconfigured ok
>>> usb2/1 unknown empty unconfigured ok
>>> usb2/2 unknown empty unconfigured ok
>>> usb2/3 usb-hub connected configured ok
>>> usb2/3.1 usb-device connected configured ok
>>> usb2/3.2 unknown empty unconfigured ok
>>> usb2/3.3 unknown empty unconfigured ok
>>>
>>> Output from format
>>>
>>> AVAILABLE DISK SELECTIONS:
>>> 0. c2t5000C5000BC44A5Fd0 <SEAGATE-ST3300655SS-0004-279.40GB>
>>> /scsi_vhci/disk at g5000c5000bc44a5f
>>> 1. c2t5000C5000BC44CFFd0 <SEAGATE-ST3300655SS-0004-279.40GB>
>>> /scsi_vhci/disk at g5000c5000bc44cff
>>> 2. c2t5000C5000BC44D63d0 <SEAGATE-ST3300655SS-0004-279.40GB>
>>> /scsi_vhci/disk at g5000c5000bc44d63
>>> 3. c2t5000C5000BC4490Fd0 <SEAGATE-ST3300655SS-0004-279.40GB>
>>> /scsi_vhci/disk at g5000c5000bc4490f
>>> 4. c2t5000C5000BC44927d0 <SEAGATE-ST3300655SS-0004-279.40GB>
>>> /scsi_vhci/disk at g5000c5000bc44927
>>> 5. c2t5000C500016A936Bd0 <SEAGATE-ST3300655SS-0004-279.40GB>
>>> /scsi_vhci/disk at g5000c500016a936b
>>> 6. c2t5000C500016AE0FFd0 <SEAGATE-ST3300655SS-0004-279.40GB>
>>> /scsi_vhci/disk at g5000c500016ae0ff
>>> 7. c2t5000C500525BFB31d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c500525bfb31
>>> 8. c2t5000C500525C2F91d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c500525c2f91
>>> 9. c2t5000C500525C72B1d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c500525c72b1
>>> 10. c2t5000C500525C9673d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c500525c9673
>>> 11. c2t5000C500525EB0ACd0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c500525eb0ac
>>> 12. c2t5000C500525EB2B9d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c500525eb2b9
>>> 13. c2t5000C500525F2297d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c500525f2297
>>> 14. c2t5000C50001621DC7d0 <SEAGATE-ST3300655SS-0004-279.40GB>
>>> /scsi_vhci/disk at g5000c50001621dc7
>>> 15. c2t5000C50045561CEAd0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c50045561cea
>>> 16. c2t5000C50048990BE6d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c50048990be6
>>> 17. c2t5000C500489947A8d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c500489947a8
>>> 18. c2t5000C500489956C1d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>>> /scsi_vhci/disk at g5000c500489956c1
>>> 19. c2t5000CCA216C4D4B3d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216c4d4b3
>>> 20. c2t5000CCA216C50088d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216c50088
>>> 21. c2t5000CCA216CD8947d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216cd8947
>>> 22. c2t5000CCA216CDA7E7d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216cda7e7
>>> 23. c2t5000CCA216CDABB4d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216cdabb4
>>> 24. c2t5000CCA216CE3DC0d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce3dc0
>>> 25. c2t5000CCA216CE3DCBd0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce3dcb
>>> 26. c2t5000CCA216CE3EC3d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce3ec3
>>> 27. c2t5000CCA216CE3F6Ad0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce3f6a
>>> 28. c2t5000CCA216CE4CB3d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce4cb3
>>> 29. c2t5000CCA216CE4EAEd0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce4eae
>>> 30. c2t5000CCA216CE4EDDd0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce4edd
>>> 31. c2t5000CCA216CE17CEd0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce17ce
>>> 32. c2t5000CCA216CE52C4d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce52c4
>>> 33. c2t5000CCA216CE52E8d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce52e8
>>> 34. c2t5000CCA216CE512Ed0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce512e
>>> 35. c2t5000CCA216CE517Fd0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce517f
>>> 36. c2t5000CCA216CE0752d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce0752
>>> 37. c2t5000CCA216CE5079d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>>> /scsi_vhci/disk at g5000cca216ce5079
>>> 38. c2t5000CCA222C7C200d0 <ATA-Hitachi HDS72202-A3EA-1.82TB>
>>> /scsi_vhci/disk at g5000cca222c7c200
>>> 39. c2t5000CCA222C8254Cd0 <ATA-Hitachi HDS72202-A3EA-1.82TB>
>>> /scsi_vhci/disk at g5000cca222c8254c
>>> 40. c3t0d0 <DELL-PERC6/i-1.22 cyl 8841 alt 2 hd 255 sec 63>
>>> /pci at 0,0/pci8086,340b at 4/pci1028,1f0c at 0/sd at 0,0
>>> 41. c3t1d0 <DELL-PERC 6/i-1.22-55.38GB>
>>> /pci at 0,0/pci8086,340b at 4/pci1028,1f0c at 0/sd at 1,0
>>> 42. c3t2d0 <DELL-PERC6/i-1.22 cyl 19383 alt 2 hd 255 sec 63>
>>> /pci at 0,0/pci8086,340b at 4/pci1028,1f0c at 0/sd at 2,0
>>> 43. c3t3d0 <DELL-PERC6/i-1.22 cyl 19383 alt 2 hd 255 sec 63>
>>> /pci at 0,0/pci8086,340b at 4/pci1028,1f0c at 0/sd at 3,0
>>> 44. c4t5003048001AC5957d0 <ATA-ST3750640AS-E-698.64GB>
>>> /pci at 0,0/pci8086,340d at 6/pci1000,3080 at 0/iport at f0/disk at w5003048001ac5957,0
>>> Specify disk (enter its number): Specify disk (enter its number):
>>> ~
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> OpenIndiana-discuss mailing list
>>> OpenIndiana-discuss at openindiana.org
>>> http://openindiana.org/mailman/listinfo/openindiana-discuss
>>
>> --
>> ZFS Performance and Training
>> Richard.Elling at RichardElling.com
>> +1-760-896-4422
>>
>>
>>
>> _______________________________________________
>> OpenIndiana-discuss mailing list
>> OpenIndiana-discuss at openindiana.org
>> http://openindiana.org/mailman/listinfo/openindiana-discuss
>>
>
>
>
> _______________________________________________
> OpenIndiana-discuss mailing list
> OpenIndiana-discuss at openindiana.org
> http://openindiana.org/mailman/listinfo/openindiana-discuss
--
ZFS Performance and Training
Richard.Elling at RichardElling.com
+1-760-896-4422
More information about the OpenIndiana-discuss
mailing list