[OpenIndiana-discuss] format and cfgadm show different controllers / disks??

Richard Elling richard.elling at richardelling.com
Thu Jul 19 17:15:16 UTC 2012


On Jul 19, 2012, at 9:03 AM, steve at linuxsuite.org wrote:

> 
>  Howdy!
> 
>      I have a Dell 610 with LSI 9200-8e HBA connected to Supermicro 847
> (45 disk 4U JBOD)
> Each port on the LSI is connect by separate cable to one of the 2
> BackPlanes on
> the SM847.
> 
>      How come format and cfgadm show different controllers and devices..
> 
>  - cfgadm -al
>  all devices on one backplane as c4, the devices
> on the other backplane are on c6.
> 
>  - format
> lists ALL devices on HBA as being on c2 (see below)

c2 is the multipath "controller," it isn't a real HBA.

> 
>  Why does cfgadm  list some disks Type "disk" with name dsk/cxxx
> and others as Type "disk-path" with name w500xxxxx..
> 
> # cfgadm -al
> Ap_Id                          Type         Receptacle   Occupant    
> Condition
> c3                             scsi-bus     connected    configured   unknown
> c3::dsk/c3t0d0                 disk         connected    configured   unknown
> c3::dsk/c3t1d0                 disk         connected    configured   unknown
> c3::dsk/c3t2d0                 disk         connected    configured   unknown
> c3::dsk/c3t3d0                 disk         connected    configured   unknown
> c4                             scsi-sas     connected    configured   unknown
> c4::dsk/c4t5003048001AC5957d0  disk         connected    configured   unknown
> c4::es/ses1                    ESI          connected    configured   unknown
> c4::smp/expd1                  smp          connected    configured   unknown
> c4::w5000c5000bc44a5d,0        disk-path    connected    configured   unknown

This is one disk path that leads to c2t5000C5000BC44A5Fd0 (as seen in the
device tree and by format) Note that the last nibble is munged.
 -- richard

> c4::w5000c5000bc44cfd,0        disk-path    connected    configured   unknown
> c4::w5000c5000bc44d61,0        disk-path    connected    configured   unknown
> c4::w5000c5000bc4490d,0        disk-path    connected    configured   unknown
> c4::w5000c5000bc44925,0        disk-path    connected    configured   unknown
> c4::w5000c500016a9369,0        disk-path    connected    configured   unknown
> c4::w5000c500016ae0fd,0        disk-path    connected    configured   unknown
> c4::w5000c500525bfb31,0        disk-path    connected    configured   unknown
> c4::w5000c500525c2f91,0        disk-path    connected    configured   unknown
> c4::w5000c500525c72b1,0        disk-path    connected    configured   unknown
> c4::w5000c500525c9673,0        disk-path    connected    configured   unknown
> c4::w5000c500525eb0ac,0        disk-path    connected    configured   unknown
> c4::w5000c500525eb2b9,0        disk-path    connected    configured   unknown
> c4::w5000c500525f2297,0        disk-path    connected    configured   unknown
> c4::w5000c50001621dc5,0        disk-path    connected    configured   unknown
> c4::w5000c50045561cea,0        disk-path    connected    configured   unknown
> c4::w5000c50048990be6,0        disk-path    connected    configured   unknown
> c4::w5000c500489947a8,0        disk-path    connected    configured   unknown
> c4::w5000c500489956c1,0        disk-path    connected    configured   unknown
> c6                             scsi-sas     connected    configured   unknown
> c6::es/ses0                    ESI          connected    configured   unknown
> c6::smp/expd0                  smp          connected    configured   unknown
> c6::w5000cca216c4d4b3,0        disk-path    connected    configured   unknown
> c6::w5000cca216c50088,0        disk-path    connected    configured   unknown
> c6::w5000cca216cd8947,0        disk-path    connected    configured   unknown
> c6::w5000cca216cda7e7,0        disk-path    connected    configured   unknown
> c6::w5000cca216cdabb4,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce3dc0,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce3dcb,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce3ec3,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce3f6a,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce4cb3,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce4eae,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce4edd,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce17ce,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce52c4,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce52e8,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce512e,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce517f,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce0752,0        disk-path    connected    configured   unknown
> c6::w5000cca216ce5079,0        disk-path    connected    configured   unknown
> c6::w5000cca222c7c200,0        disk-path    connected    configured   unknown
> c6::w5000cca222c8254c,0        disk-path    connected    configured   unknown
> c7                             scsi-sas     connected    unconfigured unknown
> usb0/1                         unknown      empty        unconfigured ok
> usb0/2                         unknown      empty        unconfigured ok
> usb1/1                         unknown      empty        unconfigured ok
> usb1/2                         unknown      empty        unconfigured ok
> usb2/1                         unknown      empty        unconfigured ok
> usb2/2                         unknown      empty        unconfigured ok
> usb2/3                         usb-hub      connected    configured   ok
> usb2/3.1                       usb-device   connected    configured   ok
> usb2/3.2                       unknown      empty        unconfigured ok
> usb2/3.3                       unknown      empty        unconfigured ok
> 
>  Output from format
> 
> AVAILABLE DISK SELECTIONS:
>       0. c2t5000C5000BC44A5Fd0 <SEAGATE-ST3300655SS-0004-279.40GB>
>          /scsi_vhci/disk at g5000c5000bc44a5f
>       1. c2t5000C5000BC44CFFd0 <SEAGATE-ST3300655SS-0004-279.40GB>
>          /scsi_vhci/disk at g5000c5000bc44cff
>       2. c2t5000C5000BC44D63d0 <SEAGATE-ST3300655SS-0004-279.40GB>
>          /scsi_vhci/disk at g5000c5000bc44d63
>       3. c2t5000C5000BC4490Fd0 <SEAGATE-ST3300655SS-0004-279.40GB>
>          /scsi_vhci/disk at g5000c5000bc4490f
>       4. c2t5000C5000BC44927d0 <SEAGATE-ST3300655SS-0004-279.40GB>
>          /scsi_vhci/disk at g5000c5000bc44927
>       5. c2t5000C500016A936Bd0 <SEAGATE-ST3300655SS-0004-279.40GB>
>          /scsi_vhci/disk at g5000c500016a936b
>       6. c2t5000C500016AE0FFd0 <SEAGATE-ST3300655SS-0004-279.40GB>
>          /scsi_vhci/disk at g5000c500016ae0ff
>       7. c2t5000C500525BFB31d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c500525bfb31
>       8. c2t5000C500525C2F91d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c500525c2f91
>       9. c2t5000C500525C72B1d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c500525c72b1
>      10. c2t5000C500525C9673d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c500525c9673
>      11. c2t5000C500525EB0ACd0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c500525eb0ac
>      12. c2t5000C500525EB2B9d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c500525eb2b9
>      13. c2t5000C500525F2297d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c500525f2297
>      14. c2t5000C50001621DC7d0 <SEAGATE-ST3300655SS-0004-279.40GB>
>          /scsi_vhci/disk at g5000c50001621dc7
>      15. c2t5000C50045561CEAd0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c50045561cea
>      16. c2t5000C50048990BE6d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c50048990be6
>      17. c2t5000C500489947A8d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c500489947a8
>      18. c2t5000C500489956C1d0 <ATA-ST3000DM001-9YN1-CC4H-2.73TB>
>          /scsi_vhci/disk at g5000c500489956c1
>      19. c2t5000CCA216C4D4B3d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216c4d4b3
>      20. c2t5000CCA216C50088d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216c50088
>      21. c2t5000CCA216CD8947d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216cd8947
>      22. c2t5000CCA216CDA7E7d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216cda7e7
>      23. c2t5000CCA216CDABB4d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216cdabb4
>      24. c2t5000CCA216CE3DC0d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce3dc0
>      25. c2t5000CCA216CE3DCBd0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce3dcb
>      26. c2t5000CCA216CE3EC3d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce3ec3
>      27. c2t5000CCA216CE3F6Ad0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce3f6a
>      28. c2t5000CCA216CE4CB3d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce4cb3
>      29. c2t5000CCA216CE4EAEd0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce4eae
>      30. c2t5000CCA216CE4EDDd0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce4edd
>      31. c2t5000CCA216CE17CEd0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce17ce
>      32. c2t5000CCA216CE52C4d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce52c4
>      33. c2t5000CCA216CE52E8d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce52e8
>      34. c2t5000CCA216CE512Ed0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce512e
>      35. c2t5000CCA216CE517Fd0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce517f
>      36. c2t5000CCA216CE0752d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce0752
>      37. c2t5000CCA216CE5079d0 <ATA-Hitachi HDS72101-A70M-931.51GB>
>          /scsi_vhci/disk at g5000cca216ce5079
>      38. c2t5000CCA222C7C200d0 <ATA-Hitachi HDS72202-A3EA-1.82TB>
>          /scsi_vhci/disk at g5000cca222c7c200
>      39. c2t5000CCA222C8254Cd0 <ATA-Hitachi HDS72202-A3EA-1.82TB>
>          /scsi_vhci/disk at g5000cca222c8254c
>      40. c3t0d0 <DELL-PERC6/i-1.22 cyl 8841 alt 2 hd 255 sec 63>
>          /pci at 0,0/pci8086,340b at 4/pci1028,1f0c at 0/sd at 0,0
>      41. c3t1d0 <DELL-PERC 6/i-1.22-55.38GB>
>          /pci at 0,0/pci8086,340b at 4/pci1028,1f0c at 0/sd at 1,0
>      42. c3t2d0 <DELL-PERC6/i-1.22 cyl 19383 alt 2 hd 255 sec 63>
>          /pci at 0,0/pci8086,340b at 4/pci1028,1f0c at 0/sd at 2,0
>      43. c3t3d0 <DELL-PERC6/i-1.22 cyl 19383 alt 2 hd 255 sec 63>
>          /pci at 0,0/pci8086,340b at 4/pci1028,1f0c at 0/sd at 3,0
>      44. c4t5003048001AC5957d0 <ATA-ST3750640AS-E-698.64GB>
>          /pci at 0,0/pci8086,340d at 6/pci1000,3080 at 0/iport at f0/disk at w5003048001ac5957,0
> Specify disk (enter its number): Specify disk (enter its number):
> ~
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> _______________________________________________
> OpenIndiana-discuss mailing list
> OpenIndiana-discuss at openindiana.org
> http://openindiana.org/mailman/listinfo/openindiana-discuss

--
ZFS Performance and Training
Richard.Elling at RichardElling.com
+1-760-896-4422





More information about the OpenIndiana-discuss mailing list