[OpenIndiana-discuss] VERY slow server performance

[Stuart & Shirley]

Hi - Look for some assistance in improving disk access performance on my
OpenIndiana install.

 

Wanting to upgrade my server based on OpenSolaris and ZFS to 3TB drives, I
upgraded the OS to OpenIndiana 151a.

 

Performance is terrible over the network as compared to the previous
OpenSolaris installation. Hardware is identical with the exception of a
second SATA controller (a second identical  Supermicro AOC-SAT2-MV8) and
additional hard drives.

 

Perhaps related, the USB mouse is virtually none-operational. It will only
update the location of the mouse for about 0.5s out of every 10s. This has
not been an issue, as I usually connect remotely. But still an indication
that all is not well.

 

Transfers on the  machine, from drive to drive appears about the same as
when running under OpenIndiana - but across the networks it's very slow.

 

Moving a large file from my windows 7 machine across the GbE lan - transfers
at ~11.5MB/s as reported by windows copy.

 

Using zpool iostat, the write bandwidth is reported as high as 20M.

 

Now if I run zpool iostat continuously (display every 3 seconds), copy
performance increases - moving into the 16 to 17 MB/s range as reported by
windows.

 

Copying from one storage pool to another, zpool iostat will report write
bandwidths of 26M.

 

 

My pool configuration is detailed below.

 

Other's slow performance had been pegged to flow control enabled on the
Ethernet port - this was disabled. It did make a difference, but not that
dramatic.

 

 

Any suggestions on how to improve performance and how to fix the mouse would
be greatly appreciated!

 

 

Stuart

 

 

 

 

 

 

Flow control properties:

 

LINK         PROPERTY        PERM VALUE          DEFAULT        POSSIBLE

e1000g0      flowctrl        rw   no             bi             no,tx,rx,bi

 

 

 

 

 

 

Zpool configurations:

 

  pool: rpool

state: ONLINE

  scan: resilvered 4.63G in 0h7m with 0 errors on Wed Jun  6 22:12:16 2012

config:

 

     NAME          STATE     READ WRITE CKSUM

     rpool         ONLINE       0     0     0

       mirror-0    ONLINE       0     0     0

         c3t0d0s0  ONLINE       0     0     0

         c3t1d0s0  ONLINE       0     0     0

 

errors: No known data errors

 

  pool: tank_12T

state: ONLINE

  scan: none requested

config:

 

     NAME        STATE     READ WRITE CKSUM

     tank_12T    ONLINE       0     0     0

       raidz2-0  ONLINE       0     0     0

         c3t7d0  ONLINE       0     0     0

         c3t3d0  ONLINE       0     0     0

         c3t5d0  ONLINE       0     0     0

         c3t6d0  ONLINE       0     0     0

         c5d0    ONLINE       0     0     0

         c8d0    ONLINE       0     0     0

 

errors: No known data errors

 

  pool: tank_m

state: ONLINE

  scan: none requested

config:

 

     NAME        STATE     READ WRITE CKSUM

     tank_m      ONLINE       0     0     0

       mirror-0  ONLINE       0     0     0

         c3t2d0  ONLINE       0     0     0

         c7t6d0  ONLINE       0     0     0

         c6d0    ONLINE       0     0     0

       mirror-1  ONLINE       0     0     0

         c3t4d0  ONLINE       0     0     0

         c7t7d0  ONLINE       0     0     0

         c4d0    ONLINE       0     0     0

 

errors: No known data errors