[OpenIndiana-discuss] Aggregation performance measurement

Gabriele Bulfon gbulfon at sonicle.com
Wed Oct 19 16:25:02 UTC 2011


Thanks a lot, I did all the modifications and tests you suggested.
It seems not to change though.
My concern is that this link will run just one NFS mount from the server, so I'm worried it won't
benefit of the 2Gb available!
Here are configs and results:
STORAGE OPENINDIANA
=================
sonicle at storage:~$ dladm show-aggr
LINK            POLICY   ADDRPOLICY           LACPACTIVITY  LACPTIMER   FLAGS
aggr0           L2,L3    auto                 active        short       -----
sonicle at storage:~$ dladm show-aggr -L
LINK        PORT         AGGREGATABLE SYNC COLL DIST DEFAULTED EXPIRED
aggr0       e1000g0      yes          yes  yes  yes  no        no
--          e1000g1      yes          yes  yes  yes  no        no
sonicle at storage:~$ netio -s
NETIO - Network Throughput Benchmark, Version 1.26
(C) 1997-2005 Kai Uwe Rommel
UDP server listening.
TCP server listening.
SERVER SOLARIS10/08
================
bash-3.00# dladm show-aggr
key: 1 (0x0001) policy: L2,L3   address: 0:13:49:25:2c:35 (auto)
device       address                 speed           duplex  link    state
rge0         0:13:49:25:2c:35          1000  Mbps    full    up      attached
rge1         0:13:49:25:2a:e6          1000  Mbps    full    up      attached
bash-3.00# dladm show-aggr -L
key: 1 (0x0001) policy: L2,L3   address: 0:13:49:25:2c:35 (auto)
LACP mode: active       LACP timer: short
device    activity timeout aggregatable sync  coll dist defaulted expired
rge0      active   short   yes          yes   yes  yes  no        no
rge1      active   short   yes          yes   yes  yes  no        no
bash-3.00# /usr/local/bin/netio -t 10.100.100.1
NETIO - Network Throughput Benchmark, Version 1.26
(C) 1997-2005 Kai Uwe Rommel
TCP connection established.
Packet size  1k bytes:  69140 KByte/s Tx,  66736 KByte/s Rx.
Packet size  2k bytes:  79965 KByte/s Tx,  77193 KByte/s Rx.
Packet size  4k bytes:  93350 KByte/s Tx,  81172 KByte/s Rx.
Packet size  8k bytes:  94067 KByte/s Tx,  90958 KByte/s Rx.
Packet size 16k bytes:  93572 KByte/s Tx,  82603 KByte/s Rx.
Packet size 32k bytes:  95044 KByte/s Tx,  82949 KByte/s Rx.
Done.
bash-3.00#
AFTER NETIO TEST
================
STORAGE OPENINDIANA (rebooted before running tests)
sonicle at xstorage:~$ dladm show-aggr -s
LINK        PORT      IPACKETS RBYTES OPACKETS OBYTES IPKTDIST OPKTDIST
aggr0       --        2920488 3430085269 2720782 3151698538 -- --
--          e1000g0   12547   1314085 305     36700   0.4      0.0
--          e1000g1   2907941 3428771184 2720477 3151661838 99.6   100.0
SERVER SOLARIS10/08 (could not reboot before tests, so stats may be summing previous runs)
bash-3.00# dladm show-aggr -s
key:1           ipackets   rbytes       opackets   obytes       %ipkts  %opkts
Total   27230102   23299267339  35945683   47331546852
rge0    14258127   13030520276  11965347   16865782816    52.4    33.3
rge1    12971975   10268747063  23980336   30465764036    47.6    66.7
----------------------------------------------------------------------------------
Da: Volker A. Brandt
A: Discussion list for OpenIndiana
Data: 17 ottobre 2011 18.06.36 CEST
Oggetto: Re: [OpenIndiana-discuss] Aggregation performance measurement
In particular, what's the sharing policy ('dladm show-aggr -L')?
My experience with S10 was that I only got both paths in use when
I set the sharing policy to combine L2 and L3.
Yes, that is also my experience.  Here is what I currently have for
configuration on the one aggregation I use more than sporadically:
# dladm show-aggr -L
key: 1 (0x0001) policy: L2,L3   address: 0:23:8b:xx:yy:zz (fixed)
LACP mode: active       LACP timer: short
device    activity timeout aggregatable sync  coll dist defaulted expired
bge0      active   short   yes          yes   yes  yes  no        no
nge0      active   short   yes          yes   yes  yes  no        no
This is the only useable config: active, short timeout, use L2+L3.
OS is S10 U9/x64.  But still it is not used symmetrically:
# dladm show-aggr -s
key:1           ipackets   rbytes       opackets   obytes       %ipkts  %opkts
Total   466841076  446265645314 418989589  87606162787
bge0    5166862    1815551300   321053212  560109195       1.1    76.6
nge0    461674214  444450094014 97936377   87046053592    98.9    23.4
[BTW this command could use a -h switch for MB/GB display :-)]
I guess if more clients talked to this server, the load would be spread
out more.  But I only have max 2-3 clients creating traffic at any given
time.
Regards -- Volker
--
------------------------------------------------------------------------
Volker A. Brandt               Consulting and Support for Oracle Solaris
Brandt &Brandt Computer GmbH                   WWW: http://www.bb-c.de/
Am Wiesenpfad 6, 53340 Meckenheim, GERMANY            Email: vab at bb-c.de
Handelsregister: Amtsgericht Bonn, HRB 10513              Schuhgröße: 46
Geschäftsführer: Rainer J. H. Brandt und Volker A. Brandt
_______________________________________________
OpenIndiana-discuss mailing list
OpenIndiana-discuss at openindiana.org
http://openindiana.org/mailman/listinfo/openindiana-discuss


More information about the OpenIndiana-discuss mailing list