[OpenIndiana-discuss] Aggregation performance measurement
Gabriele Bulfon
gbulfon at sonicle.com
Wed Oct 19 16:25:02 UTC 2011
Thanks a lot, I did all the modifications and tests you suggested.
It seems not to change though.
My concern is that this link will run just one NFS mount from the server, so I'm worried it won't
benefit of the 2Gb available!
Here are configs and results:
STORAGE OPENINDIANA
=================
sonicle at storage:~$ dladm show-aggr
LINK POLICY ADDRPOLICY LACPACTIVITY LACPTIMER FLAGS
aggr0 L2,L3 auto active short -----
sonicle at storage:~$ dladm show-aggr -L
LINK PORT AGGREGATABLE SYNC COLL DIST DEFAULTED EXPIRED
aggr0 e1000g0 yes yes yes yes no no
-- e1000g1 yes yes yes yes no no
sonicle at storage:~$ netio -s
NETIO - Network Throughput Benchmark, Version 1.26
(C) 1997-2005 Kai Uwe Rommel
UDP server listening.
TCP server listening.
SERVER SOLARIS10/08
================
bash-3.00# dladm show-aggr
key: 1 (0x0001) policy: L2,L3 address: 0:13:49:25:2c:35 (auto)
device address speed duplex link state
rge0 0:13:49:25:2c:35 1000 Mbps full up attached
rge1 0:13:49:25:2a:e6 1000 Mbps full up attached
bash-3.00# dladm show-aggr -L
key: 1 (0x0001) policy: L2,L3 address: 0:13:49:25:2c:35 (auto)
LACP mode: active LACP timer: short
device activity timeout aggregatable sync coll dist defaulted expired
rge0 active short yes yes yes yes no no
rge1 active short yes yes yes yes no no
bash-3.00# /usr/local/bin/netio -t 10.100.100.1
NETIO - Network Throughput Benchmark, Version 1.26
(C) 1997-2005 Kai Uwe Rommel
TCP connection established.
Packet size 1k bytes: 69140 KByte/s Tx, 66736 KByte/s Rx.
Packet size 2k bytes: 79965 KByte/s Tx, 77193 KByte/s Rx.
Packet size 4k bytes: 93350 KByte/s Tx, 81172 KByte/s Rx.
Packet size 8k bytes: 94067 KByte/s Tx, 90958 KByte/s Rx.
Packet size 16k bytes: 93572 KByte/s Tx, 82603 KByte/s Rx.
Packet size 32k bytes: 95044 KByte/s Tx, 82949 KByte/s Rx.
Done.
bash-3.00#
AFTER NETIO TEST
================
STORAGE OPENINDIANA (rebooted before running tests)
sonicle at xstorage:~$ dladm show-aggr -s
LINK PORT IPACKETS RBYTES OPACKETS OBYTES IPKTDIST OPKTDIST
aggr0 -- 2920488 3430085269 2720782 3151698538 -- --
-- e1000g0 12547 1314085 305 36700 0.4 0.0
-- e1000g1 2907941 3428771184 2720477 3151661838 99.6 100.0
SERVER SOLARIS10/08 (could not reboot before tests, so stats may be summing previous runs)
bash-3.00# dladm show-aggr -s
key:1 ipackets rbytes opackets obytes %ipkts %opkts
Total 27230102 23299267339 35945683 47331546852
rge0 14258127 13030520276 11965347 16865782816 52.4 33.3
rge1 12971975 10268747063 23980336 30465764036 47.6 66.7
----------------------------------------------------------------------------------
Da: Volker A. Brandt
A: Discussion list for OpenIndiana
Data: 17 ottobre 2011 18.06.36 CEST
Oggetto: Re: [OpenIndiana-discuss] Aggregation performance measurement
In particular, what's the sharing policy ('dladm show-aggr -L')?
My experience with S10 was that I only got both paths in use when
I set the sharing policy to combine L2 and L3.
Yes, that is also my experience. Here is what I currently have for
configuration on the one aggregation I use more than sporadically:
# dladm show-aggr -L
key: 1 (0x0001) policy: L2,L3 address: 0:23:8b:xx:yy:zz (fixed)
LACP mode: active LACP timer: short
device activity timeout aggregatable sync coll dist defaulted expired
bge0 active short yes yes yes yes no no
nge0 active short yes yes yes yes no no
This is the only useable config: active, short timeout, use L2+L3.
OS is S10 U9/x64. But still it is not used symmetrically:
# dladm show-aggr -s
key:1 ipackets rbytes opackets obytes %ipkts %opkts
Total 466841076 446265645314 418989589 87606162787
bge0 5166862 1815551300 321053212 560109195 1.1 76.6
nge0 461674214 444450094014 97936377 87046053592 98.9 23.4
[BTW this command could use a -h switch for MB/GB display :-)]
I guess if more clients talked to this server, the load would be spread
out more. But I only have max 2-3 clients creating traffic at any given
time.
Regards -- Volker
--
------------------------------------------------------------------------
Volker A. Brandt Consulting and Support for Oracle Solaris
Brandt &Brandt Computer GmbH WWW: http://www.bb-c.de/
Am Wiesenpfad 6, 53340 Meckenheim, GERMANY Email: vab at bb-c.de
Handelsregister: Amtsgericht Bonn, HRB 10513 Schuhgröße: 46
Geschäftsführer: Rainer J. H. Brandt und Volker A. Brandt
_______________________________________________
OpenIndiana-discuss mailing list
OpenIndiana-discuss at openindiana.org
http://openindiana.org/mailman/listinfo/openindiana-discuss
More information about the OpenIndiana-discuss
mailing list