[OpenIndiana-discuss] NFS Linux client slow reads

[Dan Swartzendruber]

This is kind of a mystery.  Is it the same linux client in both cases?

-----Original Message-----
From: Pete Ashdown [mailto:pashdown at xmission.com] 
Sent: Friday, May 27, 2011 7:06 PM
To: Discussion list for OpenIndiana
Subject: [OpenIndiana-discuss] NFS Linux client slow reads

Both NFS tests were conducted on the same hardware, with 4 aggregated
802.3ad gig-e ports on the server and 2 aggregated 802.3ad gig-e ports on
the client.  The OI server has 24GB RAM, 8 2TB Seagate drives, and a 32GB
SSD for ZIL and a 160GB SSD for L2ARC.

Test 1: Ubuntu Linux server & client

#  dd if=/dev/zero of=test bs=1024 count=1M
1073741824 bytes (1.1 GB) copied, 13.3347 s, 80.5 MB/s
# echo 3 > /proc/sys/vm/drop_caches  (clear Linux file buffers)
# dd if=test of=/dev/null
1073741824 bytes (1.1 GB) copied, 10.0029 s, 107 MB/s

Test 2: OI 148 server & Ubuntu Linux client

# dd if=/dev/zero of=test bs=1024 count=1M
1073741824 bytes (1.1 GB) copied, 12.0275 s, 89.3 MB/s
# echo 3 > /proc/sys/vm/drop_caches
# dd if=test of=/dev/null bs=1024
1073741824 bytes (1.1 GB) copied, 112.205 s, 9.6 MB/s  <--- ~10% of Linux
server

Test 3: On the OI server

# dd if=/dev/zero of=test bs=1024 count=1M
1073741824 bytes (1.1 GB) copied, 7.79955 s, 138 MB/s
# dd if=test of=/dev/null bs=1024
1073741824 bytes (1.1 GB) copied, 3.38502 s, 317 MB/s

Any help is appreciated.