Buffalo NAS-Central Forums

Welcome to the Linkstation Wiki community
It is currently Mon May 21, 2018 12:33 am

All times are UTC+01:00




Post new topic  Reply to topic  [ 19 posts ]  Go to page 1 2 Next
Author Message
PostPosted: Sun Sep 14, 2008 6:36 pm 
Offline
Newbie

Joined: Fri Jul 18, 2008 3:35 am
Posts: 22
All,

I'm contemplating upgrading my wireless router with one that has a gigabit switch in order to increase the performance between my LS Live and my main workstation (which also has a wired connection into that router). I did some testing this morning going through my existing 100 Mbit router and doing a direct GbE connection between my workstation and LS Live. My testing revealed only about a 30% increase in speed with the direct GbE link:

Hardware: Linkstation Live v2
OS: FreeLink
Kernel: 2.6.16.57-lsp_eabi-dh_v4
Filesize: 607377628
Protocol: NFS v3 over TCP
Client-side mount options: rw,rsize=65535,wsize=65535,proto=tcp,nfsvers=3
Command: time cp -av /mnt/ls1/share/testfile /tmp
Time @ 100 Mb: 56.49 sec. (10.25 MiB/sec.)
Time @ 1 Gb: 43.35 sec. (13.36 MiB/sec.)

My question is: what sorts of speeds are others getting? If you have a few spare minutes, can you please post your MB/sec. speeds to this thread, and if possible, your OS, kernel and any special server or client-side options you're using? I'm particularly interested in results from someone using one of the newer lenny armel images that davy_gravy has graciously put together. I understand that there are some Samba performance issues with the new kernel, but I was wondering whether there was any improvement in the NFS performance.

Thanks for your help!


Last edited by ahagge on Tue Sep 16, 2008 3:02 am, edited 1 time in total.

Top
   
PostPosted: Mon Sep 15, 2008 9:47 pm 
Offline
Newbie

Joined: Sun Jul 29, 2007 8:53 pm
Posts: 74
Location: Victoria, BC, Canada
With NFSv4 over TCP and Gentoo on a 2.6.26 kernel I get around 10-12 MB/s over my gigabit connection.

_________________
Saving the world, one kilobyte at a time.


Top
   
PostPosted: Wed Sep 17, 2008 4:44 am 
Offline
Newbie

Joined: Fri Jul 18, 2008 3:35 am
Posts: 22
Update: I did some more testing of GbE using a direct cable connection between my Linkstation Live and my Linux workstation. The change I made was to enable 9004 byte jumbo frames on both machines. Wow! What a difference! Here's the updated info:

Hardware: Linkstation Live v2
OS: FreeLink
Kernel: 2.6.16.57-lsp_eabi-dh_v4 (with 9004 byte Jumbo Frames enabled)
Filesize: 607377628
Protocol: NFS v3 over TCP
Client-side mount options: rw,rsize=65535,wsize=65535,proto=tcp,nfsvers=3
Command: time cp -av /mnt/ls1/share/testfile /tmp
Time @ 1 Gb: 27.44 sec. (21.1 MiB/sec.!)

Writes were similarly improved at 41.76 sec. (13.87 MiB/sec.)

With this information, I bought a TrendNet TEW-633GR wireless N router with a gigabit switch ($80.00 on sale at Fry's), which I'd read supports Jumbo Frames. Indeed it does, and was able to replicate the numbers above with it in the mix.

Woo hoo! Can anybody top that (especially with a 2.6.26+ armel kernel)? I hope so...

_________________
Linkstation Live v2 running: pvr on Hauppauge HVR-950, apache, nfs v4, samba, cups, streamripper, Nikon webcam, weather station (via open 2300)


Top
   
PostPosted: Tue Jan 20, 2009 6:57 am 
Offline
Newbie

Joined: Fri Jul 18, 2008 3:35 am
Posts: 22
Apologies for replying to my own post, but here's some new information. I upgraded my Linkstation Live v2 to davy_gray's 0.3.1b armel image and his updated 2.6.27.4 armel kernel and ran some more tests, this time with a 2.1 GB file of mpeg2 data.

Here's the info:
Hardware: Linkstation Live v2
OS: Debian Lenny (davy_gravy version 0.3.1b)
Kernel: 2.6.27.4 (from davy_gravy)
Filesize: 2147483648
Protocol: NFS v3 over TCP (Jumbo Frames, MTU: 9004)
Client-side mount options: rw,rsize=65535,wsize=65535,proto=tcp,nfsvers=3

NFS copy command and output:
Code:
[alan@viper store]$ time cp /mnt/ls1/share/music/2GB-test /dev/null
0.045u 5.310s 3:09.65 2.8%      0+0k 4194392+0io 1pf+0w

which works out to about 10.8 MB/sec, I've gotta check into this, as I'm pretty sure I was seeing higher numbers a day or two ago with the same setup.

The results with Samba were just incredible:

Samba command and output:
Code:
[alan@viper store]$ time smbclient -U <username> -c 'get "2GB-test"' '\\ls1\test' <password>
Domain=[LS1] OS=[Unix] Server=[Samba 3.2.5]
getting file \2GB-test of size 2147483648 as 2GB-test (38313.9 kb/s) (average [b]38313.9 kb/s[/b])
0.710u 10.349s 0:55.51 19.9%    0+0k 4024+4194312io 22pf+0w

That's almost 37 MB/sec.! :up:

Unfortunately, I can't run the same test from Windows, as the [stupid] ethernet driver for my motherboard will bluescreen if I change the MTU to anything larger than 1500. Sigh.

So I'm not sure where the comments about slowness with the armel kernels are coming from, but if you can run GbE with Jumbo Frames, you'll rock!

_________________
Linkstation Live v2 running: pvr on Hauppauge HVR-950, apache, nfs v4, samba, cups, streamripper, Nikon webcam, weather station (via open 2300)


Top
   
PostPosted: Mon Feb 09, 2009 7:03 am 
Offline
Newbie

Joined: Tue Feb 03, 2009 1:44 pm
Posts: 10
ahagge wrote:
Apologies for replying to my own post, but here's some new information. I upgraded my Linkstation Live v2 to davy_gray's 0.3.1b armel image and his updated 2.6.27.4 armel kernel and ran some more tests, this time with a 2.1 GB file of mpeg2 data.

Here's the info:
Hardware: Linkstation Live v2
OS: Debian Lenny (davy_gravy version 0.3.1b)
Kernel: 2.6.27.4 (from davy_gravy)
Filesize: 2147483648
Protocol: NFS v3 over TCP (Jumbo Frames, MTU: 9004)
Client-side mount options: rw,rsize=65535,wsize=65535,proto=tcp,nfsvers=3

NFS copy command and output:
Code:
[alan@viper store]$ time cp /mnt/ls1/share/music/2GB-test /dev/null
0.045u 5.310s 3:09.65 2.8%      0+0k 4194392+0io 1pf+0w

which works out to about 10.8 MB/sec, I've gotta check into this, as I'm pretty sure I was seeing higher numbers a day or two ago with the same setup.

The results with Samba were just incredible:

Samba command and output:
Code:
[alan@viper store]$ time smbclient -U <username> -c 'get "2GB-test"' '\\ls1\test' <password>
Domain=[LS1] OS=[Unix] Server=[Samba 3.2.5]
getting file \2GB-test of size 2147483648 as 2GB-test (38313.9 kb/s) (average [b]38313.9 kb/s[/b])
0.710u 10.349s 0:55.51 19.9%    0+0k 4024+4194312io 22pf+0w

That's almost 37 MB/sec.! :up:

Unfortunately, I can't run the same test from Windows, as the [stupid] ethernet driver for my motherboard will bluescreen if I change the MTU to anything larger than 1500. Sigh.

So I'm not sure where the comments about slowness with the armel kernels are coming from, but if you can run GbE with Jumbo Frames, you'll rock!


Hi, ahagge

I have tested my Samba performance with Kurobox Pro running GbE. But I cannot manage to get beyond 22MB/s either in Windows or Linux. I am using the same image and kernal as yours(davy_gravy's 2.6.27.4).
Can you post your smb.conf file? And any other tweaks you have done to increast the performance?
BTW, does 9004 mean anything? Since my desktop pc only supports 9014, I wonder could that be a problem?

Thanks

Regards,
Robin


Top
   
PostPosted: Wed Feb 11, 2009 12:46 pm 
Offline
Regular Member

Joined: Tue Nov 27, 2007 3:19 pm
Posts: 217
Location: Dresden, Germany
ahagge wrote:
So I'm not sure where the comments about slowness with the armel kernels are coming from, but if you can run GbE with Jumbo Frames, you'll rock!


Thanks for investigating this!
So it's finally time to update to armel lenny, I guess! ;)

_________________
LS Pro v1:
  • Freelink (Debian etch), kernel: 2.6.16.57-lsp_eabi-dh_v3, gigabit network (9k jumbo frames)
  • running: mt-daapd (aka firefly), smb, amule, vsftpd, mysql, rsnapshot, micro_evtd testing ;)
  • upcoming: ampache (+ coherence), aria2, slimrat, apache, streamripper (record what my soundbridge is playing)...


Top
   
PostPosted: Thu Feb 12, 2009 3:35 am 
Offline
Newbie

Joined: Fri Jul 18, 2008 3:35 am
Posts: 22
moldowan wrote:
Thanks for investigating this!
So it's finally time to update to armel lenny, I guess! ;)


I'd better update this...I was getting decent read speeds (ie. Linkstation to PC), but horrible write speeds. By horrible, I can't seem to get better than about 2 MB/sec. :x Yeah, I know that's pathetic, but I've tried about everything I can think of, including compiling my own 2.6.28.2 kernel. Nothing has worked. I've seen some other threads indicating that there might be latency issues with the newer kernels, but no solutions yet. Jumbo Frames helped a little on read (bump from about 9 MB/sec. to about 12-13 MB/sec.), but not on write.

So I'd recommend staying put unless you need features from the new kernels. My performance definitely took a hit as a result of the upgrade, but I wanted to test a USB ATSC tuner that's available in the newer kernel (didn't work...sigh).

_________________
Linkstation Live v2 running: pvr on Hauppauge HVR-950, apache, nfs v4, samba, cups, streamripper, Nikon webcam, weather station (via open 2300)


Top
   
PostPosted: Thu Feb 12, 2009 4:00 am 
Offline
Site Admin
User avatar

Joined: Mon Aug 28, 2006 1:15 am
Posts: 2606
ahagge, NFS read/write is 12/2 (MB/sec)
and SMB read/write is 35/? (MB/sec?) or do I understand you incorrectly... ?

_________________
LS1 (foonas, nfs, Tranmission & p910nd print server, Firefly for my Roku)
LS-HG500 (Lenny)
Various LS-Pros v1,v2 (unbricked w/ serial & jtag)
KuroPro, LS2 & KuroHG (foonas)
Working on davysweather.dyndns.org lately...

=> wooohooo!
wooohooo!
Unknown command 'wooohooo!' - try 'help'


Top
   
PostPosted: Thu Feb 12, 2009 10:36 am 
Offline
Regular Member

Joined: Tue Nov 27, 2007 3:19 pm
Posts: 217
Location: Dresden, Germany
davy_gravy wrote:
ahagge, NFS read/write is 12/2 (MB/sec)
and SMB read/write is 35/? (MB/sec?) or do I understand you incorrectly... ?


ahagge, same question here! Actually I don't care about NFS...SMB is what really matters to me! And those 35 MB/s are looking really sweet. So please, can you test SMB writing speed?

_________________
LS Pro v1:
  • Freelink (Debian etch), kernel: 2.6.16.57-lsp_eabi-dh_v3, gigabit network (9k jumbo frames)
  • running: mt-daapd (aka firefly), smb, amule, vsftpd, mysql, rsnapshot, micro_evtd testing ;)
  • upcoming: ampache (+ coherence), aria2, slimrat, apache, streamripper (record what my soundbridge is playing)...


Top
   
PostPosted: Mon Feb 16, 2009 4:35 am 
Offline
Newbie

Joined: Tue Feb 03, 2009 1:44 pm
Posts: 10
moldowan wrote:
davy_gravy wrote:
ahagge, NFS read/write is 12/2 (MB/sec)
and SMB read/write is 35/? (MB/sec?) or do I understand you incorrectly... ?


ahagge, same question here! Actually I don't care about NFS...SMB is what really matters to me! And those 35 MB/s are looking really sweet. So please, can you test SMB writing speed?


I am in the same boat here. Actually I dont care about either NFS or Samba.
I have tested my Kurobox Pro yesterday with proftpd. Results are shown below:

Server: Kurobox Pro (davy_gravy's image 0.31b with kernel 2.6.26), MTU 9004, proftpd
Client: Desktop PC (Winxp Sp3) with onboard Marvell Yukon NIC, MTU 9014 (I can only set to 9014 in windows), filezilla
Results: Avg speed is about 25-27MB/s. Sometimes speed slowed down to 17MB/s. Sometimes boosted to 33MB/s. Weird.

So I am REALLY curious about how to get 37MB/s avg speed. I thought samba should be slower than ftp.


Top
   
PostPosted: Mon Feb 16, 2009 7:56 am 
Offline
Newbie

Joined: Fri Mar 21, 2008 3:04 am
Posts: 52
For those who are suffering the performance issue, try to compile the kernel without preempt option. That should promote at least about 30% disk I/O performance. Then try the NFS/Samba/FTP again. Of course, this is still not as good as the buffalo official kernel, but it's a big advantage already.


Top
   
PostPosted: Tue Feb 17, 2009 4:00 am 
Offline
Newbie

Joined: Fri Jul 18, 2008 3:35 am
Posts: 22
OK, lessee (apologies for the long post)...
davy_gravy wrote:
ahagge, NFS read/write is 12/2 (MB/sec)
and SMB read/write is 35/? (MB/sec?) or do I understand you incorrectly... ?
No, you actually understand me correctly. I don't understand the situation any better than the rest of you. But I've made a LOT of changes in the past couple of weeks. Alas, none have made a big difference. Here's the current setup:

  • I just compiled a new kernel (2.6.28.5), making sure to disable the kernel preempt option per hato's suggestion.
  • I've updated my Linkstation with the updated packages from the just-released "final" Debian lenny distro.
  • I used lb_worm's suggestion from this thread to add the entry
    Code:
    vm.min_free_kbytes = 8192
    to the file /etc/sysctl.conf . This alleviated an issue I was having with jumbo frames being enabled.
  • I'm using gigabit ethernet, with jumbo frames (9004 MTU).
  • I'm currently using NFS4 over TCP for NFS testing, with options:
    Code:
    rw,rsize=65535,wsize=65535,proto=tcp
  • To answer another question from this thread, the only "unusual" performance-oriented option I have in my smb.conf file is the "socket options" line:
    Code:
    socket options = IPTOS_LOWDELAY TCP_NODELAY SO_RCVBUF=65536 SO_SNDBUF=65536
With all of the above, I've repeated my tests with a test file of almost a gigabyte in size (to ensure that it overruns any local caching). Here's some typical sample results:

  • SMB read (Linkstation->PC):
    Code:
    time smbclient -U alan -c 'get "1GBtestfile"' '\\ls1\share' <password>
    Domain=[LS1] OS=[Unix] Server=[Samba 3.2.5]
    getting file \1GBtestfile of size 912909312 as 1GBtestfile (35706.2 kb/s) (average 35706.2 kb/s)
    0.306u 4.700s 0:25.39 19.6%     0+0k 0+1783048io 0pf+0w
  • SMB write (PC->Linkstation):
    Code:
    [alan@viper store]$ time smbclient -U alan -c 'put "1GBtestfile"' '\\ls1\share' <password>
    Domain=[LS1] OS=[Unix] Server=[Samba 3.2.5]
    putting file 1GBtestfile as \1GBtestfile (18270.6 kb/s) (average 18270.6 kb/s)
    0.544u 2.147s 0:49.16 5.4%      0+0k 0+0io 0pf+0w
  • NFS read (Linkstation->PC):
    Code:
    time dd if=/mnt/ls1/share/1GBtestfile of=1GBtestfile bs=8M
    108+1 records in
    108+1 records out
    912909312 bytes (913 MB) copied, 53.5167 s, 17.1 MB/s
    0.000u 4.633s 0:54.07 8.5%      0+0k 1783048+1783032io 0pf+0w
  • NFS write (PC->Linkstation): :down:
    Code:
    time dd if=1GBtestfile of=/mnt/ls1/share/1GBtestfile bs=8M
    108+1 records in
    108+1 records out
    912909312 bytes (913 MB) copied, 293.616 s, 3.1 MB/s
    0.001u 2.895s 4:54.72 0.9%      0+0k 832+1783032io 0pf+0w
Caveats:
  • As sledgehammer commented, there was a lot of variability in the SMB tests, especially the read tests. I'd see numbers as low as 18 MB/sec. and as high as 35 MB/sec. All results shown were the median result of 3 consecutive runs.
  • NFS version 4 didn't seem to differ significantly from NFS version 3, using the same options

Summary: NFS writes suck...

_________________
Linkstation Live v2 running: pvr on Hauppauge HVR-950, apache, nfs v4, samba, cups, streamripper, Nikon webcam, weather station (via open 2300)


Top
   
PostPosted: Tue Feb 17, 2009 4:04 am 
Offline
Site Admin
User avatar

Joined: Mon Aug 28, 2006 1:15 am
Posts: 2606
ahagge wrote:
...
Summary: NFS writes suck...


hehehehe, it has some really nice qualities that I like, but speed seems to have suffered since 2.6.19 or whenever that change was made that seems to effectively dropped NFS speeds...

ahagge, thanks for the detail of your response.

I think I'll try what you mention... even 18MB/sec write is pretty good.

EDIT: Then I can try it w/ AFP as well.

_________________
LS1 (foonas, nfs, Tranmission & p910nd print server, Firefly for my Roku)
LS-HG500 (Lenny)
Various LS-Pros v1,v2 (unbricked w/ serial & jtag)
KuroPro, LS2 & KuroHG (foonas)
Working on davysweather.dyndns.org lately...

=> wooohooo!
wooohooo!
Unknown command 'wooohooo!' - try 'help'


Top
   
PostPosted: Tue Feb 17, 2009 9:48 am 
Offline
Regular Member

Joined: Tue Nov 27, 2007 3:19 pm
Posts: 217
Location: Dresden, Germany
ahagge, thanks a lot for your comprehensive analysis!

SMB speed really looks nice!

_________________
LS Pro v1:
  • Freelink (Debian etch), kernel: 2.6.16.57-lsp_eabi-dh_v3, gigabit network (9k jumbo frames)
  • running: mt-daapd (aka firefly), smb, amule, vsftpd, mysql, rsnapshot, micro_evtd testing ;)
  • upcoming: ampache (+ coherence), aria2, slimrat, apache, streamripper (record what my soundbridge is playing)...


Top
   
PostPosted: Wed Feb 18, 2009 4:34 am 
Offline
Newbie

Joined: Tue Feb 03, 2009 1:44 pm
Posts: 10
ahagge, thanks for you info.

Can you test some ftpd performance? like proftpd, pure-ftpd

Best Regards,
Robin


Top
   
Display posts from previous:  Sort by  
Post new topic  Reply to topic  [ 19 posts ]  Go to page 1 2 Next

All times are UTC+01:00


Who is online

Users browsing this forum: No registered users and 2 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Powered by phpBB® Forum Software © phpBB Limited