perfSONAR User Q&A and Other Discussion

["Pennington, Mike" <>]

Big thanks to Brian at ES.net, for some reason we totally forgot iperf3 does not support multiple steams, you need to run it multiple times on different ports.  But without any tweaking at all and using iperf with the -P 10, it looks a LOT better now 😊

 

[SUM] 0.00-10.02 sec   110 GBytes  94.1 Gbits/sec

 

 

 

Mike Pennington CEN | Network Engineer Hartford CT | 06105-3702 o 860 622 4566 Visit our Website

 

 

From: Pennington, Mike
Sent: Friday, July 28, 2023 11:35 AM
To:
Subject: Tips and Tricks for 100G nodes?

 

Happy Friday! 

 

Before I go researching online, I’m wondering if there are any tips, tricks, or tweaks, that I need to do to get 100G tests somewhere close to 100G?  I’ve been reading it may depend on the hardware (RAM/CPU), or I may need to tweak certain Linux parameters, but not 100% sure yet.

 

We’re currently testing a couple 100G Supermicro boxes (we will be testing a couple Dell ones as well).  Here is the build for reference:

 

 

 

Installed a fresh Red Hat on both boxes and did a clean install of the entire Toolkit, everything there went perfect.  I can access both nodes and do testing.

 

I’ve run multiple tests and tried a few different tweaks, but the results are all about the same.

 

First test we did between the two nodes had a couple routers in between them, these were the results:

 

- - - - - - - - - - - - - - - - - - - - - - - - -

[ ID] Interval           Transfer     Bitrate         Retr

[  5]   0.00-10.00  sec  42.7 GBytes  36.7 Gbits/sec  4985             sender

[  5]   0.00-10.00  sec  42.7 GBytes  36.7 Gbits/sec                  receiver

 

So my next test was a 100G connection directly between the two nodes with some private IP addressing, here are the results:

 

- - - - - - - - - - - - - - - - - - - - - - - - -

[ ID] Interval           Transfer     Bitrate         Retr

[  5]   0.00-10.00  sec  43.3 GBytes  37.2 Gbits/sec  3754             sender

[  5]   0.00-10.00  sec  43.3 GBytes  37.2 Gbits/sec                  receiver

 

Only a little better, directly connected.

 

My last test was to run the server and client on the same box, so opened a couple SSH windows and did that and here are the results:

 

[ ID] Interval           Transfer     Bitrate         Retr

[  5]   0.00-10.00  sec  68.8 GBytes  59.1 Gbits/sec    0             sender

[  5]   0.00-10.00  sec  68.8 GBytes  59.1 Gbits/sec                  receiver

 

Much better, still not close to 100G though…and this was on the same box without going out to anywhere.

 

Any thoughts would be much appreciated.

 

Thanks

Mike

 

 

Mike Pennington CEN | Network Engineer Hartford CT | 06105-3702 o 860 622 4566 Visit our Website