perfSONAR User Q&A and Other Discussion

[Brent Draney <>]

There are several 100G PerfSonar nodes but that is going in the opposite direction of low cost.

perfsonar.nersc.gov is one such system and it has measured over 80 Gbps  to remote 100G 

perfsonar nodes.  NERSC’s next generation of PerfSonar will be Epyc based but it will be a high clock

chip so also not a cheap solution if you wanted to scale out.

If anyone wants the spec’s for our current or next node feel free to send me a message.

Thanks,

Brent

On May 1, 2019, at 7:34 AM, David J. Chaffin <> wrote:

Related:

Though Paul's data show D15xx should be fine for 10Gb, has anyone tried Epyc 3xxx?  Price of Xeon-D, maybe 3-4x performance.  Maybe it could do 25/40/100 Gb perfsonar? 

Example:

https://www.amazon.com/Supermicro-5019D-FTN4-8-Core-Embedded-Rackmount/dp/B07Q789NZB

--

David Chaffin

U. of Arkansas

---

From:  <> on behalf of Paul Gunn <>
Sent: Monday, April 29, 2019 8:28 PM
To: Minseok Jang
Cc: 
Subject: Re: [perfsonar-user] Xeon-D adequate for low cost 10G PS under $2,000 USD? If not, recommend cheapest 10G HW.

 

Hi Minseok,

I have ~25 perfSONAR testpoints installed around New Zealand based on Supermicro 5018D-FN8T systems, or that motherboard in a different case (DC data centres). Their X10SDV-TP8F motherboard is based around a Xeon processor D-1518. And they work fine for me.

We're running on Ubuntu 16.04, with only the testpoint packages installed on the machines.

I tried to do a simultaneous 10G test between two 10G nodes, 22 ms apart, to show you. But pscheduler was too smart for me. First one, then the other.

Running iperf3 from the command line on both hosts simultaneously, i get ~9.82 Gbits/s

pg.

Paul Gunn
Systems Administrator

Research & Education 
Advanced Network New Zealand

M +64 21 521 884

E 

www.reannz.co.nz

On Tue, 9 Apr 2019 at 13:51, Minseok Jang <> wrote:

Hi, all.

I'm planning to deploy 10~30 PS nodes in KREONET until next year. Most sites are connected with 1G, but I want to deploy 10G PS for the future. A budget for 1 PS node is under $2000 USD.

I found that Xeon-D processor contains 10GbE controller in the processor[1]. Supermicro Xeon-D solution has IPMI remote console. It is important for remote management. Its price is around $1500 at Amazon[2]. Unfortunately, I found that Xeon D-1540 gives poor performance on this video[3]. It shows 2.6Gbps on Windows 10 in the iperf test.

Is there any perfSONAR based one Xeon D-15xx or Xeon D-21xx? Is it recommendable for 10G perfSONAR? If not, could you recommend low cost one?

Best Regards

Minseok Jang

[1] https://www.servethehome.com/intel-xeon-d-soc-changing-broadwell-de/

[2] https://www.amazon.com/s?k=xeon+d+10gbe

[3] https://www.youtube.com/watch?v=8a_wlRSiTD4

--

Minseok Jang

KREONET Center / Supercomputing Division

Korea Institute of Science and Technology Information

Email: 

LinkedIn: https://www.linkedin.com/in/msjang

Phone: +82-42-869-1292 / Mobile: +82-10-2630-7480

--
To unsubscribe from this list: https://lists.internet2.edu/sympa/signoff/perfsonar-user

--
To unsubscribe from this list: https://lists.internet2.edu/sympa/signoff/perfsonar-user