Skip to Content.
Sympa Menu

perfsonar-user - Re: [perfsonar-user] throughput test timeouts

Subject: perfSONAR User Q&A and Other Discussion

List archive

Re: [perfsonar-user] throughput test timeouts


Chronological Thread 
  • From: Mark Feit <>
  • To: Michael Thomas <>, "" <>
  • Subject: Re: [perfsonar-user] throughput test timeouts
  • Date: Tue, 8 Mar 2022 17:41:45 +0000
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=internet2.edu; dmarc=pass action=none header.from=internet2.edu; dkim=pass header.d=internet2.edu; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=lzQ5oN/f2jZTpzR9pLCkOna2EPrVrWWbFXdGpSfLL80=; b=X6LsReV9bNYjPQOHVBnYQBM7cCi5FCPwggXE2gwnbwuq8Tit1jbykN/Ltt7e+UYXpI3q4cZpxHGv3j+r7pZaZrwgiZ/r0lmesAhjHmtGnzmRiGngvNVU8SgagtITzxj7SpPHEdsKraJMxA1pw1gSRNkssrv3fftqsB0s0HNv6mLRlxPdoA1m68oXConL31Dx+wSEk0P0QDUszat64xZUrL1n9U/DsV+q5KuyfPuN0HnT+UlKtB+mH4dxOVzAyPVbpbestG1IAfG/TyBSI4UVcOZzEjKwpSCY866a1Uzit26we8GeEs2HrYls+kIoDaxQyusr1eSZJzj5eLYoQxqqmw==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lkLbsaXaHqDi+hqmI+awyMjTegFPTheTZGEAzul62LA2U8wuDVPNm4X0pIaApzhQwcgDN4Mwwm6OHe4ZJUYuu81CSM4B7E+XsinHg//oYMCEHTbEE7LUnCiTTXdVWhcdgdg5MP70/TgV7s0w3O9rCIuECY7l8oMfMBlehpfjg0fnfeuMk2aq5dnyWm+GfJYnDWTh/+8CShmy2FKKVkvSYHlQ0ehKxyi/hu+AiRVS6wOADhXN3wKZtIgycvfYc3WOlpY7y4YAGyJTGamXu7GnDg8xu/izsY3XE85eqMo9iNzLz9aLeiiHxzwwkjIpnhTPs4MdiONgVkAmZZhYJlSq1A==

Michael Thomas writes:

 

I recently set up a perfsonar server and configured it to run throughput
tests with two other sites in our group.  The iperf3 tests from my site
to the remote locations works fine, but all incoming tests fail…

Error from perfsonar.ligo-wa.caltech.edu:
   iperf3 output has neither 'sum_sent' nor 'sum' field, and one of them
is required

 

This part’s a bug.  The plugin should have detected the error before looking for real data in the output.  I’ve opened a ticket on that and will fix it in 5.0:  https://github.com/perfsonar/pscheduler/issues/1270.


Diagnostics from perfsonar.ligo-wa.caltech.edu:
   /usr/bin/iperf3 -p 5201 -B 198.129.208.245 -c 208.69.128.92 -t 10
--json --rsa -public-key-path /var/run/pscheduler-server/runner/tmp/tmp_j91baqu/tmpumiughjb/public-key
--username <username redacted>

 

Unrelated note:  There’s no need to redact those; they’re only valid for one measurement.


   {
         "error":        "test authorization failed"
   }

How can I further debug this authorization failure?

 

The fault is at the far end (208.69.128.92, ligo-la).  I did a telnet to port 5201 on that host and got an answer, which is strange because there was no throughput test scheduled when I did it.  I followed it up with an attempt to run iperf3 against it and got a similar authorization failure.  Odds are very, very good there’s a stray iperf3 process in server mode on that host.  If you’d like an additional set of eyes while you poke around on that system, drop me a line off-list and we’ll set something up.

 

The production code will attempt to hunt down and terminate processes that appear to be orphaned iperf3 servers, but it isn’t perfect.  The latest version of iperf3 has some switches that will let us prevent the server process from running past the scheduled end time of the measurement and there’s already code in the pipeline for 5.0 to take advantage of it.

 

--Mark

 




Archive powered by MHonArc 2.6.24.

Top of Page