perfSONAR User Q&A and Other Discussion

[Prannoy Sablok <>]

Hi all,

Hope everyone's well and safe from Covid-19.

I installed perfsonar-testpoint on an Ubuntu 18.04.5 LTS server and have been trying to run a throughput test. But I keep getting an odd error as below when I use the command pscheduler task throughput --source=dtn.singaren.net.sg --dest=ac-dtn.singaren.net.sg . However it does work successfully when I simply use iperf3 -c dtn.singaren.net.sg with the iperf -s command on the destination. I have tried to diagnose it but have been unable to find the cause. May I please request the help of the members here to fix this issue? If this helps, the iperf version installed is 3.9 on the source server.  

 

------------------------------
Command - 

Error - 

Submitting task...
Task URL:
https://dtn.singaren.net.sg/pscheduler/tasks/9d277ae2-271d-4891-a4d6-cd747fed25fc
Running with tool 'iperf3'
Fetching first run...

Next scheduled run:
https://dtn.singaren.net.sg/pscheduler/tasks/9d277ae2-271d-4891-a4d6-cd747fed25fc/runs/c055994d-3057-4b7a-8d0e-c1934e728e53
Starts 2021-07-26T15:36:41+08 (~6 seconds)
Ends   2021-07-26T15:37:00+08 (~18 seconds)
Waiting for result...

Run failed.

Error:
  iperf3 returned an error: {
        "start":        {
                "connected":    [],
                "version":      "iperf 3.9",
                "system_info":  "Linux dtn.singaren.net.sg 3.10.0-1160.31.1.el7.x86_64 #1 SMP Thu Jun 10 13:32:12 UTC 2021 x86_64"
        },
        "intervals":    [],
        "end":  {
        }
  }


  iperf3: error - unable to send control message: Bad file descriptor



Diagnostics:
  Participant 0:
  numactl -N 0 /usr/bin/iperf3 -p 5201 -B 203.30.39.19 -c 203.30.39.22 -t 10 --json --rsa-public-key-path /run/pscheduler-server/runner/tmp/tmpuxqvh8mu/tmpoe5s2q1a/public-key --username Cd1Wtz0DRkhp5Fphg8Ox
  Participant 1:
  numactl -N 1 /usr/bin/iperf3 -s -1 --json -p 5201 -B 203.30.39.22 --authorized-users-path /var/run/pscheduler-server/runner/tmp/tmp2oeplnfj/tmpv0j4tff4/credentials --rsa-private-key-path /var/run/pscheduler-server/runner/tmp/tmp2oeplnfj/tmpv0j4tff4/private-key


Limit system diagnostics for this run:
  Hints:
    requester: 203.30.39.22
    server: 203.30.39.19
  Identified as everybody
  Classified as default
  Application: Defaults applied to non-friendly hosts
    Group 1: Limit 'innocuous-tests' failed: Passed but inverted
    Group 1: Limit 'throughput-default-tcp' passed
    Group 1: Limit 'throughput-default-udp' failed: UDP testing not allowed
    Group 1: Limit 'idleex-default' failed: Test is not 'idleex'
    Group 1: Want any, 1/4 passed, 3/4 failed: PASS
    Application PASSES
  Proposal meets limits
  Priority set to default of 0

Error from dtn.singaren.net.sg:
  iperf3 returned an error: {
        "start":        {
                "connected":    [],
                "version":      "iperf 3.9",
                "system_info":  "Linux dtn.singaren.net.sg 3.10.0-1160.31.1.el7.x86_64 #1 SMP Thu Jun 10 13:32:12 UTC 2021 x86_64"
        },
        "intervals":    [],
        "end":  {
        }
  }


  iperf3: error - unable to send control message: Bad file descriptor



Diagnostics from dtn.singaren.net.sg:
  numactl -N 0 /usr/bin/iperf3 -p 5201 -B 203.30.39.19 -c 203.30.39.22 -t 10 --json --rsa-public-key-path /run/pscheduler-server/runner/tmp/tmpuxqvh8mu/tmpoe5s2q1a/public-key --username Cd1Wtz0DRkhp5Fphg8Ox

Error from ac-dtn.singaren.net.sg:
  iperf3 returned an error:

  /usr/bin/iperf3: unrecognized option '--authorized-users-path'
  Usage: iperf3 [-s|-c host] [options]
         iperf3 [-h|--help] [-v|--version]

  Server or Client:
    -p, --port      #         server port to listen on/connect to
    -f, --format   [kmgtKMGT] format to report: Kbits, Mbits, Gbits, Tbits
    -i, --interval  #         seconds between periodic throughput reports
    -F, --file name           xmit/recv the specified file
    -A, --affinity n/n,m      set CPU affinity
    -B, --bind      <host>    bind to the interface associated with the address <host>
    -V, --verbose             more detailed output
    -J, --json                output in JSON format
    --logfile f               send output to a log file
    --forceflush              force flushing output at every interval
    --timestamps    <format>  emit a timestamp at the start of each output line
                              (using optional format string as per strftime(3))
    -d, --debug               emit debugging output
    -v, --version             show version information and quit
    -h, --help                show this message and quit
  Server specific:
    -s, --server              run in server mode
    -D, --daemon              run the server as a daemon
    -I, --pidfile file        write PID file
    -1, --one-off             handle one client connection then exit
    --server-bitrate-limit #[KMG][/#]   server's total bit rate limit (default 0 = no limit)
                              (optional slash and number of secs interval for averaging
                              total data rate.  Default is 5 seconds)
  Client specific:
    -c, --client    <host>    run in client mode, connecting to <host>
    -u, --udp                 use UDP rather than TCP
    --connect-timeout #       timeout for control connection setup (ms)
    -b, --bitrate #[KMG][/#]  target bitrate in bits/sec (0 for unlimited)
                              (default 1 Mbit/sec for UDP, unlimited for TCP)
                              (optional slash and packet count for burst mode)
    --pacing-timer #[KMG]     set the timing for pacing, in microseconds (default 1000)
    --fq-rate #[KMG]          enable fair-queuing based socket pacing in
                              bits/sec (Linux only)
    -t, --time      #         time in seconds to transmit for (default 10 secs)
    -n, --bytes     #[KMG]    number of bytes to transmit (instead of -t)
    -k, --blockcount #[KMG]   number of blocks (packets) to transmit (instead of -t or -n)
    -l, --length    #[KMG]    length of buffer to read or write
                              (default 128 KB for TCP, dynamic or 1460 for UDP)
    --cport         <port>    bind to a specific client port (TCP and UDP, default: ephemeral port)
    -P, --parallel  #         number of parallel client streams to run
    -R, --reverse             run in reverse mode (server sends, client receives)
    --bidir                   run in bidirectional mode.
                              Client and server send and receive data.
    -w, --window    #[KMG]    set window size / socket buffer size
    -C, --congestion <algo>   set TCP congestion control algorithm (Linux and FreeBSD only)
    -M, --set-mss   #         set TCP/SCTP maximum segment size (MTU - 40 bytes)
    -N, --no-delay            set TCP/SCTP no delay, disabling Nagle's Algorithm
    -4, --version4            only use IPv4
    -6, --version6            only use IPv6
    -S, --tos N               set the IP type of service, 0-255.
                              The usual prefixes for octal and hex can be used,
                              i.e. 52, 064 and 0x34 all specify the same value.
    --dscp N or --dscp val    set the IP dscp value, either 0-63 or symbolic.
                              Numeric values can be specified in decimal,
                              octal and hex (see --tos above).
    -L, --flowlabel N         set the IPv6 flow label (only supported on Linux)
    -Z, --zerocopy            use a 'zero copy' method of sending data
    -O, --omit N              omit the first n seconds
    -T, --title str           prefix every output line with this string
    --extra-data str          data string to include in client and server JSON
    --get-server-output       get results from server
    --udp-counters-64bit      use 64-bit counters in UDP test packets
    --repeating-payload       use repeating pattern in payload, instead of
                              randomized payload (like in iperf2)

  [KMG] indicates options that support a K/M/G suffix for kilo-, mega-, or giga-

  iperf3 homepage at: https://software.es.net/iperf/
  Report bugs to:     https://github.com/esnet/iperf



Diagnostics from ac-dtn.singaren.net.sg:
  numactl -N 1 /usr/bin/iperf3 -s -1 --json -p 5201 -B 203.30.39.22 --authorized-users-path /var/run/pscheduler-server/runner/tmp/tmp2oeplnfj/tmpv0j4tff4/credentials --rsa-private-key-path /var/run/pscheduler-server/runner/tmp/tmp2oeplnfj/tmpv0j4tff4/private-key

Kind Regards,

Prannoy SABLOK

Technical Specialist

Singapore Advanced Research and Education Network (SingAREN)

    

M  +65 87492366|   E 

www.singaren.net.sg