Skip to Content.
Sympa Menu

perfsonar-user - Re: [perfsonar-user] mesh tests fail to archive results from reverse path tests

Subject: perfSONAR User Q&A and Other Discussion

List archive

Re: [perfsonar-user] mesh tests fail to archive results from reverse path tests


Chronological Thread 
  • From: Andrew Lake <>
  • To: "Uhl, George D. (GSFC-423.0)[SGT INC]" <>, "" <>
  • Subject: Re: [perfsonar-user] mesh tests fail to archive results from reverse path tests
  • Date: Thu, 27 Apr 2017 10:01:36 -0400
  • Ironport-phdr: 9a23:EWrB9RF80EcGJZGfipADXp1GYnF86YWxBRYc798ds5kLTJ7ypsuwAkXT6L1XgUPTWs2DsrQf2rSQ7/6rBzFIyK3CmUhKSIZLWR4BhJdetC0bK+nBN3fGKuX3ZTcxBsVIWQwt1Xi6NU9IBJS2PAWK8TW94jEIBxrwKxd+KPjrFY7OlcS30P2594HObwlSijewZbJ/IA+5oAjQucUbgItvIbstxxXUpXdFZ/5Yzn5yK1KJmBb86Maw/Jp9/ClVpvks6c1OX7jkcqohVbBXAygoPG4z5M3wqBnMVhCP6WcGUmUXiRVHHQ7I5wznU5jrsyv6su192DSGPcDzULs5Vyiu47ttRRT1kyoMKSI3/3/LhcxxlKJboQyupxpjw47PfYqZMONycr7Bcd8GQGZMWMheVzZFAoihcYUBCeQPNvtco4Xkp1YCqB2zDhSuCuzy0D9Fnn/40q800+omHg7I0g8uEc8QvnvIt9j6LrseXPqvwaTS0TnObfVb0ir95ojSdRAhpOmBUK52ccXM00kgCQ3EhUiWp4P/PDOayPkGvm+B4OpmSO2ui3UqpB9qojS1wMcjlJXJi5sTx1vZ+yt5x4M1Kse5SE59edOkFoFftzqAOIdsTcMiRH9otD4/yrIctp+7cykKyJs9yB7HbPyHa5KE4hT9W+aNJzpzmXFreKqnihqv70StyffwW8eu3FtFsyZJiNvBum0V2xDN9sSKTuFx80Sh1DqVygze7v9ILVoqmabHN5IsxKM7mIAJvkTZBCD2nV37jK+IeUUg/eil8+rnbavpq5OGM497kQX+Pr4hmsy4H+Q0KgkOX26F9uSgzLDv4FP1TbZQgvA4iKXUv43WKd4Zq6KkGwNV15ws6xe7DzeoytQYmnwHIUpfdxKBkofoO0rDL+7jDfulhVSjjitry+jcPrL9GpXNMmTDkLD5cLZl9UFc0gQzzctY55JSEL4BOuv/WlLqtNPGFB80KAi0w+f8CNVhzYMSR3iDAq6fMKPOr1CI/OQvLPeQZIMLojryNeUq5+O9xUM+zBUgfa3tlbQab2q3E7xKZQ3ZTkHCqZJdSzxM5ksNd8PWwHykegsZLyK9UqUm6Tx9BMS7DYPrQIm2ifqO2zntWtUcfm1cBEuLF37yMpifVu0kaSSOL9VnnyBeE7WtVsVpgQmjrgHhzLxuNK/J4SACnZPlyNVv4eDPz1c/+SEiXOqH1GTYZmd4hG4XDxs/36039UV7xkar3LM+hfFEQ48Ar8hVWxs3YMaPh9dxDMr/D0eYJoqE




On April 26, 2017 at 7:00:48 PM, Uhl, George D. (GSFC-423.0)[SGT INC] () wrote:

Thanks for the clarification, Andy.  So back in the 3.5.1 days I had identified pS nodes that I don’t manage as no_agent hosts with the intention of having my managed pS nodes initiate the bi-directional tests and send the bi-directional results the central MA.  Is that feature no longer available in pS 4.0?

You can still do no_agent with force bidirectional and your host will still initiate the test (i.e. be responsible for creating the pscheduler task) but in the caseof throughput, traceroute and ping tests the source is always the be one that sends it to the archiver regardless of the initator. Your OWAMP tests (latency and latencybg in pscheduler terminology) still work the same way since we can use the —flip option to have the local side be the only pscheduler participant and thus responsible for the archiving even when it is not the source. 





Thanks,
George

From: Andrew Lake <>
Date: Wednesday, April 26, 2017 at 4:27 PM
To: George Uhl <>, "" <>
Subject: Re: [perfsonar-user] mesh tests fail to archive results from reverse path tests

Hi George,

Sorry for the delay. The source of the test is always responsible for archiving and is the side that has all the info about whether it succeeded or not. If you swap mcln-ps.maxgigapop.net into the URL you should see what you are after:

2017-04-25T03:53:08-05:00 on mcln-ps.maxgigapop.net and enpl-pt2-10g.eos.nasa.gov with iperf3:

throughput --duration PT30S --source mcln-ps.maxgigapop.net --ip-version 4 --dest enpl-pt2-10g.eos.nasa.gov --window-size 1310720 --parallel 1

* Stream ID 4
Interval       Throughput     Retransmits    Current Window 
0.0 - 1.0      9.03 Gbps      0              2.03 MBytes    
1.0 - 2.0      8.87 Gbps      0              2.03 MBytes    
2.0 - 3.0      8.70 Gbps      0              2.03 MBytes    
3.0 - 4.0      8.92 Gbps      0              2.03 MBytes    
4.0 - 5.0      8.81 Gbps      0              2.03 MBytes    
5.0 - 6.0      8.50 Gbps      0              2.03 MBytes    
6.0 - 7.0      8.05 Gbps      0              2.03 MBytes    
7.0 - 8.0      7.79 Gbps      0              2.03 MBytes    
8.0 - 9.0      7.49 Gbps      0              2.03 MBytes    
9.0 - 10.0     8.43 Gbps      0              2.03 MBytes    
10.0 - 11.0    8.64 Gbps      0              2.03 MBytes    
11.0 - 12.0    8.46 Gbps      0              2.03 MBytes    
12.0 - 13.0    8.10 Gbps      0              2.03 MBytes    
13.0 - 14.0    7.80 Gbps      0              2.03 MBytes    
14.0 - 15.0    7.23 Gbps      0              2.03 MBytes    
15.0 - 16.0    7.04 Gbps      0              2.03 MBytes    
16.0 - 17.0    7.10 Gbps      0              2.03 MBytes    
17.0 - 18.0    6.99 Gbps      0              2.03 MBytes    
18.0 - 19.0    7.26 Gbps      0              2.03 MBytes    
19.0 - 20.0    7.32 Gbps      0              2.03 MBytes    
20.0 - 21.0    7.38 Gbps      0              2.03 MBytes    
21.0 - 22.0    7.37 Gbps      0              2.03 MBytes    
22.0 - 23.0    7.29 Gbps      0              2.03 MBytes    
23.0 - 24.0    7.21 Gbps      0              2.03 MBytes    
24.0 - 25.0    7.11 Gbps      0              2.03 MBytes    
25.0 - 26.0    7.07 Gbps      0              2.03 MBytes    
26.0 - 27.0    7.06 Gbps      0              2.03 MBytes    
27.0 - 28.0    6.99 Gbps      0              2.03 MBytes    
28.0 - 29.0    7.07 Gbps      0              2.03 MBytes    
29.0 - 30.0    7.07 Gbps      0              2.03 MBytes    

Summary
Interval       Throughput     Retransmits    
0.0 - 30.0     7.74 Gbps      0

Archivings:

  To esmond, Finished
    2017-04-25T03:53:53-05:00 400: Invalid JSON returned
    2017-04-25T03:54:58-05:00 400: Invalid JSON returned
    2017-04-25T04:04:05-05:00 400: Invalid JSON returned
    2017-04-25T05:06:55-05:00 400: Invalid JSON returned
    2017-04-25T06:07:27-05:00 400: Invalid JSON returned
    2017-04-25T07:07:32-05:00 400: Invalid JSON returned
    2017-04-25T08:12:35-05:00 400: Invalid JSON returned
    2017-04-25T09:13:20-05:00 400: Invalid JSON returned
    2017-04-25T10:16:57-05:00 400: Invalid JSON returned
    2017-04-25T11:17:02-05:00 400: Invalid JSON returned
    2017-04-25T12:17:08-05:00 400: Invalid JSON returned
    2017-04-25T13:17:13-05:00 400: Invalid JSON returned
    2017-04-25T14:18:37-05:00 400: Invalid JSON returned
    2017-04-25T15:22:30-05:00 Archiver permanently abandoned registering test after 14 attempt(s): 400: Invalid JSON returned


Does archive.eos.nasa.gov allow mcln-ps.maxgigapop.net to connect to it on port 443? Having the source be responsible for the archiving is a change from 3.5 and a result of some of the architectural changes.

Thanks,
Andy




On April 25, 2017 at 3:09:01 PM, Uhl, George D. (GSFC-423.0)[SGT INC] () wrote:

Since the pS 4.0 upgrade I’ve noticed that some tests results are not getting archived to a my central archive.  In these cases I manage one of the hosts and I test to a no_agent host.  It’s the test results sourced from the no_agent host that fail to be archived.  Drilling down into the pscheduler results on my managed host shows tests in both directions run successfully but only the managed->no_agent test results get archived.  Nothing obvious in my meshconfig-agent-tasks.conf file stands out to me that would indicate a cause. 

From my managed host:

# pscheduler result --archivings https://enpl-pt2-10g.eos.nasa.gov/pscheduler/tasks/bb0dd703-6559-4543-83d6-b3844bba516a/runs/356db092-d154-4a30-b728-1a256431635c

2017-04-25T06:53:59-04:00 on enpl-pt2-10g.eos.nasa.gov and mcln-ps.maxgigapop.net with iperf3:


throughput --duration PT30S --source enpl-pt2-10g.eos.nasa.gov --ip-version 4 --dest mcln-ps.maxgigapop.net --window-size 1310720 --parallel 1


* Stream ID 4

Interval       Throughput     Retransmits    Current Window 

0.0 - 1.0      6.19 Gbps      0              2.03 MBytes    

1.0 - 2.0      6.29 Gbps      0              2.03 MBytes    

2.0 - 3.0      6.28 Gbps      0              2.03 MBytes    

3.0 - 4.0      6.22 Gbps      0              2.03 MBytes    

4.0 - 5.0      6.15 Gbps      0              2.03 MBytes    

5.0 - 6.0      6.08 Gbps      0              2.03 MBytes    

6.0 - 7.0      5.89 Gbps      0              2.03 MBytes    

7.0 - 8.0      5.56 Gbps      0              2.03 MBytes    

8.0 - 9.0      5.06 Gbps      0              2.03 MBytes    

9.0 - 10.0     4.65 Gbps      0              2.03 MBytes    

10.0 - 11.0    4.38 Gbps      0              2.03 MBytes    

11.0 - 12.0    4.23 Gbps      0              2.03 MBytes    

12.0 - 13.0    4.25 Gbps      0              2.03 MBytes    

13.0 - 14.0    4.39 Gbps      0              2.03 MBytes    

14.0 - 15.0    6.29 Gbps      0              2.03 MBytes    

15.0 - 16.0    6.67 Gbps      0              2.03 MBytes    

16.0 - 17.0    6.64 Gbps      0              2.03 MBytes    

17.0 - 18.0    6.64 Gbps      0              2.03 MBytes    

18.0 - 19.0    6.68 Gbps      0              2.03 MBytes    

19.0 - 20.0    6.67 Gbps      0              2.03 MBytes    

20.0 - 21.0    6.66 Gbps      0              2.03 MBytes    

21.0 - 22.0    6.63 Gbps      0              2.03 MBytes    

22.0 - 23.0    6.63 Gbps      0              2.03 MBytes    

23.0 - 24.0    6.65 Gbps      0              2.03 MBytes    

24.0 - 25.0    6.68 Gbps      0              2.03 MBytes    

25.0 - 26.0    6.65 Gbps      0              2.03 MBytes    

26.0 - 27.0    6.66 Gbps      0              2.03 MBytes    

27.0 - 28.0    6.68 Gbps      0              2.03 MBytes    

28.0 - 29.0    6.66 Gbps      0              2.03 MBytes    

29.0 - 30.0    6.66 Gbps      0              2.03 MBytes    


Summary

Interval       Throughput     Retransmits    

0.0 - 30.0     6.06 Gbps      0


Archivings:


  To esmond, Finished

    2017-04-25T06:54:40-04:00 Succeeded




From the no_agent host:

# pscheduler result  --archivings https://enpl-pt2-10g.eos.nasa.gov/pscheduler/tasks/36bb4f1d-dd27-4e5b-8975-36d36b014af2/runs/2819c8ac-23be-480f-8ef5-30760ea0e5c4

2017-04-25T04:53:08-04:00 on mcln-ps.maxgigapop.net and enpl-pt2-10g.eos.nasa.gov with iperf3:


throughput --duration PT30S --source mcln-ps.maxgigapop.net --ip-version 4 --dest enpl-pt2-10g.eos.nasa.gov --window-size 1310720 --parallel 1


* Stream ID 4

Interval       Throughput     Retransmits    Current Window 

0.0 - 1.0      9.03 Gbps      0              2.03 MBytes    

1.0 - 2.0      8.87 Gbps      0              2.03 MBytes    

2.0 - 3.0      8.70 Gbps      0              2.03 MBytes    

3.0 - 4.0      8.92 Gbps      0              2.03 MBytes    

4.0 - 5.0      8.81 Gbps      0              2.03 MBytes    

5.0 - 6.0      8.50 Gbps      0              2.03 MBytes    

6.0 - 7.0      8.05 Gbps      0              2.03 MBytes    

7.0 - 8.0      7.79 Gbps      0              2.03 MBytes    

8.0 - 9.0      7.49 Gbps      0              2.03 MBytes    

9.0 - 10.0     8.43 Gbps      0              2.03 MBytes    

10.0 - 11.0    8.64 Gbps      0              2.03 MBytes    

11.0 - 12.0    8.46 Gbps      0              2.03 MBytes    

12.0 - 13.0    8.10 Gbps      0              2.03 MBytes    

13.0 - 14.0    7.80 Gbps      0              2.03 MBytes    

14.0 - 15.0    7.23 Gbps      0              2.03 MBytes    

15.0 - 16.0    7.04 Gbps      0              2.03 MBytes    

16.0 - 17.0    7.10 Gbps      0              2.03 MBytes    

17.0 - 18.0    6.99 Gbps      0              2.03 MBytes    

18.0 - 19.0    7.26 Gbps      0              2.03 MBytes    

19.0 - 20.0    7.32 Gbps      0              2.03 MBytes    

20.0 - 21.0    7.38 Gbps      0              2.03 MBytes    

21.0 - 22.0    7.37 Gbps      0              2.03 MBytes    

22.0 - 23.0    7.29 Gbps      0              2.03 MBytes    

23.0 - 24.0    7.21 Gbps      0              2.03 MBytes    

24.0 - 25.0    7.11 Gbps      0              2.03 MBytes    

25.0 - 26.0    7.07 Gbps      0              2.03 MBytes    

26.0 - 27.0    7.06 Gbps      0              2.03 MBytes    

27.0 - 28.0    6.99 Gbps      0              2.03 MBytes    

28.0 - 29.0    7.07 Gbps      0              2.03 MBytes    

29.0 - 30.0    7.07 Gbps      0              2.03 MBytes    


Summary

Interval       Throughput     Retransmits    

0.0 - 30.0     7.74 Gbps      0


Archivings:


    This task had no archivings.







Archive powered by MHonArc 2.6.19.

Top of Page