perfSONAR User Q&A and Other Discussion

["Garnizov, Ivan" <>]

Hello Kate,

 

Please specify fully the test specification of the task. You are missing the –source param.

From the output appears pscheduler is trying to reach the remote test participant through your internal localhost interface.

 

Regards,

Ivan Garnizov

 

GEANT SA1T2: pS deployments GN Operations

GEANT SA2T3: pS development team

GEANT SA3T5: eduPERT team

 

Jubiläumsjahr 2018 - IT in Bewegung

Das RRZE - der IT-Dienstleister der FAU

www.50-jahre.rrze.fau.de

 

Von: Kate Adams [mailto:]
Gesendet: Freitag, 12. Oktober 2018 17:06
An: Garnizov, Ivan (RRZE) <>
Cc:
Betreff: Re: [perfsonar-user] Runs missed

 

pscheduler task --debug trace --dest ps-ksu-bw.personar.kanren.net

 

Results in a run being missed, as returned on the command line.  The log files have this to say:

 

Oct 12 09:33:46 speedy journal: task DEBUG    Posted https://localhost/pscheduler/tasks/611e97bc-21d9-4508-863d-41a26b16737d

Oct 12 09:33:46 speedy journal: task DEBUG    Submission diagnostics:

Oct 12 09:33:46 speedy journal: task DEBUG      Hints:

Oct 12 09:33:46 speedy journal: task DEBUG        requester: ::1

Oct 12 09:33:46 speedy journal: task DEBUG        server: ::1

Oct 12 09:33:46 speedy journal: task DEBUG      Identified as everybody, local-interfaces

Oct 12 09:33:46 speedy journal: task DEBUG      Classified as default, friendlies

Oct 12 09:33:46 speedy journal: task DEBUG      Application: Hosts we trust to do everything

Oct 12 09:33:46 speedy journal: task DEBUG        Group 1: Limit 'always' passed

Oct 12 09:33:46 speedy journal: task DEBUG        Group 1: Want all, 1/1 passed, 0/1 failed: PASS

Oct 12 09:33:46 speedy journal: task DEBUG        Application PASSES

Oct 12 09:33:46 speedy journal: task DEBUG      Application: Defaults applied to non-friendly hosts

Oct 12 09:33:46 speedy journal: task DEBUG        Group 1: Limit 'innocuous-tests' passed

Oct 12 09:33:46 speedy journal: task DEBUG        Group 1: Limit 'throughput-default-tcp' failed: Test is not 'throughput'

Oct 12 09:33:46 speedy journal: task DEBUG        Group 1: Limit 'throughput-default-udp' failed: Test is not 'throughput'

Oct 12 09:33:46 speedy journal: task DEBUG        Group 1: Limit 'idleex-default' failed: Test is not 'idleex'

Oct 12 09:33:46 speedy journal: task DEBUG        Group 1: Want any, 1/4 passed, 3/4 failed: PASS

Oct 12 09:33:46 speedy journal: task DEBUG        Application PASSES

Oct 12 09:33:46 speedy journal: task DEBUG      Proposal meets limits

Oct 12 09:33:46 speedy journal: task DEBUG    Fetching https://localhost/pscheduler/tasks/611e97bc-21d9-4508-863d-41a26b16737d/runs/first

...skipping...

Oct 12 09:35:46 speedy journal: task DEBUG    Handing off: pscheduler watch --format text/plain --debug https://localhost/pscheduler/tasks/611e97bc-21d9-4508-863d-41a26b16737d

Oct 12 09:35:47 speedy journal: watch DEBUG    Fetching https://localhost/pscheduler/tasks/611e97bc-21d9-4508-863d-41a26b16737d

 

 

 

 

On Fri, Oct 12, 2018 at 5:46 AM Garnizov, Ivan <> wrote:

Hello Kate,

 

These are 2 different cases on the pscheduler operation.

Failed to schedule means: It did not find a free slot in the schedule on the localhost. Presumably this host is engaged with other tasks as well.

A missed run means it was scheduled, but then there had been a leap of time or something kept busy pscheduler, which led to the moment when the test should have been started is missed.

 

The logs you are looking in for events are incorrect. There is only one place for logs from pscheduler operation: /var/log/pscheduler/pscheduler.log

 

The above explanations about the possible failures in operation of pscheduler though should not apply for trace tasks.

 

Please provide the whole command and related events from the pscheduler log.

 

 

 

Regards,

Ivan Garnizov

 

GEANT SA1T2: pS deployments GN Operations

GEANT SA2T3: pS development team

GEANT SA3T5: eduPERT team

 

Jubiläumsjahr 2018 - IT in Bewegung

Das RRZE - der IT-Dienstleister der FAU

www.50-jahre.rrze.fau.de

 

Von: [mailto:] Im Auftrag von Kate Adams
Gesendet: Donnerstag, 11. Oktober 2018 21:22
An:
Betreff: [perfsonar-user] Runs missed

 

Hello All,

 

In troubleshooting the maddash, I ran a traceroute manually.  The first time, the run failed to schedule.  The second time, it was missed.

 

Task URL:

https://localhost/pscheduler/tasks/71e37423-aa34-4b4e-af80-e387feab3443

Running with tool 'traceroute'

Fetching first run...

 

Next scheduled run:

https://localhost/pscheduler/tasks/71e37423-aa34-4b4e-af80-e387feab3443/runs/b03787cc-835e-4b17-aea6-3071a883f9d9

Starts 2018-10-11T10:43:24-05:00 (~0 seconds)

Ends   2018-10-11T10:43:32-05:00 (~0 seconds)

Waiting for result...

Run did not complete: Missed

No further runs scheduled.

 

There was no information in these log files about that run.  Where are the errors/reasons it didn't run logged?  

psconfig-pscheduler-agent-transactions.log

psconfig-pscheduler-agent.log

psconfig-pscheduler-agent-tasks.log

 

--

Kate Adams ()

Cyberinfrastructure Technologist

Great Plains Network

 

--

Kate Adams ()

Cyberinfrastructure Technologist

Great Plains Network