perfSONAR User Q&A and Other Discussion

[Murilo Vetter <>]

Hi Andrew,

I tried to debug in one host that is working and I got the following log:

--

2019/04/04 16:13:07 DEBUG pid=94935 prog=perfSONAR_PS::PSConfig::BaseAgent::run line=208 guid=AE08F946-570D-11E9-988B-8A7C666609C1 agent_conf_file=/etc/perfsonar/psconfig/pscheduler-agent.json requesting_agent={"monipe-sc-atraso.rnp.br":{"address":"monipe-sc-atraso.rnp.br"},"200.237.196.20":{"address":"200.237.196.20"},"200.237.196.19":{"address":"200.237.196.19"},"172.17.0.1":{"address":"172.17.0.1"},"monipe-sc-banda.rnp.br":{"address":"monipe-sc-banda.rnp.br"},"monipe-sc-perfsonar":{"address":"monipe-sc-perfsonar"}} msg=Auto-detected requesting agent
2019/04/04 16:13:07 DEBUG pid=94935 prog=perfSONAR_PS::PSConfig::BaseAgent::run line=208 guid=AE08F946-570D-11E9-988B-8A7C666609C1 agent_conf_file=/etc/perfsonar/psconfig/pscheduler-agent.json requesting_agent={"monipe-sc-atraso.rnp.br":{"address":"monipe-sc-atraso.rnp.br"},"200.237.196.20":{"address":"200.237.196.20"},"200.237.196.19":{"address":"200.237.196.19"},"172.17.0.1":{"address":"172.17.0.1"},"monipe-sc-banda.rnp.br":{"address":"monipe-sc-banda.rnp.br"},"monipe-sc-perfsonar":{"address":"monipe-sc-perfsonar"}} msg=Auto-detected requesting agent

--

It is something to name resolution. In this host, it resolve the name of the server.

Do you know what is going on?

Regards,

--

Murilo Vetter
Analista REMEP-FLN/PoP-SC
PoP-SC - Ponto de Presença da RNP em Santa Catarina
REMEP-FLN - Rede Metropolitana de Educação e Pesquisa da Região de Florianópolis
RNP - Rede Nacional de Ensino e Pesquisa
UFSC - Universidade Federal de Santa Catarina
SETIC - Superintendência de Governança Eletrônica e Tecnologia da Informação e Comunicação
Fundações de Apoio FEESC e FEPESE
--/--

www.pop-sc.rnp.br
remep.pop-sc.rnp.br
CHAMADOS:
+55(48)3721-3000
INOC: 11242*100

---

De: "Murilo Vetter" <>
Para: "Andrew Lake" <>
Cc: "Mark Feit" <>, "Ivan Garnizov" <>, "perfsonar-user" <>
Enviadas: Quinta-feira, 4 de abril de 2019 12:30:21
Assunto: Re: [perfsonar-user] Tests are not scheduling on pscheduler

Hi Andrew,

About the docker image of testpoint, I am using the last images.

Now, all start to work as expected, except for 1 host that has the following problem.

I change the debug level to DEBUG of psconfig_pscheduler_anget and start it.

I got the following log messages:

--

[root@monipe-ba-perfsonar bin]# /usr/lib/perfsonar/bin/psconfig_pscheduler_agent --config=/etc/perfsonar/psconfig/pscheduler-agent.json --logger=/etc/perfsonar/psconfig/pscheduler-agent-logger.conf --pidfile=/var/run/psconfig-pscheduler-agent.pid --user=perfsonar --group=perfsonar

==> /var/log/perfsonar/psconfig-pscheduler-agent.log <==
2019/04/04 12:16:59 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::BaseAgent::init line=118 agent_conf_file=/etc/perfsonar/psconfig/pscheduler-agent.json msg=No include directory specified. Defaulting to /etc/perfsonar/psconfig/pscheduler.d
2019/04/04 12:16:59 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::BaseAgent::init line=124 agent_conf_file=/etc/perfsonar/psconfig/pscheduler-agent.json msg=No archives directory specified. Defaulting to /etc/perfsonar/psconfig/archives.d
2019/04/04 12:16:59 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::BaseAgent::init line=130 agent_conf_file=/etc/perfsonar/psconfig/pscheduler-agent.json msg=No transform directory specified. Defaulting to /etc/perfsonar/psconfig/transforms.d
2019/04/04 12:16:59 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::BaseAgent::init line=136 agent_conf_file=/etc/perfsonar/psconfig/pscheduler-agent.json msg=No requesting agent file specified. Defaulting to /etc/perfsonar/psconfig/requesting-agent.json
2019/04/04 12:16:59 INFO pid=6500 prog=main:: line=166 msg=Starting pSConfig pScheduler agent
2019/04/04 12:16:59 INFO pid=6500 prog=main:: line=176 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB msg=Running agent...
2019/04/04 12:16:59 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::BaseAgent::run line=166 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB agent_conf_file=/etc/perfsonar/psconfig/pscheduler-agent.json msg=No pscheduler-assist-server specified. Defaulting to localhost
[root@monipe-ba-perfsonar bin]# 2019/04/04 12:16:59 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::BaseAgent::run line=170 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB agent_conf_file=/etc/perfsonar/psconfig/pscheduler-agent.json msg=pscheduler_url is https://localhost/pscheduler
2019/04/04 12:17:07 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::BaseAgent::run line=208 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB agent_conf_file=/etc/perfsonar/psconfig/pscheduler-agent.json requesting_agent={"200.128.2.20":{"address":"200.128.2.20"},"monipe-ba-perfsonar":{"address":"monipe-ba-perfsonar"},"172.17.0.1":{"address":"172.17.0.1"},"200.128.2.21":{"address":"200.128.2.21"}} msg=Auto-detected requesting agent
2019/04/04 12:17:07 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_start line=63 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB pscheduler_assist_url=https://localhost/pscheduler msg=No client-uuid-file specified. Defaulting to /var/lib/perfsonar/psconfig/client_uuid
2019/04/04 12:17:07 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_start line=69 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB pscheduler_assist_url=https://localhost/pscheduler msg=No pscheduler-tracker-file specified. Defaulting to /var/lib/perfsonar/psconfig/psc_tracker
2019/04/04 12:17:07 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_start line=90 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB pscheduler_assist_url=https://localhost/pscheduler msg=No task-min-runs specified. Defaulting to 2
2019/04/04 12:17:07 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_start line=96 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB pscheduler_assist_url=https://localhost/pscheduler msg=No task-renewal-fudge-factor specified. Defaulting to 0.25
2019/04/04 12:17:15 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_start line=113 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB pscheduler_assist_url=https://localhost/pscheduler match_addresses=["200.128.2.20","monipe-ba-perfsonar","172.17.0.1","200.128.2.21"] msg=Auto-detected match addresses

==> /var/log/perfsonar/psconfig-pscheduler-agent-transactions.log <==
2019/04/04 12:17:15 INFO guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB action="list" url="https://localhost/pscheduler" msg=Getting task list from https://localhost/pscheduler
2019/04/04 12:17:15 DEBUG guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB action="list" url="https://localhost/pscheduler" msg=Trying to get task list without enabled filter

==> /var/log/perfsonar/psconfig-pscheduler-agent.log <==
2019/04/04 12:17:18 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::BaseAgent::_process_psconfig line=374 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB config_url=http://monipe-central.rnp.br:8000/pub/config/matriz?format=psconfig config_src=remote json={"hosts":{"monipe-pa-banda.rnp.br":{},"monipe-rs-atraso.rnp.br":{},"monipe-ce-banda.rnp.br":{},"monipe-pb-banda.rnp.br":{},"monipe-pb-atraso.rnp.br":{},"monipe-df-atraso.rnp.br":{},"monipe-sp-banda.rnp.br":{},"monipe-rs-banda.rnp.br":{},"monipe-pa-atraso.rnp.br":{},"monipe-ro-banda.rnp.br":{},"monipe-pe-banda.rnp.br":{},"monipe-al-banda.rnp.br":{},"monipe-go-atraso.rnp.br":{},"monipe-df-banda.rnp.br":{},"monipe-mg-atraso.rnp.br":{},"monipe-rr-banda.rnp.br":{},"monipe-sc-atraso.rnp.br":{},"monipe-to-banda.rnp.br":{},"monipe-pi-atraso.rnp.br":{},"monipe-ba-atraso.rnp.br":{},"monipe-mg-banda.rnp.br":{},"monipe-rj-atraso.rnp.br":{},"monipe-ce-atraso.rnp.br":{},"monipe-ms-atraso.rnp.br":{},"monipe-rj-banda.rnp.br":{},"monipe-pr-atraso.rnp.br":{},"monipe-am-atraso.rnp.br":{},"monipe-to-atraso.rnp.br":{},"monipe-sc-banda.rnp.br":{},"monipe-ap-atraso.rnp.br":{},"monipe-ap-banda.rnp.br":{},"monipe-es-atraso.rnp.br":{},"monipe-ma-banda.rnp.br":{},"monipe-rn-atraso.rnp.br":{},"monipe-ms-banda.rnp.br":{},"monipe-pi-banda.rnp.br":{},"monipe-se-atraso.rnp.br":{},"monipe-ro-atraso.rnp.br":{},"monipe-rn-banda.rnp.br":{},"monipe-rr-atraso.rnp.br":{},"monipe-sp-atraso.rnp.br":{},"monipe-pr-banda.rnp.br":{},"monipe-mt-atraso.rnp.br":{},"monipe-pe-atraso.rnp.br":{},"monipe-al-atraso.rnp.br":{},"monipe-se-banda.rnp.br":{},"monipe-mt-banda.rnp.br":{},"monipe-ac-atraso.rnp.br":{},"monipe-ac-banda.rnp.br":{},"monipe-ba-banda.rnp.br":{},"monipe-es-banda.rnp.br":{},"monipe-am-banda.rnp.br":{},"monipe-ma-atraso.rnp.br":{},"monipe-go-banda.rnp.br":{}},"tasks":{"BANDA":{"archives":["config-archive0"],"test":"BANDA","group":"BANDA","tools":["bwctliperf3","iperf3"],"_meta":{"display-name":"BANDA"},"schedule":"repeat-PT4H"},"ATRASOBIDIRECIONAL":{"archives":["config-archive0"],"test":"ATRASOBIDIRECIONAL","group":"ATRASOBIDIRECIONAL","_meta":{"display-name":"ATRASOBIDIRECIONAL"},"schedule":"repeat-PT5M"},"TRACEROUTE":{"archives":["config-archive0"],"test":"TRACEROUTE","group":"TRACEROUTE","tools":["bwctltraceroute","traceroute"],"_meta":{"display-name":"TRACEROUTE"},"schedule":"repeat-PT2H"},"ATRASO":{"archives":["config-archive0"],"test":"ATRASO","group":"ATRASO","_meta":{"display-name":"ATRASO"}}},"_meta":{"display-name":"matriz"},"archives":{"config-archive0":{"data":{"measurement-agent":"{% scheduled_by_address %}","url":"http://monipe-central.rnp.br/esmond/perfsonar/archive/"},"archiver":"esmond"}},"addresses":{"monipe-pa-banda.rnp.br":{"_meta":{"display-url":"https://monipe-pa-banda.rnp.br/toolkit/","display-name":"POP-PA"},"address":"monipe-pa-banda.rnp.br","host":"monipe-pa-banda.rnp.br"},"monipe-rs-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-rs-atraso.rnp.br/toolkit/","display-name":"POP-RS"},"address":"monipe-rs-atraso.rnp.br","host":"monipe-rs-atraso.rnp.br"},"monipe-ce-banda.rnp.br":{"_meta":{"display-url":"https://monipe-ce-banda.rnp.br/toolkit/","display-name":"POP-CE"},"address":"monipe-ce-banda.rnp.br","host":"monipe-ce-banda.rnp.br"},"monipe-pb-banda.rnp.br":{"_meta":{"display-url":"https://monipe-pb-banda.rnp.br/toolkit/","display-name":"POP-PB"},"address":"monipe-pb-banda.rnp.br","host":"monipe-pb-banda.rnp.br"},"monipe-pb-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-pb-atraso.rnp.br/toolkit/","display-name":"POP-PB"},"address":"monipe-pb-atraso.rnp.br","host":"monipe-pb-atraso.rnp.br"},"monipe-df-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-df-atraso.rnp.br/toolkit/","display-name":"POP-DF"},"address":"monipe-df-atraso.rnp.br","host":"monipe-df-atraso.rnp.br"},"monipe-sp-banda.rnp.br":{"_meta":{"display-url":"https://monipe-sp-banda.rnp.br/toolkit/","display-name":"POP-SP"},"address":"monipe-sp-banda.rnp.br","host":"monipe-sp-banda.rnp.br"},"monipe-rs-banda.rnp.br":{"_meta":{"display-url":"https://monipe-rs-banda.rnp.br/toolkit/","display-name":"POP-RS"},"address":"monipe-rs-banda.rnp.br","host":"monipe-rs-banda.rnp.br"},"monipe-pa-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-pa-atraso.rnp.br/toolkit/","display-name":"POP-PA"},"address":"monipe-pa-atraso.rnp.br","host":"monipe-pa-atraso.rnp.br"},"monipe-ro-banda.rnp.br":{"_meta":{"display-url":"https://monipe-ro-banda.rnp.br/toolkit/","display-name":"POP-RO"},"address":"monipe-ro-banda.rnp.br","host":"monipe-ro-banda.rnp.br"},"monipe-pe-banda.rnp.br":{"_meta":{"display-url":"https://monipe-pe-banda.rnp.br/toolkit/","display-name":"POP-PE"},"address":"monipe-pe-banda.rnp.br","host":"monipe-pe-banda.rnp.br"},"monipe-al-banda.rnp.br":{"_meta":{"display-url":"https://monipe-al-banda.rnp.br/toolkit/","display-name":"POP-AL"},"address":"monipe-al-banda.rnp.br","host":"monipe-al-banda.rnp.br"},"monipe-go-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-go-atraso.rnp.br/toolkit/","display-name":"POP-GO"},"address":"monipe-go-atraso.rnp.br","host":"monipe-go-atraso.rnp.br"},"monipe-df-banda.rnp.br":{"_meta":{"display-url":"https://monipe-df-banda.rnp.br/toolkit/","display-name":"POP-DF"},"address":"monipe-df-banda.rnp.br","host":"monipe-df-banda.rnp.br"},"monipe-mg-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-mg-atraso.rnp.br/toolkit/","display-name":"POP-MG"},"address":"monipe-mg-atraso.rnp.br","host":"monipe-mg-atraso.rnp.br"},"monipe-rr-banda.rnp.br":{"_meta":{"display-url":"https://monipe-rr-banda.rnp.br/toolkit/","display-name":"POP-RR"},"address":"monipe-rr-banda.rnp.br","host":"monipe-rr-banda.rnp.br"},"monipe-sc-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-sc-atraso.rnp.br/toolkit/","display-name":"POP-SC"},"address":"monipe-sc-atraso.rnp.br","host":"monipe-sc-atraso.rnp.br"},"monipe-to-banda.rnp.br":{"_meta":{"display-url":"https://monipe-to-banda.rnp.br/toolkit/","display-name":"POP-TO"},"address":"monipe-to-banda.rnp.br","host":"monipe-to-banda.rnp.br"},"monipe-pi-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-pi-atraso.rnp.br/toolkit/","display-name":"POP-PI"},"address":"monipe-pi-atraso.rnp.br","host":"monipe-pi-atraso.rnp.br"},"monipe-ba-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-ba-atraso.rnp.br/toolkit/","display-name":"POP-BA"},"address":"monipe-ba-atraso.rnp.br","host":"monipe-ba-atraso.rnp.br"},"monipe-mg-banda.rnp.br":{"_meta":{"display-url":"https://monipe-mg-banda.rnp.br/toolkit/","display-name":"POP-MG"},"address":"monipe-mg-banda.rnp.br","host":"monipe-mg-banda.rnp.br"},"monipe-rj-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-rj-atraso.rnp.br/toolkit/","display-name":"POP-RJ"},"address":"monipe-rj-atraso.rnp.br","host":"monipe-rj-atraso.rnp.br"},"monipe-ce-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-ce-atraso.rnp.br/toolkit/","display-name":"POP-CE"},"address":"monipe-ce-atraso.rnp.br","host":"monipe-ce-atraso.rnp.br"},"monipe-ms-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-ms-atraso.rnp.br/toolkit/","display-name":"POP-MS"},"address":"monipe-ms-atraso.rnp.br","host":"monipe-ms-atraso.rnp.br"},"monipe-rj-banda.rnp.br":{"_meta":{"display-url":"https://monipe-rj-banda.rnp.br/toolkit/","display-name":"POP-RJ"},"address":"monipe-rj-banda.rnp.br","host":"monipe-rj-banda.rnp.br"},"monipe-pr-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-pr-atraso.rnp.br/toolkit/","display-name":"POP-PR"},"address":"monipe-pr-atraso.rnp.br","host":"monipe-pr-atraso.rnp.br"},"monipe-am-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-am-atraso.rnp.br/toolkit/","display-name":"POP-AM"},"address":"monipe-am-atraso.rnp.br","host":"monipe-am-atraso.rnp.br"},"monipe-to-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-to-atraso.rnp.br/toolkit/","display-name":"POP-TO"},"address":"monipe-to-atraso.rnp.br","host":"monipe-to-atraso.rnp.br"},"monipe-sc-banda.rnp.br":{"_meta":{"display-url":"https://monipe-sc-banda.rnp.br/toolkit/","display-name":"POP-SC"},"address":"monipe-sc-banda.rnp.br","host":"monipe-sc-banda.rnp.br"},"monipe-ap-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-ap-atraso.rnp.br/toolkit/","display-name":"POP-AP"},"address":"monipe-ap-atraso.rnp.br","host":"monipe-ap-atraso.rnp.br"},"monipe-ap-banda.rnp.br":{"_meta":{"display-url":"https://monipe-ap-banda.rnp.br/toolkit/","display-name":"POP-AP"},"address":"monipe-ap-banda.rnp.br","host":"monipe-ap-banda.rnp.br"},"monipe-es-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-es-atraso.rnp.br/toolkit/","display-name":"POP-ES"},"address":"monipe-es-atraso.rnp.br","host":"monipe-es-atraso.rnp.br"},"monipe-ma-banda.rnp.br":{"_meta":{"display-url":"https://monipe-ma-banda.rnp.br/toolkit/","display-name":"POP-MA"},"address":"monipe-ma-banda.rnp.br","host":"monipe-ma-banda.rnp.br"},"monipe-rn-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-rn-atraso.rnp.br/toolkit/","display-name":"POP-RN"},"address":"monipe-rn-atraso.rnp.br","host":"monipe-rn-atraso.rnp.br"},"monipe-ms-banda.rnp.br":{"_meta":{"display-url":"https://monipe-ms-banda.rnp.br/toolkit/","display-name":"POP-MS"},"address":"monipe-ms-banda.rnp.br","host":"monipe-ms-banda.rnp.br"},"monipe-pi-banda.rnp.br":{"_meta":{"display-url":"https://monipe-pi-banda.rnp.br/toolkit/","display-name":"POP-PI"},"address":"monipe-pi-banda.rnp.br","host":"monipe-pi-banda.rnp.br"},"monipe-se-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-se-atraso.rnp.br/toolkit/","display-name":"POP-SE"},"address":"monipe-se-atraso.rnp.br","host":"monipe-se-atraso.rnp.br"},"monipe-ro-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-ro-atraso.rnp.br/toolkit/","display-name":"POP-RO"},"address":"monipe-ro-atraso.rnp.br","host":"monipe-ro-atraso.rnp.br"},"monipe-rn-banda.rnp.br":{"_meta":{"display-url":"https://monipe-rn-banda.rnp.br/toolkit/","display-name":"POP-RN"},"address":"monipe-rn-banda.rnp.br","host":"monipe-rn-banda.rnp.br"},"monipe-rr-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-rr-atraso.rnp.br/toolkit/","display-name":"POP-RR"},"address":"monipe-rr-atraso.rnp.br","host":"monipe-rr-atraso.rnp.br"},"monipe-sp-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-sp-atraso.rnp.br/toolkit/","display-name":"POP-SP"},"address":"monipe-sp-atraso.rnp.br","host":"monipe-sp-atraso.rnp.br"},"monipe-pr-banda.rnp.br":{"_meta":{"display-url":"https://monipe-pr-banda.rnp.br/toolkit/","display-name":"POP-PR"},"address":"monipe-pr-banda.rnp.br","host":"monipe-pr-banda.rnp.br"},"monipe-mt-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-mt-atraso.rnp.br/toolkit/","display-name":"POP-MT"},"address":"monipe-mt-atraso.rnp.br","host":"monipe-mt-atraso.rnp.br"},"monipe-pe-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-pe-atraso.rnp.br/toolkit/","display-name":"POP-PE"},"address":"monipe-pe-atraso.rnp.br","host":"monipe-pe-atraso.rnp.br"},"monipe-al-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-al-atraso.rnp.br/toolkit/","display-name":"POP-AL"},"address":"monipe-al-atraso.rnp.br","host":"monipe-al-atraso.rnp.br"},"monipe-se-banda.rnp.br":{"_meta":{"display-url":"https://monipe-se-banda.rnp.br/toolkit/","display-name":"POP-SE"},"address":"monipe-se-banda.rnp.br","host":"monipe-se-banda.rnp.br"},"monipe-mt-banda.rnp.br":{"_meta":{"display-url":"https://monipe-mt-banda.rnp.br/toolkit/","display-name":"POP-MT"},"address":"monipe-mt-banda.rnp.br","host":"monipe-mt-banda.rnp.br"},"monipe-ac-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-ac-atraso.rnp.br/toolkit/","display-name":"POP-AC"},"address":"monipe-ac-atraso.rnp.br","host":"monipe-ac-atraso.rnp.br"},"monipe-ac-banda.rnp.br":{"_meta":{"display-url":"https://monipe-ac-banda.rnp.br/toolkit/","display-name":"POP-AC"},"address":"monipe-ac-banda.rnp.br","host":"monipe-ac-banda.rnp.br"},"monipe-ba-banda.rnp.br":{"_meta":{"display-url":"https://monipe-ba-banda.rnp.br/toolkit/","display-name":"POP-BA"},"address":"monipe-ba-banda.rnp.br","host":"monipe-ba-banda.rnp.br"},"monipe-es-banda.rnp.br":{"_meta":{"display-url":"https://monipe-es-banda.rnp.br/toolkit/","display-name":"POP-ES"},"address":"monipe-es-banda.rnp.br","host":"monipe-es-banda.rnp.br"},"monipe-am-banda.rnp.br":{"_meta":{"display-url":"https://monipe-am-banda.rnp.br/toolkit/","display-name":"POP-AM"},"address":"monipe-am-banda.rnp.br","host":"monipe-am-banda.rnp.br"},"monipe-ma-atraso.rnp.br":{"_meta":{"display-url":"https://monipe-ma-atraso.rnp.br/toolkit/","display-name":"POP-MA"},"address":"monipe-ma-atraso.rnp.br","host":"monipe-ma-atraso.rnp.br"},"monipe-go-banda.rnp.br":{"_meta":{"display-url":"https://monipe-go-banda.rnp.br/toolkit/","display-name":"POP-GO"},"address":"monipe-go-banda.rnp.br","host":"monipe-go-banda.rnp.br"}},"tests":{"BANDA":{"spec":{"source":"{% address[0] %}","dest":"{% address[1] %}","duration":"PT20S","omit-interval":5,"ip-version":4},"type":"throughput"},"ATRASOBIDIRECIONAL":{"spec":{"source":"{% address[0] %}","count":10,"dest":"{% address[1] %}","ip-version":4},"type":"rtt"},"TRACEROUTE":{"spec":{"packet-size":1200,"source":"{% address[0] %}","dest":"{% address[1] %}","wait":"PT1M","ip-version":4,"first-ttl":1},"type":"trace"},"ATRASO":{"spec":{"bucket-width":0.001,"source":"{% address[0] %}","dest":"{% address[1] %}","packet-count":600,"packet-interval":0.1,"ip-version":4},"type":"latencybg"}},"groups":{"BANDA":{"addresses":[{"name":"monipe-pr-banda.rnp.br"},{"name":"monipe-es-banda.rnp.br"},{"name":"monipe-al-banda.rnp.br"},{"name":"monipe-pb-banda.rnp.br"},{"name":"monipe-se-banda.rnp.br"},{"name":"monipe-rs-banda.rnp.br"},{"name":"monipe-ac-banda.rnp.br"},{"name":"monipe-ap-banda.rnp.br"},{"name":"monipe-am-banda.rnp.br"},{"name":"monipe-ba-banda.rnp.br"},{"name":"monipe-ce-banda.rnp.br"},{"name":"monipe-df-banda.rnp.br"},{"name":"monipe-go-banda.rnp.br"},{"name":"monipe-ma-banda.rnp.br"},{"name":"monipe-mt-banda.rnp.br"},{"name":"monipe-ms-banda.rnp.br"},{"name":"monipe-mg-banda.rnp.br"},{"name":"monipe-pa-banda.rnp.br"},{"name":"monipe-pe-banda.rnp.br"},{"name":"monipe-pi-banda.rnp.br"},{"name":"monipe-rj-banda.rnp.br"},{"name":"monipe-rn-banda.rnp.br"},{"name":"monipe-ro-banda.rnp.br"},{"name":"monipe-rr-banda.rnp.br"},{"name":"monipe-sc-banda.rnp.br"},{"name":"monipe-sp-banda.rnp.br"},{"name":"monipe-to-banda.rnp.br"}],"type":"mesh"},"ATRASOBIDIRECIONAL":{"addresses":[{"name":"monipe-rs-atraso.rnp.br"},{"name":"monipe-sp-atraso.rnp.br"},{"name":"monipe-ms-atraso.rnp.br"},{"name":"monipe-es-atraso.rnp.br"},{"name":"monipe-df-atraso.rnp.br"},{"name":"monipe-rj-atraso.rnp.br"},{"name":"monipe-mt-atraso.rnp.br"},{"name":"monipe-to-atraso.rnp.br"},{"name":"monipe-ac-atraso.rnp.br"},{"name":"monipe-al-atraso.rnp.br"},{"name":"monipe-ap-atraso.rnp.br"},{"name":"monipe-am-atraso.rnp.br"},{"name":"monipe-ba-atraso.rnp.br"},{"name":"monipe-ce-atraso.rnp.br"},{"name":"monipe-ma-atraso.rnp.br"},{"name":"monipe-mg-atraso.rnp.br"},{"name":"monipe-pa-atraso.rnp.br"},{"name":"monipe-pb-atraso.rnp.br"},{"name":"monipe-pe-atraso.rnp.br"},{"name":"monipe-ro-atraso.rnp.br"},{"name":"monipe-go-atraso.rnp.br"},{"name":"monipe-pi-atraso.rnp.br"},{"name":"monipe-rr-atraso.rnp.br"},{"name":"monipe-se-atraso.rnp.br"},{"name":"monipe-sc-atraso.rnp.br"},{"name":"monipe-rn-atraso.rnp.br"},{"name":"monipe-pr-atraso.rnp.br"}],"type":"mesh"},"TRACEROUTE":{"addresses":[{"name":"monipe-rs-atraso.rnp.br"},{"name":"monipe-sp-atraso.rnp.br"},{"name":"monipe-ms-atraso.rnp.br"},{"name":"monipe-es-atraso.rnp.br"},{"name":"monipe-df-atraso.rnp.br"},{"name":"monipe-rj-atraso.rnp.br"},{"name":"monipe-mt-atraso.rnp.br"},{"name":"monipe-to-atraso.rnp.br"},{"name":"monipe-ac-atraso.rnp.br"},{"name":"monipe-al-atraso.rnp.br"},{"name":"monipe-ap-atraso.rnp.br"},{"name":"monipe-am-atraso.rnp.br"},{"name":"monipe-ba-atraso.rnp.br"},{"name":"monipe-ce-atraso.rnp.br"},{"name":"monipe-ma-atraso.rnp.br"},{"name":"monipe-mg-atraso.rnp.br"},{"name":"monipe-pa-atraso.rnp.br"},{"name":"monipe-pb-atraso.rnp.br"},{"name":"monipe-pe-atraso.rnp.br"},{"name":"monipe-ro-atraso.rnp.br"},{"name":"monipe-go-atraso.rnp.br"},{"name":"monipe-pi-atraso.rnp.br"},{"name":"monipe-rr-atraso.rnp.br"},{"name":"monipe-se-atraso.rnp.br"},{"name":"monipe-sc-atraso.rnp.br"},{"name":"monipe-rn-atraso.rnp.br"},{"name":"monipe-pr-atraso.rnp.br"}],"type":"mesh"},"ATRASO":{"addresses":[{"name":"monipe-rs-atraso.rnp.br"},{"name":"monipe-sp-atraso.rnp.br"},{"name":"monipe-ms-atraso.rnp.br"},{"name":"monipe-es-atraso.rnp.br"},{"name":"monipe-df-atraso.rnp.br"},{"name":"monipe-rj-atraso.rnp.br"},{"name":"monipe-mt-atraso.rnp.br"},{"name":"monipe-to-atraso.rnp.br"},{"name":"monipe-ac-atraso.rnp.br"},{"name":"monipe-al-atraso.rnp.br"},{"name":"monipe-ap-atraso.rnp.br"},{"name":"monipe-am-atraso.rnp.br"},{"name":"monipe-ba-atraso.rnp.br"},{"name":"monipe-ce-atraso.rnp.br"},{"name":"monipe-ma-atraso.rnp.br"},{"name":"monipe-mg-atraso.rnp.br"},{"name":"monipe-pa-atraso.rnp.br"},{"name":"monipe-pb-atraso.rnp.br"},{"name":"monipe-pe-atraso.rnp.br"},{"name":"monipe-ro-atraso.rnp.br"},{"name":"monipe-go-atraso.rnp.br"},{"name":"monipe-pi-atraso.rnp.br"},{"name":"monipe-rr-atraso.rnp.br"},{"name":"monipe-se-atraso.rnp.br"},{"name":"monipe-sc-atraso.rnp.br"},{"name":"monipe-rn-atraso.rnp.br"},{"name":"monipe-pr-atraso.rnp.br"}],"type":"mesh"}},"schedules":{"repeat-PT5M":{"sliprand":true,"repeat":"PT5M"},"repeat-PT2H":{"sliprand":true,"slip":"PT1H","repeat":"PT2H"},"repeat-PT4H":{"sliprand":true,"slip":"PT24M","repeat":"PT4H"}}} msg=Loaded pSConfig JSON
2019/04/04 12:17:19 DEBUG pid=6500 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_handle_psconfig line=204 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB task_name=ATRASO config_url=http://monipe-central.rnp.br:8000/pub/config/matriz?format=psconfig config_src=remote msg=Successfully processed task.

==> /var/log/perfsonar/psconfig-pscheduler-agent-transactions.log <==
2019/04/04 12:17:19 INFO guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB action="delete" msg=Deleting tasks
2019/04/04 12:17:19 INFO guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB action="delete" msg=No tasks marked for deletion
2019/04/04 12:17:19 INFO guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB action="delete" msg=Done deleting tasks
2019/04/04 12:17:19 INFO guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB action="create" msg=Creating tasks
2019/04/04 12:17:19 INFO guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB action="create" msg=No tasks to create
2019/04/04 12:17:19 INFO guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB action="create" msg=Done creating tasks

==> /var/log/perfsonar/psconfig-pscheduler-agent.log <==
2019/04/04 12:17:19 INFO pid=6500 prog=main:: line=178 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB msg=Agent completed running
2019/04/04 12:17:19 INFO pid=6500 prog=main:: line=189 guid=B0E0F572-56EC-11E9-B460-F85CB5DE74DB msg=Time until next record refresh is 3580 seconds
--

I was expecting to match with my host (monipe-ba-atraso.rnp.br / monipe-ba-banda.rnp.br), since from the container point of view it is resolving:

--

[root@monipe-ba-perfsonar bin]# hostname -A
monipe-ba-atraso.rnp.br monipe-ba-banda.rnp.br monipe-ba-perfsonar

--

Following are the IP addresses:

--

[root@monipe-ba-perfsonar bin]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: ens160: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 00:0a:f7:7d:79:de brd ff:ff:ff:ff:ff:ff
    inet 200.128.2.21/27 brd 200.128.2.31 scope global noprefixroute ens160
       valid_lft forever preferred_lft forever
    inet6 fe80::5b12:bed7:a23a:ba89/64 scope link noprefixroute
       valid_lft forever preferred_lft forever
3: ens192: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 00:0a:f7:7d:79:df brd ff:ff:ff:ff:ff:ff
    inet 200.128.2.20/27 brd 200.128.2.31 scope global noprefixroute ens192
       valid_lft forever preferred_lft forever
    inet6 fe80::d863:982:4499:f51b/64 scope link noprefixroute
       valid_lft forever preferred_lft forever
4: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default
    link/ether 02:42:85:16:47:69 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
       valid_lft forever preferred_lft forever

--

Any clue?

Regards,

--

Murilo Vetter
Analista REMEP-FLN/PoP-SC
PoP-SC - Ponto de Presença da RNP em Santa Catarina
REMEP-FLN - Rede Metropolitana de Educação e Pesquisa da Região de Florianópolis
RNP - Rede Nacional de Ensino e Pesquisa
UFSC - Universidade Federal de Santa Catarina
SETIC - Superintendência de Governança Eletrônica e Tecnologia da Informação e Comunicação
Fundações de Apoio FEESC e FEPESE
--/--

www.pop-sc.rnp.br
remep.pop-sc.rnp.br
CHAMADOS:
+55(48)3721-3000
INOC: 11242*100

---

De: "Andrew Lake" <>
Para: "Murilo Vetter" <>
Cc: "Mark Feit" <>, "Ivan Garnizov" <>, "perfsonar-user" <>
Enviadas: Quarta-feira, 3 de abril de 2019 23:59:02
Assunto: Re: [perfsonar-user] Tests are not scheduling on pscheduler

Hi Murilo,

Based on your logs it looks like it complaining it can’t find the archive specified in your tasks...though when I look at your template it is there. I made a copy of your template, tweaked an address to be my localhost and tried using your template in the latest perfsonar-testpoint container and it worked fine. I am having trouble understanding why it wouldn’t work for you too. Are you running the “perfsonar/testpoint:latest” image from docker hub or are you by chance using one of our other tags for a specific version? “docker ps” should show you.

Thanks,

Andy

On April 3, 2019 at 2:31:05 PM, Murilo Vetter () wrote:

Hi Andrew,

Now I changed the configuration of my perfsonar hosts and I am having the following:

REMOTE PS CONFIG HOST:

--

[root@monipe-sc-perfsonar /]# psconfig remote list
=== pScheduler Agent ===
[
   {
      "url" : "http://monipe-central.rnp.br:8000/pub/config/matriz?format=psconfig",
      "configure-archives" : true
   }
]

--

LOGS:

--

[root@monipe-sc-perfsonar /]# tail -f /var/log/perfsonar/psconfig-pscheduler-*
==> /var/log/perfsonar/psconfig-pscheduler-agent-tasks.log <==

==> /var/log/perfsonar/psconfig-pscheduler-agent-transactions.log <==
2019/04/03 15:16:00 INFO guid=8474DB58-563C-11E9-BEE2-83364A7EE038 action="create" msg=Creating tasks
2019/04/03 15:16:00 INFO guid=8474DB58-563C-11E9-BEE2-83364A7EE038 action="create" msg=No tasks to create
2019/04/03 15:16:00 INFO guid=8474DB58-563C-11E9-BEE2-83364A7EE038 action="create" msg=Done creating tasks
2019/04/03 15:20:00 INFO guid=17CD80A8-563D-11E9-96CC-6C374A7EE038 action="list" url="https://localhost/pscheduler msg=Getting task list from https://localhost/pscheduler
2019/04/03 15:20:02 INFO guid=17CD80A8-563D-11E9-96CC-6C374A7EE038 action="delete" msg=Deleting tasks
2019/04/03 15:20:02 INFO guid=17CD80A8-563D-11E9-96CC-6C374A7EE038 action="delete" msg=No tasks marked for deletion
2019/04/03 15:20:02 INFO guid=17CD80A8-563D-11E9-96CC-6C374A7EE038 action="delete" msg=Done deleting tasks
2019/04/03 15:20:02 INFO guid=17CD80A8-563D-11E9-96CC-6C374A7EE038 action="create" msg=Creating tasks
2019/04/03 15:20:02 INFO guid=17CD80A8-563D-11E9-96CC-6C374A7EE038 action="create" msg=No tasks to create
2019/04/03 15:20:02 INFO guid=17CD80A8-563D-11E9-96CC-6C374A7EE038 action="create" msg=Done creating tasks

==> /var/log/perfsonar/psconfig-pscheduler-agent.log <==
2019/04/03 15:20:02 ERROR pid=233 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_handle_psconfig line=188 task=ATRASO,addresses=monipe-sc-atraso.rnp.br->monipe-pe-atraso.rnp.br,error=Unable to find archive defined in task: config-archive0
2019/04/03 15:20:02 ERROR pid=233 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_handle_psconfig line=188 task=ATRASO,addresses=monipe-sc-atraso.rnp.br->monipe-ro-atraso.rnp.br,error=Unable to find archive defined in task: config-archive0
2019/04/03 15:20:02 ERROR pid=233 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_handle_psconfig line=188 task=ATRASO,addresses=monipe-sc-atraso.rnp.br->monipe-go-atraso.rnp.br,error=Unable to find archive defined in task: config-archive0
2019/04/03 15:20:02 ERROR pid=233 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_handle_psconfig line=188 task=ATRASO,addresses=monipe-sc-atraso.rnp.br->monipe-pi-atraso.rnp.br,error=Unable to find archive defined in task: config-archive0
2019/04/03 15:20:02 ERROR pid=233 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_handle_psconfig line=188 task=ATRASO,addresses=monipe-sc-atraso.rnp.br->monipe-rr-atraso.rnp.br,error=Unable to find archive defined in task: config-archive0
2019/04/03 15:20:02 ERROR pid=233 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_handle_psconfig line=188 task=ATRASO,addresses=monipe-sc-atraso.rnp.br->monipe-se-atraso.rnp.br,error=Unable to find archive defined in task: config-archive0
2019/04/03 15:20:02 ERROR pid=233 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_handle_psconfig line=188 task=ATRASO,addresses=monipe-sc-atraso.rnp.br->monipe-rn-atraso.rnp.br,error=Unable to find archive defined in task: config-archive0
2019/04/03 15:20:02 ERROR pid=233 prog=perfSONAR_PS::PSConfig::PScheduler::Agent::_run_handle_psconfig line=188 task=ATRASO,addresses=monipe-sc-atraso.rnp.br->monipe-pr-atraso.rnp.br,error=Unable to find archive defined in task: config-archive0
2019/04/03 15:20:02 INFO pid=233 prog=main:: line=178 guid=17CD80A8-563D-11E9-96CC-6C374A7EE038 msg=Agent completed running
2019/04/03 15:20:02 INFO pid=233 prog=main:: line=189 guid=17CD80A8-563D-11E9-96CC-6C374A7EE038 msg=Time until next record refresh is 3598 seconds

==> /var/log/perfsonar/psconfig-pscheduler-migrate.log <==

/etc/perfsonar/meshconfig-agent.conf does not exist, so nothing to translate. That probably means this is a new install or has the host already been upgraded.

/etc/perfsonar/meshconfig-agent-tasks.conf does not exist, so nothing to translate. That probably means this is a new install or has the host already been upgraded.

/var/lib/perfsonar/meshconfig/client_uuid does not exist, nothing to migrate

/var/lib/perfsonar/meshconfig/psc_tracker does not exist, nothing to migrate

[Mon Oct 29 15:07:31 UTC 2018] Migration complete
--

Now every hosts are showing these problems. Any help?

Regards,

--

Murilo Vetter
Analista REMEP-FLN/PoP-SC
PoP-SC - Ponto de Presença da RNP em Santa Catarina
REMEP-FLN - Rede Metropolitana de Educação e Pesquisa da Região de Florianópolis
RNP - Rede Nacional de Ensino e Pesquisa
UFSC - Universidade Federal de Santa Catarina
SETIC - Superintendência de Governança Eletrônica e Tecnologia da Informação e Comunicação
Fundações de Apoio FEESC e FEPESE
--/--

www.pop-sc.rnp.br
remep.pop-sc.rnp.br
CHAMADOS:
+55(48)3721-3000
INOC: 11242*100

---

De: "Andrew Lake" <>
Para: "Ivan Garnizov" <>, "Murilo Vetter" <>
Cc: "perfsonar-user" <>, "Mark Feit" <>
Enviadas: Quarta-feira, 3 de abril de 2019 12:10:55
Assunto: Re: [perfsonar-user] Tests are not scheduling on pscheduler

Hi Murilio,

Let me try to summarize the steps you have run and what should happen so you can correct me if I missed anything and then we can delve into how to figure out what is going wrong:

1. You bring up a new perfsolnar-testpoint container

2. Inside the testpoint container you run “psconfig remote add --configure-archives http://monipe-central.rnp.br:8000/pub/config/matriz”

3. Within 60 seconds the psconfig agent should pickup the new URL and start looking for tasks (i.e. no service restart needed)

4. It starts creating tasks.

It looks like at either steps 3 or 4 things are tripping-up. The most common cause for the type of behavior you are seeing is that the container has an IP address that does not map to anything in your remote JSON file. Specifically, if you were to do a DNS lookup any of the hostnames in the “addresses” section of your remote JSON, does it map to an IP address you see when you run “ifconfig” inside the container? If the answer is no, that is likely the issue and you need some additional configuration (that I can help you with if this is indeed the case).

If the hostnames do map to an IP address inside the container, then there are a couple things you can check. For one, it looks like you are using the pSConfig Web administrator, which still defaults to the old MeshConfig JSON format for backward compatibility reasons. You can get the newer format directly by running the following:

psconfig remote delete http://monipe-central.rnp.br:8000/pub/config/matriz

psconfig remote add --configure-archives "http://monipe-central.rnp.br:8000/pub/config/matriz?format=psconfig"

This might fix things if you are running into some type of translation error. If not, it will take a translation error out of the equation at least. 

If that still does not fix things you can turn on debugging in the logs by replacing INFO with DEBUG in /etc/perfsonar/psconfig/pscheduler-agent-logger.conf. We can go from there. In particular I’d be interested if we see any messages in the logs indicating it even tried to download the JSON file if it it turns out none of the above helps. 

Hope that helps get you further along.

Thanks,

Andy

On April 3, 2019 at 8:59:35 AM, Murilo Vetter () wrote:

 the system operates without the knowledge of the mesh configuration, which is added during the operation of the pS container….

 

In your case, I would suggest to prepare the psconfig configuration for  the meshes with the building of the container. Thus when started with the container psconfig will automatically parse it and configure pscheduler.

 

There might be other mean to restart a service without the use of the ‘systemctl’ command. Of course I can’t recommend that, but I guess in your case, there is nothing to loose.

--
To unsubscribe from this list: https://lists.internet2.edu/sympa/signoff/perfsonar-user