perfSONAR User Q&A and Other Discussion

[Szymon Trocha <>]

Hi Phil,

W dniu 05.09.2024 o 19:59, Phil Reese pisze:

Hi again,

I'm having a heck of a time getting an Archive host to show data. I've tried the archive host on VMs and bare metal systems.  Systems with as little at 10g and as much as 32g.  All versions end up with logs looking like the following.  Sorry for the length, just trying to provide as much info as might be needed.

Previously built Testpoint and Archive hosts continue to work without issue.

Phil

----
Testpoint hosts:

There are three Testpoint hosts.  All complete the 'pscheduler troubleshoot' test successfully.  They are also able to 'curl -k https://...'   the .json file from the Archive host.

The last few lines of 'psconfig stats pscheduler':
...
Total tasks managed by agent: 8
From remote definitions: 8
    https://nnuc/psconfig/3by3.json: 8

----
Archive host :

The open ports on the firewall are:
  services: cockpit dhcpv6-client https ssh

The Testpoint systems are built and provided a "psconfig remote add 'https://...'"
Did you run this with --configure-archives option?

The Archive host finishes the build, "psconfig remote add 'https://...'" added, and "psarchive troubleshoot" is run:
Did you configure auth in your MA host according to https://docs.perfsonar.net/multi_ma_install.html#authenticating-measurement-hosts ?

[root@nnuc xxxxx]# psarchive troubleshoot
OpenSearch running ...... OK
Logstash running ...... OK
...
Logstash->OpenSearch Authentication ...... OK
OpenSearch Data Exists ...... FAIL

There is no data in the database. This may be expected if this is a new archive and/or you have not yet setup measurements. If you reached this point, then the basic operations of your archive seem to be functioning.
...

(Given the timing, this would be expected.  However, Archive hosts built a few weeks earlier would sail through the full troubleshoot test.)

"psarchive troubleshoot"  run again 20-30 minutes later remained the same.

-------
Logs:

/var/log/logstash-plain.log  (many lines like this)
[2024-09-05T10:08:40,251][WARN ][org.logstash.dissect.Dissector][pscheduler][d0c83a28792c25a5dde35eff02146f9880d9f53249982c6b5c65ae174b921407] Dissector mapping, field not found in event {"field"=>"[pscheduler][run_href]", "event"=>{"@version"=>"1", "@timestamp"=>2024-09-05T17:08:40.146355132Z, "message"=>"", "headers"=>{"request_method"=>"GET", "http_host"=>"localhost", "http_user_agent"=>"python-requests/2.25.1", "http_version"=>"HTTP/1.1", "x_forwarded_server"=>"nnuc.ufixu.com", "request_path"=>"/", "content_length"=>"0", "x_forwarded_host"=>"localhost", "x_forwarded_for"=>"::1", "accept_encoding"=>"gzip, deflate", "http_accept"=>"*/*", "connection"=>"Keep-Alive"}, "host"=>"127.0.0.1"}}

/var/log/opensearch.log   (many lines like this)
[2024-09-05T10:09:27,285][WARN ][o.o.p.c.u.JsonConverter  ] [nnuc] Json Mapping Error: Cannot invoke "java.lang.Long.longValue()" because "this.cacheMaxSize" is null (through reference chain: org.opensearch.performanceanalyzer.collectors.CacheConfigMetricsCollector$CacheMaxSizeStatus["Cache_MaxSize"])

You can ignore these warnings they do not harm

Regards,

--
Szymon Trocha
Poznań Supercomputing & Networking Center
General NOC phone +48 61-858-2015 | noc.pcss.pl
Personal desk phone +48 61-858-2022 Wysłaliśmy do Ciebie ten e-mail w odpowiedzi na Twoje zapytanie lub w związku z oferowaną usługą. Przesłanie korespondencji do Centrum Zarządzania PCSS lub zgłoszenie telefoniczne jest równoznaczne z wyrażeniem zgody na przetwarzanie danych osobowych przez Instytut Chemii Bioorganicznej Polskiej Akademii Nauk w Poznaniu adres: ul. Z. Noskowskiego 12/14, 61-704 Poznań. Szczegółowe informacje znajdują się w naszej Polityce prywatności. | This message has been sent as a part of communication with PSNC NOC or your service request sent to us. For more information read our Privacy Policy.

Attachment: smime.p7s
Description: Kryptograficzna sygnatura S/MIME