perfSONAR User Q&A and Other Discussion

[Phil Reese <>]

Hi again,

I'm having a heck of a time getting an Archive host to show data. I've 
tried the archive host on VMs and bare metal systems.  Systems with as 
little at 10g and as much as 32g.  All versions end up with logs looking 
like the following.  Sorry for the length, just trying to provide as 
much info as might be needed.

Previously built Testpoint and Archive hosts continue to work without issue.

Phil

----
Testpoint hosts:

There are three Testpoint hosts.  All complete the 'pscheduler 
troubleshoot' test successfully.  They are also able to 'curl -k 
https://...'   the .json file from the Archive host.

The last few lines of 'psconfig stats pscheduler':
...
Total tasks managed by agent: 8
From remote definitions: 8
    https://nnuc/psconfig/3by3.json: 8

----
Archive host :

The open ports on the firewall are:
  services: cockpit dhcpv6-client https ssh

The Testpoint systems are built and provided a "psconfig remote add 
'https://...'"

The Archive host finishes the build, "psconfig remote add 'https://...'" 
added, and "psarchive troubleshoot" is run:

[root@nnuc xxxxx]# psarchive troubleshoot
OpenSearch running ...... OK
Logstash running ...... OK
...
Logstash->OpenSearch Authentication ...... OK
OpenSearch Data Exists ...... FAIL

There is no data in the database. This may be expected if this is a new 
archive and/or you have not yet setup measurements. If you reached this 
point, then the basic operations of your archive seem to be functioning.
...

(Given the timing, this would be expected.  However, Archive hosts built 
a few weeks earlier would sail through the full troubleshoot test.)

"psarchive troubleshoot"  run again 20-30 minutes later remained the same.

-------
Logs:

/var/log/logstash-plain.log  (many lines like this)
[2024-09-05T10:08:40,251][WARN 
][org.logstash.dissect.Dissector][pscheduler][d0c83a28792c25a5dde35eff02146f9880d9f53249982c6b5c65ae174b921407] 
Dissector mapping, field not found in event 
{"field"=>"[pscheduler][run_href]", "event"=>{"@version"=>"1", 
"@timestamp"=>2024-09-05T17:08:40.146355132Z, "message"=>"", 
"headers"=>{"request_method"=>"GET", "http_host"=>"localhost", 
"http_user_agent"=>"python-requests/2.25.1", "http_version"=>"HTTP/1.1", 
"x_forwarded_server"=>"nnuc.ufixu.com", "request_path"=>"/", 
"content_length"=>"0", "x_forwarded_host"=>"localhost", 
"x_forwarded_for"=>"::1", "accept_encoding"=>"gzip, deflate", 
"http_accept"=>"*/*", "connection"=>"Keep-Alive"}, "host"=>"127.0.0.1"}}

/var/log/opensearch.log   (many lines like this)
[2024-09-05T10:09:27,285][WARN ][o.o.p.c.u.JsonConverter  ] [nnuc] Json 
Mapping Error: Cannot invoke "java.lang.Long.longValue()" because 
"this.cacheMaxSize" is null (through reference chain: 
org.opensearch.performanceanalyzer.collectors.CacheConfigMetricsCollector$CacheMaxSizeStatus["Cache_MaxSize"])