Hi Kyle,
Sorry for the delay.
You are using a “clone” operator for 2 pScheduler Limit rules:
"name": "throughput-default-udp",
"name": "throughput-default-tcp",
The “clone” operator is used for inheritance from a “parent” Limits rule definition. It allows to create adjusted copies of a common
Limit rule.
In order to be able to help you, you need to specify the parameters for the common / “parent” Limit rule
So please specify
What would be the common limitations for both of the above listed Limit rules.
Regards,
Ivan Garnizov
GEANT WP6T3: pS development team
GEANT WP9T1: pS deployments GN Operations
GEANT WP9T2: Software governance in GEANT
From: Kyle Hutson [mailto:]
Sent: Wednesday, January 24, 2024 6:33 PM
To: Garnizov, Ivan (RRZE) <>
Subject: Re: [perfsonar-user] PS5 setup help
My limits.conf is pushed by ansible, so they're the same on all of the measurement hosts. I don't have a limits.conf on the dashboard node (I don't need one, correct?)
Attached is the limits.conf that gets pushed.
On Wed, Jan 24, 2024 at 3:02 AM Garnizov, Ivan <> wrote:
Hi Kyle,
Apparently your limits file has errors.
If you are not able to deal with it by yourself, you can send it along.
Please send all versions of the limits file: /etc/pscheduler/limits.conf
Your current version and all your subsequent amendment attempts for I am trying to make a case about
the complexity of the limits file.
Regards,
Ivan
From: Kyle Hutson [mailto:]
Sent: Tuesday, January 23, 2024 9:27 PM
To: Garnizov, Ivan (RRZE) <>
Subject: Re: [perfsonar-user] PS5 setup help
I am authorizing only by IP [1]
I have no pscheduler log from my dashboard host. Picking a measurement host, all I see in my pscheduler.log is once per hour...
Jan 23 14:00:06 ps-grand-bw journal: scheduler INFO Started
Jan 23 14:00:06 ps-grand-bw journal: scheduler INFO Started
and then a few times this morning
Jan 21 07:13:42 ps-grand-bw journal: pscheduler-api[32656] CRITICAL Failed to load limit file: Limit 'throughput-default-udp': Unable to clone undefined limit 'throughput-default-template'
Jan 21 07:13:42 ps-grand-bw journal: pscheduler-api[32656] CRITICAL Failed to load limit file: Limit 'throughput-default-udp': Unable to clone undefined limit 'throughput-default-template'
Nothing concerning the archiver there.
$ cat /etc/httpd/conf.d/apache-logstash.conf
<IfModule proxy_module>
ProxyRequests Off
<Proxy *>
<IfVersion >= 2.4>
Require all granted
</IfVersion>
<IfVersion < 2.4>
Order deny,allow
Allow from all
</IfVersion>
</Proxy>
ProxyPass /logstash http://localhost:11283 status=+I
ProxyPassReverse /logstash http://localhost:11283 status=+I
ProxyPreserveHost On
<Location /logstash>
Authtype Basic
Authname "Logstash Pass"
AuthUserFile /etc/perfsonar/opensearch/logstash_login
<RequireAny>
Require ip 164.113.32.109 164.113.32.89 164.113.32.105 164.113.32.85 164.113.32.141 164.113.32.49 164.113.32.149 164.113.32.66 164.113.32.145 164.113.32.57 164.113.32.113 164.113.32.93 164.113.32.117 164.113.32.97 164.113.32.153 164.113.32.73
Require ip 2001:49d0:23c0:1007::2 2001:49d0:23c0:1002::2 2001:49d0:23c0:1006::2 2001:49d0:23c0:1001::2 2001:49d0:23c0:1::10 2001:49d0:23c0:6::49 2001:49d0:23c0:3::26 2001:49d0:23c0:8::26 2001:49d0:23c0:2::18 2001:49d0:23c0:7::57 2001:49d0:23c0:1008::2
2001:49d0:23c0:1003::2 2001:49d0:23c0:1009::2 2001:49d0:23c0:1004::2 2001:49d0:23c0:4::34 2001:49d0:23c0:9::73
</RequireAny>
</Location>
</IfModule>
On Tue, Jan 23, 2024 at 2:13 PM Garnizov, Ivan <> wrote:
Hello
Kyle,
In order to be able to help you please share, which type of authorization have you decided
yourself upon.
Please check the pscheduler logs for events of failure of the “ archiver “ service.
Or even in general, if there are any successful measurements.
Regards,
Ivan Garnizov
GEANT WP6T3: pS development team
GEANT WP9T1: pS deployments GN Operations
GEANT WP9T2: Software governance in GEANT
From:
[mailto:]
On Behalf Of Kyle Hutson
Sent: Tuesday, January 23, 2024 12:34 AM
To:
Subject: Re: [perfsonar-user] PS5 setup help
Now that people are back from winter breaks and the list is getting active again, could somebody advise me on this?
On Wed, Dec 13, 2023 at 11:37 AM Kyle Hutson <> wrote:
All right, I think I've got the next issue distilled to something I can ask about.
I've created a JSON file on my central server. Here's the section generated by psconfig:
"archiver": "http",
"data": {
"schema": 3,
"_url": "https://ps-dashboard5.perfsonar.kanren.net/logstash",
"verify-ssl": false,
"op": "put",
"_headers": {
"x-ps-observer": "{% scheduled_by_address %}",
"content-type": "application/json"
}
},
"_meta": {
"esmond_url": "https://ps-dashboard5.perfsonar.kanren.net/esmond/perfsonar/archive/"
}
},
==
If you want the full JSON file, https://ps-dashboard5.perfsonar.kanren.net/toolkit/KanREN.json
I've used 'psconfig remote add' on my measurement hosts. One example:
==
$ psconfig remote list
=== pScheduler Agent ===
[
{
"url" : "http://dashboard.greatplains.net/psconfig/gpn_psconfig.json",
"configure-archives" : true
},
{
"url" : "https://ps-dashboard5.perfsonar.kanren.net/toolkit/KanREN.json",
"configure-archives" : true
}
]
However, I am not seeing any hits in my apache logs for either anything containing "logstash" nor for anything containing "esmond"
On Mon, Dec 11, 2023 at 3:39 PM Kyle Hutson <> wrote:
Background: everything we had setup for a central dashboard broke when the auto-upgrade to version 5 happened last April. I thought I'd be clever and bring up the base OS to something
that wasn't being deprecated in the next year while I was messing with it (namely Alma 9). I think I have several issues, but I'll start with one I can clearly articulate...
When I run 'systemctl restart maddash-server', it looks happy for several seconds and then fails.
/var/log/maddash/maddash-server.out reveals many 'JarClassLoader' warnings - I'm guessing those are advisory only. I have 365 lines of those.
Those are followed by these lines:
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See
http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
MLog initialization issue: slf4j found no binding or threatened to use its (dangerously silent) NOPLogger. We consider the slf4j library not found.
Initialization error: java.lang.String cannot be cast to java.util.Map
java.lang.ClassCastException: java.lang.String cannot be cast to java.util.Map
at net.es.maddash.MaDDashGlobals.configureDashboards(MaDDashGlobals.java:372)
at net.es.maddash.MaDDashGlobals.load(MaDDashGlobals.java:301)
at net.es.maddash.MaDDashGlobals.<init>(MaDDashGlobals.java:188)
at net.es.maddash.MaDDashGlobals.getInstance(MaDDashGlobals.java:520)
at net.es.maddash.Invoker.main(Invoker.java:55)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.simontuffs.onejar.Boot.run(Boot.java:340)
at com.simontuffs.onejar.Boot.main(Boot.java:166)
Looking for files containing 'slf4j; reveals files in
- /usr/share/logstash/logstash-core/lib/jars
- /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems
- /usr/share/opensearch/plugins/opensearch-*
Any clues on how to get this piece running?
|