Skip to Content.
Sympa Menu

perfsonar-user - RE: [perfsonar-user] PS5 setup help

Subject: perfSONAR User Q&A and Other Discussion

List archive

RE: [perfsonar-user] PS5 setup help


Chronological Thread 
  • From: "Garnizov, Ivan" <>
  • To: Kyle Hutson <>, "<> ()" <>
  • Subject: RE: [perfsonar-user] PS5 setup help
  • Date: Thu, 25 Jan 2024 17:04:47 +0000

Hi Kyle,

 

Sorry for the delay.

You are using a “clone” operator for 2 pScheduler Limit rules:

                    "name": "throughput-default-udp",

                    "name": "throughput-default-tcp",

 

The “clone” operator is used for inheritance from a “parent” Limits rule definition. It allows to create adjusted copies of a common Limit rule.

In order to be able to help you, you need to specify the parameters for the common / “parent” Limit rule

So please specify

What would be the common limitations for both of the above listed Limit rules.

 

 

Regards,

Ivan Garnizov

 

GEANT WP6T3: pS development team

GEANT WP9T1: pS deployments GN Operations

GEANT WP9T2: Software governance in GEANT

 

 

 

From: Kyle Hutson [mailto:]
Sent: Wednesday, January 24, 2024 6:33 PM
To: Garnizov, Ivan (RRZE) <>
Subject: Re: [perfsonar-user] PS5 setup help

 

My limits.conf is pushed by ansible, so they're the same on all of the measurement hosts. I don't have a limits.conf on the dashboard node (I don't need one, correct?)

 

Attached is the limits.conf that gets pushed.

 

 

On Wed, Jan 24, 2024 at 3:02 AM Garnizov, Ivan <> wrote:

Hi Kyle,

 

Apparently your limits file has errors.

If you are not able to deal with it by yourself, you can send it along.

Please send all versions of the limits file: /etc/pscheduler/limits.conf

 

Your current version and all your subsequent amendment attempts for I am trying to make a case about the complexity of the limits file.

 

Regards,

Ivan

 

 

From: Kyle Hutson [mailto:]
Sent: Tuesday, January 23, 2024 9:27 PM
To: Garnizov, Ivan (RRZE) <>
Subject: Re: [perfsonar-user] PS5 setup help

 

I am authorizing only by IP [1]

 

I have no pscheduler log from my dashboard host. Picking a measurement host, all I see in my pscheduler.log is once per hour...

Jan 23 14:00:06 ps-grand-bw journal: scheduler INFO     Started
Jan 23 14:00:06 ps-grand-bw journal: scheduler INFO     Started

....

and then a few times this morning

Jan 21 07:13:42 ps-grand-bw journal: pscheduler-api[32656] CRITICAL Failed to load limit file: Limit 'throughput-default-udp': Unable to clone undefined limit 'throughput-default-template'
Jan 21 07:13:42 ps-grand-bw journal: pscheduler-api[32656] CRITICAL Failed to load limit file: Limit 'throughput-default-udp': Unable to clone undefined limit 'throughput-default-template'

Nothing concerning the archiver there.

 

[1]

From my dashboard host

=====

$ cat /etc/httpd/conf.d/apache-logstash.conf

<IfModule proxy_module>
    ProxyRequests Off
    <Proxy *>
        <IfVersion >= 2.4>
            Require all granted
        </IfVersion>
        <IfVersion < 2.4>
            Order deny,allow
            Allow from all
        </IfVersion>
    </Proxy>
    ProxyPass /logstash http://localhost:11283 status=+I
    ProxyPassReverse /logstash http://localhost:11283 status=+I
    ProxyPreserveHost On
    <Location /logstash>
        Authtype Basic
        Authname "Logstash Pass"
        AuthUserFile /etc/perfsonar/opensearch/logstash_login
        <RequireAny>
           Require ip 164.113.32.109 164.113.32.89 164.113.32.105 164.113.32.85 164.113.32.141 164.113.32.49 164.113.32.149 164.113.32.66 164.113.32.145 164.113.32.57 164.113.32.113 164.113.32.93 164.113.32.117 164.113.32.97 164.113.32.153 164.113.32.73
           Require ip 2001:49d0:23c0:1007::2 2001:49d0:23c0:1002::2 2001:49d0:23c0:1006::2 2001:49d0:23c0:1001::2 2001:49d0:23c0:1::10 2001:49d0:23c0:6::49 2001:49d0:23c0:3::26 2001:49d0:23c0:8::26 2001:49d0:23c0:2::18 2001:49d0:23c0:7::57 2001:49d0:23c0:1008::2 2001:49d0:23c0:1003::2 2001:49d0:23c0:1009::2 2001:49d0:23c0:1004::2 2001:49d0:23c0:4::34 2001:49d0:23c0:9::73
        </RequireAny>
    </Location>
</IfModule>

=====

 

 

 

 

On Tue, Jan 23, 2024 at 2:13 PM Garnizov, Ivan <> wrote:

Hello Kyle,

 

In order to be able to help you please share, which type of authorization have you decided yourself upon.

 

Please check the pscheduler logs for events of failure of the “ archiver “ service.

Or even in general, if there are any successful measurements.

 

 

Regards,

Ivan Garnizov

 

GEANT WP6T3: pS development team

GEANT WP9T1: pS deployments GN Operations

GEANT WP9T2: Software governance in GEANT

 

 

 

From: [mailto:] On Behalf Of Kyle Hutson
Sent: Tuesday, January 23, 2024 12:34 AM
To:
Subject: Re: [perfsonar-user] PS5 setup help

 

Now that people are back from winter breaks and the list is getting active again, could somebody advise me on this?

 

On Wed, Dec 13, 2023 at 11:37 AM Kyle Hutson <> wrote:

All right, I think I've got the next issue distilled to something I can ask about.

 

I've created a JSON file on my central server. Here's the section generated by psconfig:

==

 "archives" : {

    "archiver": "http",
    "data": {
        "schema": 3,
        "_url": "https://ps-dashboard5.perfsonar.kanren.net/logstash",
        "verify-ssl": false,
        "op": "put",
        "_headers": {
            "x-ps-observer": "{% scheduled_by_address %}",
            "content-type": "application/json"
        }
    },
    "_meta": {
        "esmond_url": "https://ps-dashboard5.perfsonar.kanren.net/esmond/perfsonar/archive/"
    }
   },
==
If you want the full JSON file, https://ps-dashboard5.perfsonar.kanren.net/toolkit/KanREN.json
I've used 'psconfig remote add' on my measurement hosts. One example:
==
$ psconfig remote list

=== pScheduler Agent ===
[
   {
      "url" : "http://dashboard.greatplains.net/psconfig/gpn_psconfig.json",
      "configure-archives" : true
   },
   {
      "url" : "https://ps-dashboard5.perfsonar.kanren.net/toolkit/KanREN.json",
      "configure-archives" : true
   }
]

==

 

However, I am not seeing any hits in my apache logs for either anything containing "logstash" nor for anything containing "esmond"

 

On Mon, Dec 11, 2023 at 3:39 PM Kyle Hutson <> wrote:

Background: everything we had setup for a central dashboard broke when the auto-upgrade to version 5 happened last April. I thought I'd be clever and bring up the base OS to something that wasn't being deprecated in the next year while I was messing with it (namely Alma 9). I think I have several issues, but I'll start with one I can clearly articulate...

 

When I run 'systemctl restart maddash-server', it looks happy for several seconds and then fails.

 

/var/log/maddash/maddash-server.out reveals many 'JarClassLoader' warnings - I'm guessing those are advisory only. I have 365 lines of those.

 

Those are followed by these lines:

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
MLog initialization issue: slf4j found no binding or threatened to use its (dangerously silent) NOPLogger. We consider the slf4j library not found.
Initialization error: java.lang.String cannot be cast to java.util.Map
java.lang.ClassCastException: java.lang.String cannot be cast to java.util.Map
        at net.es.maddash.MaDDashGlobals.configureDashboards(MaDDashGlobals.java:372)
        at net.es.maddash.MaDDashGlobals.load(MaDDashGlobals.java:301)
        at net.es.maddash.MaDDashGlobals.<init>(MaDDashGlobals.java:188)
        at net.es.maddash.MaDDashGlobals.getInstance(MaDDashGlobals.java:520)
        at net.es.maddash.Invoker.main(Invoker.java:55)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.simontuffs.onejar.Boot.run(Boot.java:340)
        at com.simontuffs.onejar.Boot.main(Boot.java:166)

 

Looking for files containing 'slf4j; reveals files in

- /usr/share/logstash/logstash-core/lib/jars

- /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems

- /usr/share/opensearch/plugins/opensearch-*

 

Any clues on how to get this piece running?




Archive powered by MHonArc 2.6.24.

Top of Page