perfSONAR User Q&A and Other Discussion

["Garnizov, Ivan" <>]

Hello D'Angelo,

 

In your report you are not sharing any more details in the terms of:

-          Number and type of measurements

-          OS

 

Is this a dedicated measurement archive host?

 

All we can see is that you are working with the minimum size on RAM resource, which I believe is already outdated 2-3 years ago.

 

Regards,

 

Regards,

Ivan Garnizov

 

GEANT WP6T3: pS development team

GEANT WP9T1: pS deployments GN Operations

GEANT WP9T2: Software governance in GEANT

 

 

 

 

From: [mailto:] On Behalf Of D'Angelo, Cas
Sent: Monday, April 24, 2023 6:39 PM
To:
Cc: Merritt, John R <>
Subject: [perfsonar-user] Logstash killing my CPU on measurement archive

 

I am getting high CPU warnings from my measurement archive host.  Anyone else seeing runaway logstash?

Top:

<PS-DASH:XXXXXX>top

top - 12:35:30 up 39 min,  2 users,  load average: 3.70, 3.36, 3.28

Tasks: 225 total,   1 running, 224 sleeping,   0 stopped,   0 zombie

%Cpu(s):  2.0 us,  6.6 sy, 77.4 ni, 14.0 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st

KiB Mem :  3861052 total,   815196 free,  1605652 used,  1440204 buff/cache

KiB Swap:  2097148 total,  2096372 free,      776 used.  1989984 avail Mem

 

   PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND    

 21080 logstash  39  19 3282968 151308  14504 S 58.5  3.9   0:01.76 java      

  1351 maddash   20   0 3050136 297728  11484 S  1.7  7.7   0:24.85 java      

  2290 mongod    20   0 1086728  65688   8176 S  0.7  1.7   0:06.73 mongod    

     1 root      20   0  128308   6984   4196 S  0.3  0.2   0:02.38 systemd    

   460 root      20   0   89020  12292  11772 S  0.3  0.3   0:01.89 systemd-jo+

   685 dbus      20   0   77320   2720   1920 S  0.3  0.1   0:00.39 dbus-daemon

  1238 root      20   0  707296 109068  59272 S  0.3  2.8   0:09.35 pmd        

  1242 perfson+  20   0  889980  54404  24536 S  0.3  1.4   0:01.18 node      

  2387 perfson+  20   0  313824  27968   5256 S  0.3  0.7   0:10.57 python3    

     

 

Cas D'Angelo AVP & Chief Operating Officer OIT Georgia Tech   p: 404-894-1356 w: oit.gatech.edu