perfsonar-user - [perfsonar-user] Logstash killing my CPU on measurement archive

Subject: perfSONAR User Q&A and Other Discussion

List archive

From: "D'Angelo, Cas" <>
To: "" <>
Cc: "Merritt, John R" <>
Subject: [perfsonar-user] Logstash killing my CPU on measurement archive
Date: Mon, 24 Apr 2023 16:38:37 +0000
Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oit.gatech.edu; dmarc=pass action=none header.from=oit.gatech.edu; dkim=pass header.d=oit.gatech.edu; arc=none
Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=gcpCgthheb/6a1tP//KoyBtJc/RV1DBMxFJCYeTY/Z0=; b=j/ppCweXLJxJlXDQfQUYTdHhIwxtgtbYyrP4MuqQZorVg0wwRll3V+SZ5Xm8nDXJ8/v0KDDWDT8g4WUdP//+YgVX+eh7Ohf5hGVt+1Ib9mfMc0GkM2fQT1IDFjjPsT8bJIhYvYyRKOJ8LIzw4BvCFr/fbz2qXhhwrbvXuT/mE11tXAtYBVT8EPjQLPcdQExq/OcoJyu2D1TNdavew+3FWHZJ3XpIm0Q9XV6BmqBhrC/Il1C8oGrK5JO3n7uZtFgTVoNlnpeUrTo5Q/IpcFwzn5X5ayZXcstgn2pj7/Ao++bbWxG2waDHrtMt+FtIAH0buPWI8UhAw8vzgVL2c6Czfg==
Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=AyPtJLHXEcBihP9Lq7dXiAEPaiab1TAwFtn29YeECNquTrXaujXDxc+JHMnfVDkyNRO+D1hqp5pIIts/V6d91owARLuPVxHNWDGbNnQ6QnSpTi03BKyE1jZcfYs6RgUa79bIxU68iv6ess1v8DYAEZ8KKfNl6KRYYO9kAxcy7s63kdoV2HBVGGFHxVfVyeYCiSfZahnuZ2RdcuCN++uEUieJF86T2sGoNK447WQn4kuSfkOn4f00rx7GGvlpTuwHRjjV/zAM7VZoOumqblURBLMgKcjJ+P994rU23lMMCUhJc9xH6CdxEv22kiXEwL0FGdNWDdDOrRpCKFAaaxjx0A==
Msip_labels:

I am getting high CPU warnings from my measurement archive host. Anyone else seeing runaway logstash?

Top:

<PS-DASH:XXXXXX>top

top - 12:35:30 up 39 min, 2 users, load average: 3.70, 3.36, 3.28

Tasks: 225 total, 1 running, 224 sleeping, 0 stopped, 0 zombie

%Cpu(s): 2.0 us, 6.6 sy, 77.4 ni, 14.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st

KiB Mem : 3861052 total, 815196 free, 1605652 used, 1440204 buff/cache

KiB Swap: 2097148 total, 2096372 free, 776 used. 1989984 avail Mem

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND

21080 logstash 39 19 3282968 151308 14504 S 58.5 3.9 0:01.76 java

1351 maddash 20 0 3050136 297728 11484 S 1.7 7.7 0:24.85 java

2290 mongod 20 0 1086728 65688 8176 S 0.7 1.7 0:06.73 mongod

1 root 20 0 128308 6984 4196 S 0.3 0.2 0:02.38 systemd

460 root 20 0 89020 12292 11772 S 0.3 0.3 0:01.89 systemd-jo+

685 dbus 20 0 77320 2720 1920 S 0.3 0.1 0:00.39 dbus-daemon

1238 root 20 0 707296 109068 59272 S 0.3 2.8 0:09.35 pmd

1242 perfson+ 20 0 889980 54404 24536 S 0.3 1.4 0:01.18 node

2387 perfson+ 20 0 313824 27968 5256 S 0.3 0.7 0:10.57 python3

Cas D'Angelo

AVP & Chief Operating Officer OIT

Georgia Tech

p: 404-894-1356

[perfsonar-user] Logstash killing my CPU on measurement archive, D'Angelo, Cas, 04/24/2023
- RE: [perfsonar-user] Logstash killing my CPU on measurement archive, Garnizov, Ivan, 04/24/2023