perfSONAR User Q&A and Other Discussion

[Johann Hugo <>]

Hi all

Got it sorted by cheating a bit. 

The "opensearch_output_" lines in /etc/default/logstash were missing.

more  /etc/default/logstash

LS_HOME="/usr/share/logstash"

LS_SETTINGS_DIR="/etc/logstash"
LS_PIDFILE="/var/run/logstash.pid"
LS_USER="logstash"
LS_GROUP="logstash"
LS_GC_LOG_FILE="/var/log/logstash/gc.log"
LS_OPEN_FILES="16384"
LS_NICE="19"
SERVICE_NAME="logstash"
SERVICE_DESCRIPTION="logstash"
## Logstash environment variables.
log_level=info
opensearch_output_host=https://localhost:9200
opensearch_output_user=pscheduler_logstash
opensearch_output_password=xxxxxxxxxxxxxxxxxxx
XPACK_MONITORING_ENABLED=False

If I run this script by hand, it doesn't add the opensearch_output variables.

 /usr/lib/perfsonar/archive/perfsonar-scripts/pselastic_secure_pre.sh install

....

[Creating opensearch users]
Users already created
[DONE]

....

So I cheated the script (see below) to run the part that adds the  "opensearch_output_" lines

vi  /usr/lib/perfsonar/archive/perfsonar-scripts/pselastic_secure_pre.sh

....

# if [ $? -eq 0 ]; then
if [ $? -eq 1 ]; then
    echo "Users already created"
else

....

Now logstash runs fine.

root@ps-4-100g:~# systemctl status logstash.service
● logstash.service - logstash
     Loaded: loaded (/lib/systemd/system/logstash.service; enabled; vendor preset: enabled)
    Drop-In: /etc/systemd/system/logstash.service.d
             └─override.conf, timeout-override.conf
     Active: active (running) since Fri 2024-05-17 15:22:05 SAST; 59min ago

root@ps-4-100g:~# more /etc/os-release
PRETTY_NAME="Ubuntu 22.04.4 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.4 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy

Regards

Johann

On Tue, May 14, 2024 at 9:03 PM Johann Hugo <> wrote:

Hi all

Logstash stops every time with this error:

[ERROR][logstash.agent           ] Failed to execute action {:action=">LogStash::PipelineAction::Create/pipeline_id:pscheduler," :exception=>"Java::JavaLang::IllegalStateException", :message=>"Unable to configure plugins: Cannot evaluate `${opensearch_output_host}`. Replacement variable `opensearch_output_host` is not defined in a Logstash secret store or an environment entry and there is no default value given.", :backtrace=>["org.logstash.config.ir.CompiledPipeline.<init>(CompiledPipeline.java:120)"

Does anyone know how to fix this ?

Regards

Johann