Skip to Content.
Sympa Menu

perfsonar-user - Re: [perfsonar-user] ESMOND Tuning

Subject: perfSONAR User Q&A and Other Discussion

List archive

Re: [perfsonar-user] ESMOND Tuning


Chronological Thread 
  • From: Murilo Vetter <>
  • To: Szymon Trocha <>
  • Cc:
  • Subject: Re: [perfsonar-user] ESMOND Tuning
  • Date: Fri, 29 Sep 2017 11:06:36 -0300 (BRT)
  • Ironport-phdr: 9a23:StA86xdPeRbEFVDqtRehmmpDlGMj4u6mDksu8pMizoh2WeGdxcW9YB7h7PlgxGXEQZ/co6odzbGH4+a4ASQp2tWoiDg6aptCVhsI2409vjcLJ4q7M3D9N+PgdCcgHc5PBxdP9nC/NlVJSo6lPwWB6nK94iQPFRrhKAF7Ovr6GpLIj8Swyuu+54Dfbx9GiTe5Yr5+Ngm6oRnMvcQKnIVuLbo8xAHUqXVSYeRWwm1oJVOXnxni48q74YBu/SdNtf8/7sBMSar1cbg2QrxeFzQmLns65Nb3uhnZTAuA/WUTX2MLmRdVGQfF7RX6XpDssivms+d2xSeXMdHqQb0yRD+v9LlgRgP2hygbNj456GDXhdJ2jKJHuxKquhhzz5fJbI2JKPZye6XQds4YS2VcRMZcTyJPDIOmb4URDOQOP+hYoZTyqFQSrBuwAhWsCfj1xTNUmnD5xrc33/gjHAzAwQcuH8gOsHPRrNjtM6kSTPq1zKjMzTXEcvhZ1iny6JTUch8/u/GHQLV9cc/MyUk1FgPFilKQpZb7PzyLyuQNr3aU7/B7WOK3jG4nsxh9oiOzycs2kInJgJoVxkrf+iVj2Ys4I8CzRkB8Yd6hCpRQtieaOpNsQsMkW2Fkoj01yqcetZ6jYCcK048nywTHa/yDdYWD/xHtVP6JLDtmh39pZK+zihOx/ES8z+DzTMq53VVPoydKjtXAqmwB2hnW58WHUvdx4Fut1SqV2wzN5OxJI1o4mbffJpI/2LI9lpweulnZECDsgkX5lqqWe10k+ue27+TnZa3rp56dN49xkQ7+KL4hltanAeQ/KggCRnOb9vim2L35+035WK9GgeYskqXBsZDaI9oUprKhDgNL0Ysv9wuzAjKl3dgEmHQINlFIdRGCgoXmJ13CPOz0APK6jlmsiDtrwurJPrzlApXDNHjDl7LhcK54605B0gozzNRf55VOBrEfPv3zRlPxu8LCDhIiKwy0xP7nBMxm1owCQ26PGKmZMLvIvVCT/OIjO/OMa5MNuDbhN/gl4ObjjWcnll8Hc6mpxpwXaHaiEfR8OkmZfGHsjckbEWoRugo+TffqiEGZUTJNfXqyXqQ85i0lB4K8C4fMWJytjKKb0CilA5JWezMONlfZKmX5coKCE8sWbymSK4c1iS4VUL+nDZM70hquvSf/wrwhNu3G/CQe84rngotP6vXXhC01oBlpFcWZ1CmzQn1ok3lAEzorxqF7pgpjx0uf3LJQm/tAUMdYoelPSkEwL8iP4fZ9DoXXRxjAetDBdlu6Xti8SWU0U8gwx9hIfUthB9i4pgjEx2+xCPkPkaTNDoZiofGU5GT4O8sokyWO76ImlVRzB5IXbWA=

Hi,

In the first moment we check in the console of the host using HTOP.
As we could check, CPU has low usage.

Regards,

--


Murilo Vetter
Analista REMEP-FLN/PoP-SC
PoP-SC - Ponto de Presença da RNP em Santa Catarina
REMEP-FLN - Rede Metropolitana de Educação e Pesquisa da Região de Florianópolis
RNP - Rede Nacional de Ensino e Pesquisa
UFSC - Universidade Federal de Santa Catarina
SETIC - Superintendência de Governança Eletrônica e Tecnologia da Informação e Comunicação
Fundações de Apoio FEESC e FEPESE
--/--

www.pop-sc.rnp.br
remep.pop-sc.rnp.br
CHAMADOS:

+55(48)3721-3000
INOC: 11242*100



De: "Szymon Trocha" <>
Para:
Cc: "Murilo Vetter" <>
Enviadas: Sexta-feira, 29 de setembro de 2017 10:59:59
Assunto: Re: [perfsonar-user] ESMOND Tuning

W dniu 29.09.2017 o 14:31, Murilo Vetter pisze:
Hi list,

Here we are running ESMOND in our production environment and we notice that it is crashing the service a lot.
It starts once every hour. The host in that time was with 4GB of memory.

After trying to tuning Cassandra and increasing the memory of the host to 8GB, it is crashing once a day.
The size of the base is using ~100GB.

What is the recommendation size of memory to use in production environment?
In this host does not exist swap, is it necessary?

Some data below of the host:
[cqlsh 4.1.1 | Cassandra 2.0.17 | CQL spec 3.1.1 | Thrift protocol 19.39.0] ----- running with super-csv-2.4.0.jar
Java(TM) SE Runtime Environment (build 1.7.0_80-b15)
MAX_HEAP_SIZE="8G"
HEAP_NEWSIZE="2048M"
key_cache_size_in_mb: 512
file_cache_size_in_mb: 512
memtable_total_space_in_mb: 2048
commitlog_total_space_in_mb: 4096
in_memory_compaction_limit_in_mb: 256
DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap

In the initialization of Cassandra it was appearing:
CLibrary.java (line 63) JNA not found. Native methods will be disabled.

We tryed to update to jna 3.5.1 and jna 4.5, no one works with Cassandra, it appears the follow error:
java.lang.NoClassDefFoundError: org/supercsv/prefs/CsvPreference$Builder

We tryed also to use disk_access_mode: standard, but it doesn't work too.

Does anyone have a clue to help in this problem? Any proper configuration of Cassandra in this scenario?


Hi Murilo,

I'm just curious - did you maybe run some kind of SNMP monitoring for this host? To see historical mem and cpu behaviour

Regards,
-- 
Szymon Trocha

Poznań Supercomputing & Networking Center
Tel. +48 618582022 ::: http://noc.pcss.pl




Archive powered by MHonArc 2.6.19.

Top of Page