Skip to Content.
Sympa Menu

perfsonar-user - Re: [perfsonar-user] ESMOND Tuning

Subject: perfSONAR User Q&A and Other Discussion

List archive

Re: [perfsonar-user] ESMOND Tuning


Chronological Thread 
  • From: Szymon Trocha <>
  • To:
  • Cc: Murilo Vetter <>
  • Subject: Re: [perfsonar-user] ESMOND Tuning
  • Date: Fri, 29 Sep 2017 15:59:59 +0200
  • Ironport-phdr: 9a23:EOmP6xIiXeg50MxW4NmcpTZWNBhigK39O0sv0rFitYgeIv3xwZ3uMQTl6Ol3ixeRBMOAuqIC07KempujcFRI2YyGvnEGfc4EfD4+ouJSoTYdBtWYA1bwNv/gYn9yNs1DUFh44yPzahANS47xaFLIv3K98yMZFAnhOgppPOT1HZPZg9iq2+yo9ZDeZwZFiCChbb9uMR67sRjfus4KjIV4N60/0AHJonxGe+RXwWNnO1eelAvi68mz4ZBu7T1et+ou+MBcX6r6eb84TaFDAzQ9L281/szrugLdQgaJ+3ART38ZkhtMAwjC8RH6QpL8uTb0u+ZhxCWXO9D9QKsqUjq+8ahkVB7oiD8GNzEn9mHXltdwh79frB64uhBz35LYbISTOfFjfK3SYMkaSHJcUMhPWSxPAoS8YYgBAeUPMulXrZXyqVQVoBu+BgShHv/jxiNGi3L026AxzuQvERvB3AwlB98ArXXVrdXwNKcVV+C+0bfGzS/Eb/xK2Tfy8pXDfxc6ofCNXbNwdM3RyU81GwPZlFWQrpDqPzOP2ekWtmiU9exgWfi3i24gqgBxpCKgxsE2honRgoIY01bJ/jh3zoYyIN23Uk97Ydi8HZtIqy6aLJB2Ttk6Q2Fsvisx174IuYajcSQU1Jgr2wPTZvmEfoSU4R/uUeOcLSp6iX9rfb+zmgu+/VC9xuD8SsW4ykhGoypKn9XWq3wA1QDf5tKGR/Z9+EqqxCyB2BrJ6u5eJEA5jarbJIAlwr43jpccqlrMHjXrmEXylqCabEAk9fKu6+j9erXmoZ6dN4luhQH4KKgugsi/Dfw5MggIQWeb5fyx2KP/8UHlXblHi/47nrXavZ3fIMkXu6y0DgFQ34o+9hqzFzKm384ZnXkDIlJFYhWHj43xNlHVIfH5DfK/g1OqkDtx2/DGJLrhDYnNLnfZi7rheKxy60hGxAorytBe5pRUBasHIP7pQk/xsMTUDgUlPAys3+bnFNJ925sGWW2RGK+ZPrjSsViO5u01OemAfZIVuC3jJPg//PPuiX45mUQBfamyw5cbcnG4HvJ6I0qHe3rshMkOEXsUsgYkUuPllUCCAnZvYCOqUrgy/TY9AZjjEJzOXKishqCMxiG2AscQa2xbWX6WFnK9TJeVXvAKIB6IJcRhm3RQTqqwTognkw20swT6wpJiJ+yS4ioKs5vlksBxsb6A3Sou/CB5WpzOm1qGSHt5yyZRH2c7
  • Organization: PCSS

W dniu 29.09.2017 o 14:31, Murilo Vetter pisze:
Hi list,

Here we are running ESMOND in our production environment and we notice that it is crashing the service a lot.
It starts once every hour. The host in that time was with 4GB of memory.

After trying to tuning Cassandra and increasing the memory of the host to 8GB, it is crashing once a day.
The size of the base is using ~100GB.

What is the recommendation size of memory to use in production environment?
In this host does not exist swap, is it necessary?

Some data below of the host:
[cqlsh 4.1.1 | Cassandra 2.0.17 | CQL spec 3.1.1 | Thrift protocol 19.39.0] ----- running with super-csv-2.4.0.jar
Java(TM) SE Runtime Environment (build 1.7.0_80-b15)
MAX_HEAP_SIZE="8G"
HEAP_NEWSIZE="2048M"
key_cache_size_in_mb: 512
file_cache_size_in_mb: 512
memtable_total_space_in_mb: 2048
commitlog_total_space_in_mb: 4096
in_memory_compaction_limit_in_mb: 256
DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap

In the initialization of Cassandra it was appearing:
CLibrary.java (line 63) JNA not found. Native methods will be disabled.

We tryed to update to jna 3.5.1 and jna 4.5, no one works with Cassandra, it appears the follow error:
java.lang.NoClassDefFoundError: org/supercsv/prefs/CsvPreference$Builder

We tryed also to use disk_access_mode: standard, but it doesn't work too.

Does anyone have a clue to help in this problem? Any proper configuration of Cassandra in this scenario?


Hi Murilo,

I'm just curious - did you maybe run some kind of SNMP monitoring for this host? To see historical mem and cpu behaviour

Regards,
-- 
Szymon Trocha

Poznań Supercomputing & Networking Center
Tel. +48 618582022 ::: http://noc.pcss.pl



Archive powered by MHonArc 2.6.19.

Top of Page