grouper-users - [grouper-users] RE: Performance tuning guide?
Subject: Grouper Users - Open Discussion List
List archive
- From: "Hyzer, Chris" <>
- To: Richard Frovarp <>, "" <>
- Subject: [grouper-users] RE: Performance tuning guide?
- Date: Mon, 7 Jan 2019 22:52:07 +0000
- Accept-language: en-US
- Authentication-results: spf=none (sender IP is ) ;
- Ironport-phdr: 9a23:OM3PVxzewjALT4vXCy+O+j09IxM/srCxBDY+r6Qd0uoUK/ad9pjvdHbS+e9qxAeQG9mDu7Qc06L/iOPJYSQ4+5GPsXQPItRndiQuroEopTEmG9OPEkbhLfTnPGQQFcVGU0J5rTngaRAGUMnxaEfPrXKs8DUcBgvwNRZvJuTyB4Xek9m72/q99pHPYAhEniaxba9vJxiqsAvdsdUbj5F/Iagr0BvJpXVIe+VSxWx2IF+Yggjx6MSt8pN96ipco/0u+dJOXqX8ZKQ4UKdXDC86PGAv5c3krgfMQA2S7XYBSGoWkx5IAw/Y7BHmW5r6ryX3uvZh1CScIMb7Vq4/Vyi84Kh3SR/okCYHOCA/8GHLkcx7kaZXrAu8qxBj34LYZYeYP+d8cKzAZ9MXXWpPUNhMWSxdDI2ybIUPAOgAPelEoIbwvEEBoQeiCQS2GO/j1j1Fi3nr1qM6yeQhFgTG0RQuE9wMsHXVrcv6NL0KXeuo0qTIzS/Db/JN2Tvz9YPFdRUhru2MXbNwcMve11MvGhjEjlWLtYPpJS6V1vwTvGid6epsT/yghHM6qwxopDWk28QiipHRi44L0F/I6Th1zYMoKdGlVUJ2ZNCkHZRMuy2GMoZ7QN0tTm51tys/z7AKp4K3cDUSxJg6yRPTd+aLfoyV7h75SuqdPDN1iGh4dL+9hhu+6UagxfP/W8Wo1VtHqzdKn9rWuX0M0hHc9MaKRud480i7xzmP2Rzf5+RHLE8qjqXWKJgsyaMqmJUJq0TMBCr2lV32jKCIckUk/fCl5fz7b7vhupOROJZ4hx/nPKgzg8C/Bv83PRYUU2ic5OS8yKbs/UrkQLVMk/I6iLHZsIrdJcQHuKG2HxNV0ock6xa5FTum18kYnWUDLFJCfxKHjJLlNE3JIPD9Ffu/glKsnyl3x/3eILHuGInBImXGnbv8YLpx9ktRyAQ8wNxD+55ZD7MML+z8V0DssdHVCwE1PxCpz+r/DdVyzIIeWWaBAq+DN6PStEeF5uczLOmMZI4UuSjyK+I+6v7vln82hUURfbSx3ZQJbnC4GO5qLFuEbnrxmtsBC3sFvhIiTOz2j12PSTFTZ2y1X6Ih/jE0FpimAZ7eRoC2nrOBxjy7E4ZSZmBHEVCMDWzoe5ueV/cNbiKSPtFukiYCVbe/V48tywuiuxHnxLp6faLo/XgitJnj3cJ5r8PJkg877yQ8W96c2GGEVW0ykHkPWTYsxIh5rVdgjFqPzP48y7ZXD9tO//5TFxohOITH5+18F93oXA/dJJGEREvsCoGpGzYsVt8rhsIVblxmM9Skkh3Z2Se2WfkYm6HdV7Iu9aeJlVjgNctnjz7t1LMglBNuFs5ENXy0i7RX9hPYQZPRnkOf0aumaPJPj2b26G6fwD/W7wljWwlqXPCABChHPBGEpMnl5k7EU76lAKgmNQ0E08OZN69WcYO1305eSqLlP9LTKyKqlmG8CAzA54vEbZGiOgB/lD7YFFBClgkS+XicMg1rAyyhsnDTFhRvDlmpflvh9+84pX+mHQc5
- Spamdiagnosticmetadata: NSPM
- Spamdiagnosticoutput: 1:99
You can decrease the thread pool size if you want. But maybe you should also increase the max_connections var in mariadb... The docs in the config say its one pool for each list of groups job, is that the type of job you are running? # number of threads to use for each list of groups job (not shared among jobs) # {valueType: "integer", required: true} loader.groupThreadPoolSize=20 Thanks Chris -----Original Message----- Is there a performance tuning guide somewhere. I know to kick up the
memory offered to Tomcat. That helped out a good amount for the UI. In particular at the moment I'm having trouble with the loader. I'm
trying to load in our legacy groups for lack of a better term, and it's
firing up way too many threads. We have around 1k legacy groups. I can
see from jconsole that it's easily starting over 200 pool threads. Then
they start to time out, and MariaDB starts to complain about too many
connections. I see in the loader config file reference to
loader.use.groupThreads, and loader.groupThreadPoolSize, but not
entirely sure how they work. loader.use.groupThreads means that it is trying to use threads for each
of my 1k groups? And loader.groupThreadPoolSize means it is trying to
use 20 threads for each group? So is it trying to start 20k threads?
That would seem to indicate that the right option would be to set
loader.use.groupThreads to false. Or is there something else? I've hit
the same problem trying to load departments, and we're a mid-sized school. Is there anything else to performance tune the system? Thanks, Richard |
- [grouper-users] Performance tuning guide?, Richard Frovarp, 01/07/2019
- [grouper-users] RE: Performance tuning guide?, Hyzer, Chris, 01/07/2019
- [grouper-users] Re: Performance tuning guide?, Richard Frovarp, 01/07/2019
- [grouper-users] Re: Performance tuning guide?, Hyzer, Chris, 01/08/2019
- [grouper-users] Re: Performance tuning guide?, Richard Frovarp, 01/07/2019
- [grouper-users] RE: Performance tuning guide?, Hyzer, Chris, 01/07/2019
Archive powered by MHonArc 2.6.19.