Skip to Content.
Sympa Menu

grouper-users - Re: [grouper-users] performance issue with grouper 2.4

Subject: Grouper Users - Open Discussion List

List archive

Re: [grouper-users] performance issue with grouper 2.4


Chronological Thread 
  • From: "Hyzer, Chris" <>
  • To: "" <>, Siju Jacob <>
  • Subject: Re: [grouper-users] performance issue with grouper 2.4
  • Date: Wed, 17 Mar 2021 17:19:26 +0000
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=isc.upenn.edu; dmarc=pass action=none header.from=isc.upenn.edu; dkim=pass header.d=isc.upenn.edu; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=L2h+Ap/Z+4CjLDkOSQLDbwGmMePxZZy5p0Z0YcNrM+0=; b=dMzeI54qzgmJNhOJNENv3/TTKx7Wwt1srJzi8dWaGTL/Ll2M2gmv+VcKxf8mBUP2g5u+wu56SgF3iid9d4Gq0iouYwQ3RLRBv59h0RF0A4R3whiG9KZCAUxl2bswLNBDMjADfWeOsiYyTieucy3xxqshr8nLSsIMNYQ3/PPyaNt6W0CPHoLC/lL9pvHimIbE+V7QW1cL79L4iim8536QSwJNGMTr/T6lIAMMD9+X2I+GFTti5X1qz4YJpceJdmn5CdQoy+c1hO7p6DBx2XUYXklOnhEgfe44bMwDA6YosyKhE6zBne6J+Ui8Ng+7nRBo29d1l14iEOKwJ07zG2nRCQ==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Gd1J8Z4KmugObT/HHbD/psCZvuaAI30vKm6DU6n6fpG4IQEy6jDQXSuDlLsMnP0eG/6UM8/b88lNGMrwFm4fkAzXYRp4Y/isWUbjGwFS5l/INC0Qk3hvMdL5UYnULaIj8pKp8TXNYHsF3a1tMEYgGbjv8+LFhA4qkZ8FPBh9xicR9aoltixiPBepVSs6DJ976YidxvqeZy9pPOr7Gtk8m38ztrFgskFWNFYpAs1KQg8BvR5+fjozVqFMhGj+qJquEC3Eytff/aBC93dR4K8ZZrXGFCTjtOP/D5IB0/97PLmBnR3uMpbXUAt6mIDGtY06GvQeY9jKstzIHs5UCy3FeQ==

are you on slack to discuss this there?

It shouldnt take that long.  How long does the query take to return the results in a SQL client?

Is the database located in the same data center as the app server?

Have analyzed the tables/indexes recently?

It should be fast without an upgrade but do you have plans for an upgrade?

Thanks!
Chris

From: <> on behalf of Siju Jacob <>
Sent: Tuesday, March 9, 2021 10:32 AM
To: <>
Subject: [grouper-users] performance issue with grouper 2.4
 

Hi Team,

     We are using grouper 2.4 with latest updates. We are trying to scale our grouper to enterprise level. We are facing some performance issues.

    While trying to run the loaders with below configuration its taking days for a loader to load all members in grouper from source system.

 

    We are running on JDK 1.8 , Linux system with X86 Large - 4vCPU 16GB Mem and Centos, Oracle 11g database.

 

Please let me know what will be the ideal hardware configurations based on your experience for the enterprise level grouper with below mentioned load.

 

 

First time loading of a student group with 75,000 members take 24 hours.

Subsequent run of the same loader with no update take 7 hours to complete

 

Below is the loader email report.

 

-----------------------------------------------------------------------

environment:           TEST

memberships:           15,589,329

groups:                54,113

members:               733,651

folders:               6,326

unresolvable subjects: 3

bad memberships:       0

 

 

----------------

WITHIN LAST DAY:

----------------

new memberships:       4,217,129

new groups:            5

updated groups:        0

new folders:           0

 

----------------

LOADER SUMMARY WITHIN LAST DAY

----------------

jobs:                  16,923

started:               3

errors:                226

unresolvable subjects: 0

inserts:               468,662

updates:               0

deletes:               5

total loader mships:   1,084,974

processing time:       7d, 23h, 34m, 40s, 367ms

 

--------------------------------------------

GROUPER INFO

----------------------------------------

version: 2.4.0, build date: 2018/08/23 07:48:38, env: TEST

os.name: Linux

os.arch: amd64

os.version: 3.10.0-1160.15.2.el7.x86_64

java.version: 1.8.0_282

java.vendor: Red Hat, Inc.

java.class.path: /opt/grouper/grouper.apiBinary-2.4.0

heapSize: 1 GB

heapMaxSize: 4 GB

heapSizeFree: 50 MB

 

privileges.access.cache.interface:

privileges.naming.cache.interface:

groups.wheel.use: true

groups.wheel.group: etc:sysadmingroup

 

 

    

Any advice or guidance will be of great help and would be greatly appreciated..!

 

 

Thanks,

Siju Jacob




Archive powered by MHonArc 2.6.24.

Top of Page