Skip to Content.
Sympa Menu

grouper-users - RE: [grouper-users] Planning to scale grouper to enterprise level. Could you please share the CPU information

Subject: Grouper Users - Open Discussion List

List archive

RE: [grouper-users] Planning to scale grouper to enterprise level. Could you please share the CPU information


Chronological Thread 
  • From: "Hyzer, Chris" <>
  • To: Siju Jacob <>, " Mailing List" <>
  • Cc: Omer Almatary <>, Nazeer Syed <>, Cyril Phillips <>
  • Subject: RE: [grouper-users] Planning to scale grouper to enterprise level. Could you please share the CPU information
  • Date: Tue, 2 Oct 2018 04:39:41 +0000
  • Accept-language: en-US
  • Authentication-results: spf=none (sender IP is ) ;
  • Ironport-phdr: 9a23:60i6thfmwMkWgdO07P9Dn0YtlGMj4u6mDksu8pMizoh2WeGdxc27ZRyN2/xhgRfzUJnB7Loc0qyK6/+mATRIyK3CmUhKSIZLWR4BhJdetC0bK+nBN3fGKuX3ZTcxBsVIWQwt1Xi6NU9IBJS2PAWK8TW94jEIBxrwKxd+KPjrFY7OlcS30P2594HObwlSizexfbF/IA+qoQnNq8IbnZZsJqEtxxXTv3BGYf5WxWRmJVKSmxbz+MK994N9/ipTpvws6ddOXb31cKokQ7NYCi8mM30u683wqRbDVwqP6WACXWgQjxFFHhLK7BD+Xpf2ryv6qu9w0zSUMMHqUbw5Xymp4rx1QxH0ligIKz858HnWisNuiqJbvAmhrAF7z4LNfY2ZKOZycqbbcNgHR2ROQ9xRWjRBDI2icoUPE+QPM+VWr4b/plsBsRSxCBK2C+/z1jNFnGP60bE43uknDArI3BYgH9ULsHnMotn7NqcTUOGrw6nS1TnIcu1b2Tfn6IjJaRAtr+yHULV1ccXNyUkuFwLEgUuKqYH+PjOVzfgCv3KG7+p4S+2vjWgnpxtvrTey28chk4/EjZ8bxFDD8CV22oc1JdugRU56Z96kDIVftzucN4RoXsMuXXtktzgnxb0boZK0ZjAKx447yB7fdfOLaY+I4gjsVOqJJjd4mW5leLa4hxa18kis0PHzVs6x0FtMsyFLkcHMu2gT2xPJ9sSLV/5w8lq81TqS0g3T5O5JLVwomafeKZMu3LE9m5UWvEnGACP6hFv6gLeLekgq5uSk8eDqbqj8qpOCKoN5jhvyPrksl8G+Geg4PBYBUmuH9em50bDs4E70QLtUgfAzjKbVrozWKMQeq6GiHQBY3YIu5hO/Aju7zdsVnH8KJ09fdh2dlYjmIVTOLej4Dfihh1Ssly9myejaM7PmHpnBMGHPnqr5c7pg8kJczxE8ws5F65JTF7EBPOn8WkjstNzeExA1KRS0w/zgCNVhyIwRRX6PAq6eMKPUq1OI4f8vI/WIZI8Svzb9KOIp6OLpjX88gVMdfK+p0oULaH2gAPhpOVmVbWfpj9scDGsGow8zTOLlhVGeTTJeYnS/ULwz6zw0DY+rCJnPSpyzjLCZ2Se0BJxWZmRIClCWFnfocp2JW/IQZyKSIs5gkyILVaK6Ro8gzhGhqBX2y6d/LuXK/C0Ys4jv28Zo6O3OjR0y7yB7D9yB02GRSGF5hmwIRyUx3KBiuUxy1E2D3bFlg/xDC9NT/ehJXxw+NZ7d1Ox6F8vyVhzbcteITlamXsupASs3Tt0v398CfVxxFMu/gRDejGKWBOoulr6WTL49+aXWlyzqJZklkV7B1bVnlUQ6TcZVLiurirMps0CZCJTOjl2UjeO3bqkGxwbM8nuO12yDoBseXQJtGYDMXHQeYESeidXi+gmKG7C0Dqk/PxEE1NWPMLBia9v1gE9ASeu5ftnSfjTitX23AEPC5qKeYZCuM04dxiTGQgBQlgsT7GSLLyA/HSznvnrTCjooGF7yNRC/udJioW+2GxdnhzqBaFdsgv/sokZP366VVu8T07QYuSwotzRzGhOn0snLD8ab+VYzZ71SNNU65loPlXnUsQBwJNSBF+hjnRZfFmY/pEbyz1NyA4REn9ItqSYvxwpjO6+C+FJafHWFxZ32PPvaJnShtB0=
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99

What type of database do you use?  Have you analyzed tables?  What is slow exactly and how long does whatever it is take?  How much memory does each tomcat have?

 

From: Siju Jacob <>
Sent: Monday, October 01, 2018 4:29 PM
To: Hyzer, Chris <>; Mailing List <>
Cc: Omer Almatary <>; Nazeer Syed <>; Cyril Phillips <>
Subject: RE: [grouper-users] Planning to scale grouper to enterprise level. Could you please share the CPU information

 

Hi Team,

 

We are running Grouper 2.3.0.

Below is the number of groups and members we have at present

 

Object

Present Count

Query

Groups

27522

select count(1) from grouper_groups

Folders

2970

select count(1) from grouper_stems

Memberships

370977

select count(1) from grouper_memberships_all_v gmav

 

We are having the 2 servers with below configuration in each. Grouper UI/WS and API Binary is deployed in both he servers.

 

Grouper Applications

Server count

Architecture/OS

CPU

Memory

Disk Space

Software Version

UI/ WS/ API Binary

Solaris 10 (SPARC)

Sun SPARC M3000 Architecture SPARC64 VII: 2.52GHz Quad Core processors

8 GB

2x146GB Internal

drives

 

JDK1.7.0

Apache Tomcat 8.5.12

Apache/2.2.34

 

 

 

Our grouper application seems to be slow with above configuration.

 

Could you please share your CPU and OS information for an enterprise level grouper deployment.

 

Thanks,

Siju

 

From: Hyzer, Chris <>
Sent: Monday, September 10, 2018 9:18 AM
To: Siju Jacob <>; Mailing List <>
Cc: Omer Almatary <>; Nazeer Syed <>; Cyril Phillips <>
Subject: RE: [grouper-users] Planning to scale grouper to enterprise level. Could you please share the information

 

Those numbers don’t really look right to me…

 

I would think you would have a lot more groups.  Some groups would have a lot more members.  I would think most apps would use SAML or LDAP instead of WS.  I would think you wouldn’t have 500 concurrent UI users, that seems high.

 

Anyways, if you have that much usage, I would be most worried about the size of the database.   I would have a load balancer for UI and WS and scale that as you need to.  At Penn we have this configuration:

 

https://spaces.at.internet2.edu/display/Grouper/Penn+Grouper+deployment

 

We use:

·         WS

·         Daemon

·         UI

·         PSPNG

·         Custom ldap provisioner

Authorizations are provisioned with

·         SAML

·         LDAP

·         WS

·         SQL

We have:

Count

Object

Query

230k

Groups

select count(1) from grouper_groups

23k

Folders

select count(1) from grouper_stems

12m

Memberships

select count(1) from grouper_memberships_all_v gmav

Servers:

Note, our servers are shared with 20 java applications, Grouper UI, WS, and Daemon being three of those 20.

Server type

Server count

Memory allocated

UI

5

1.5g

WS

5

750m

Daemon

5

2.8g

Instrumentation: /grouper/grouperUi/app/UiV2Main.index?operation=UiV2Admin.instrumentation

Operation

Count

Membership changes / day

20k

UI servlet requests / day

500

 

 

 

 

From: [] On Behalf Of Siju Jacob
Sent: Friday, September 07, 2018 1:26 PM
To: Mailing List <>
Cc: Omer Almatary <>; Nazeer Syed <>; Cyril Phillips <>
Subject: [grouper-users] Planning to scale grouper to enterprise level. Could you please share the information

 

Hi Team,

    We are planning to scale Grouper to support the enterprise and the projected usage is approximately 500 concurrent UI users and 1500 applications making webservice calls to grouper. There will be approximately 2000 groups with 400 members  in each group.

     Does any of you have similar level of grouper usage. If yes could you please share with us the kind of infrastructure you have in place in terms of OS, memory, disk space etc..

 

     We are using grouper 2.3.0. Running on tomcat 8 and JDK 7. Currently we have 2 Unix servers.  At present our grouper usage is limited, with 20 concurrent grouper UI users and 10 applications making web service calls to grouper.

     Any advice or guidance will be of great help and would be greatly appreciated..!

 

Thanks,

Siju Jacob

 




Archive powered by MHonArc 2.6.19.

Top of Page