Skip to Content.
Sympa Menu

grouper-users - RE: [grouper-users] Grouper UI search performance

Subject: Grouper Users - Open Discussion List

List archive

RE: [grouper-users] Grouper UI search performance


Chronological Thread 
  • From: Chris Hyzer <>
  • To: Tim Darby <>
  • Cc: "" <>
  • Subject: RE: [grouper-users] Grouper UI search performance
  • Date: Wed, 12 Dec 2012 11:30:36 +0000
  • Accept-language: en-US

Can you turn on p6spy?

 

1.       In the grouper.hibernate.properties, set:

 

hibernate.connection.driver_class = com.p6spy.engine.spy.P6SpyDriver

 

2.       Make sure you have the p6spy.jar there

3.       In the spy.properties set your underlying driver:

 

realdriver=oracle.jdbc.driver.OracleDriver

4.       Also set a file path (or change to something on unix, /tmp/grouperP6spy.log):

 

logfile=c\:\\temp\\grouperSpy.log

 

5.       Then run the group search and send me the output in the log file, should be something like this, but many more entries:

 

2012/12/12 06:26:10:795, 1ms, statement: ByHqlStatic.java.listSet() line 421, Hib3GroupDAO.java.callback() line 2511, Hib3GroupDAO.java.findAllByApproximateNameSecureHelper() line 2432, Hib3GroupDAO.java.findAllByApproximateNameSecure() line 543, GrouperSourceAdapter.java.callback() line 456, GrouperSession.java.callbackGrouperSession() line 801, GrouperSourceAdapter.java.searchHelper() line 427, GrouperSourceAdapter.java.search() line 582, SourcesXmlResolver.java.findAll() line 341, CachingResolver.java.findAll() line 174, ValidatingResolver.java.findAll() line 146, SubjectFinder.java.findAll() line 635, ShellHelper.java.eval() line 63, GrouperShell.java.run() line 428, GrouperShell.java.grouperShellHelper() line 232, GrouperShell.java.main() line 162

   select distinct group0_.id as id21_, group0_.hibernate_version_number as hibernate2_21_, group0_.last_membership_change as last3_21_, group0_.last_imm_membership_change as last4_21_, group0_.parent_stem as parent5_21_, group0_.creator_id as creator6_21_, group0_.create_time as create7_21_, group0_.modifier_id as modifier8_21_, group0_.modify_time as modify9_21_, group0_.name as name21_, group0_.display_name as display11_21_, group0_.extension as extension21_, group0_.display_extension as display13_21_, group0_.description as descrip14_21_, group0_.context_id as context15_21_, group0_.alternate_name as alternate16_21_, group0_.type_of_group as type17_21_ from grouper_groups group0_ where (lower(group0_.name) like '%qs%' or lower(group0_.display_name) like '%qs%' or lower(group0_.alternate_name) like '%qs%') and (group0_.type_of_group in ('group' , 'role'))

2012/12/12 06:26:10:795, resultset: ALIASES: 0: id, 1: hibernate_version_number, 2: last_membership_change, 3: last_imm_membership_change, 4: parent_stem, 5: creator_id, 6: create_time, 7: modifier_id, 8: modify_time, 9: name, 10: display_name, 11: extension, 12: display_extension, 13: description, 14: context_id, 15: alternate_name, 16: type_of_group

2012/12/12 06:26:10:796, resultset: 0: 02759bdd-e950-45a0-8cf6-44869efb1df9, 1: 1, 2: null, 3: null, 4: de361979-7562-4747-9f88-1d745d131976, 5: ec29dce7f0704483b370d6266e8ea3b8, 6: 1152804373000, 7: ec29dce7f0704483b370d6266e8ea3b8, 8: 1353297684968, 9: qsuob:faculties:artf:staff_mail_inc, 10: QS University of Bristol:Academic faculties:Arts:staff mail includes, 11: staff_mail_inc, 12: staff mail includes, 13: null, 14: f02d9c61daaa4a0ab48f85396fc87d40, 15: null, 16: group

2012/12/12 06:26:10:796, resultset: 0: 03e1d69a-dfe8-4c67-898e-dac0f3c96125, 1: 1, 2: null, 3: null, 4: de361979-7562-4747-9f88-1d745d131976, 5: ec29dce7f0704483b370d6266e8ea3b8, 6: 1152804373000, 7: ec29dce7f0704483b370d6266e8ea3b8, 8: 1353297684705, 9: qsuob:faculties:artf:staff_mail_minus, 10: QS University of Bristol:Academic faculties:Arts:staff - staff_mail_exc, 11: staff_mail_minus, 12: staff - staff_mail_exc, 13: null, 14: f02d9c61daaa4a0ab48f85396fc87d40, 15: null, 16: group

 

From: [mailto:] On Behalf Of Tim Darby
Sent: Tuesday, December 11, 2012 5:44 PM
To: Chris Hyzer
Subject: Re: [grouper-users] Grouper UI search performance

 

Hey Chris, 

 

I tried installing this and pointing it to the same database I was using and I'm not seeing any change.  The time it takes to return search results is still very long.


Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799



On Wed, Nov 21, 2012 at 3:33 PM, Chris Hyzer <> wrote:

I think it might be a bug that was fixed in the 2.1.3… can you try that one?

 

http://www.internet2.edu/grouper/release/2.1.3/

 

Note, you could run this note in your production app server, but locally pointing to the prod DB and see if it helps.  (obviously don’t init the DB or anything)

 

Thanks,

Chris

 

From: [mailto:] On Behalf Of Tim Darby
Sent: Wednesday, November 21, 2012 5:30 PM
Cc:
Subject: Re: [grouper-users] Grouper UI search performance

 

Thanks, I ran this (took about 2 hours), but it didn't help.  Any other thoughts?  Which tables does the UI query when you specify Grouper Source Adapter in the search tool?


Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

 

On Wed, Nov 14, 2012 at 1:20 PM, Chris Hyzer <> wrote:

Can you analyze the tables in your database and see if it helps?

 

This will generate the script:

 

select 'ANALYZE TABLE ' || table_name || ' COMPUTE STATISTICS;' as script from user_Tables where table_name like 'GROUPER%'

 

Which will look like this, run the generated script (it will take some time), and see if it helps:

 

 

SCRIPT                                                         

----------------------------------------------------------------

ANALYZE TABLE GROUPER_ATTRIBUTES COMPUTE STATISTICS;           

ANALYZE TABLE GROUPER_ATTRIBUTE_ASSIGN COMPUTE STATISTICS;     

ANALYZE TABLE GROUPER_ATTRIBUTE_ASSIGN_VALUE COMPUTE STATISTICS;

ANALYZE TABLE GROUPER_ATTRIBUTE_DEF COMPUTE STATISTICS;        

ANALYZE TABLE GROUPER_ATTRIBUTE_DEF_NAME COMPUTE STATISTICS;   

ANALYZE TABLE GROUPER_ATTRIBUTE_DEF_NAME_SET COMPUTE STATISTICS;

ANALYZE TABLE GROUPER_ATTRIBUTE_DEF_SCOPE COMPUTE STATISTICS;  

ANALYZE TABLE GROUPER_ATTR_ASSIGN_ACTION COMPUTE STATISTICS;    

ANALYZE TABLE GROUPER_ATTR_ASSIGN_ACTION_SET COMPUTE STATISTICS;

ANALYZE TABLE GROUPER_AUDIT_ENTRY COMPUTE STATISTICS;          

ANALYZE TABLE GROUPER_AUDIT_TYPE COMPUTE STATISTICS;           

ANALYZE TABLE GROUPER_CHANGE_LOG_CONSUMER COMPUTE STATISTICS;  

ANALYZE TABLE GROUPER_CHANGE_LOG_ENTRY COMPUTE STATISTICS;     

ANALYZE TABLE GROUPER_CHANGE_LOG_ENTRY_TEMP COMPUTE STATISTICS;

ANALYZE TABLE GROUPER_CHANGE_LOG_TYPE COMPUTE STATISTICS;      

ANALYZE TABLE GROUPER_COMPOSITES COMPUTE STATISTICS;            

ANALYZE TABLE GROUPER_DDL COMPUTE STATISTICS;                  

ANALYZE TABLE GROUPER_EXT_SUBJ COMPUTE STATISTICS;             

ANALYZE TABLE GROUPER_EXT_SUBJ_ATTR COMPUTE STATISTICS;        

ANALYZE TABLE GROUPER_FIELDS COMPUTE STATISTICS;               

ANALYZE TABLE GROUPER_GROUPS COMPUTE STATISTICS;               

ANALYZE TABLE GROUPER_GROUPS_TYPES COMPUTE STATISTICS;         

ANALYZE TABLE GROUPER_GROUP_SET COMPUTE STATISTICS;            

ANALYZE TABLE GROUPER_LOADER_LOG COMPUTE STATISTICS;           

ANALYZE TABLE GROUPER_MEMBERS COMPUTE STATISTICS;              

ANALYZE TABLE GROUPER_MEMBERSHIPS COMPUTE STATISTICS;          

ANALYZE TABLE GROUPER_PIT_ATTRIBUTE_ASSIGN COMPUTE STATISTICS; 

ANALYZE TABLE GROUPER_PIT_ATTRIBUTE_DEF COMPUTE STATISTICS;    

ANALYZE TABLE GROUPER_PIT_ATTR_ASSN_ACTN COMPUTE STATISTICS;   

ANALYZE TABLE GROUPER_PIT_ATTR_ASSN_ACTN_SET COMPUTE STATISTICS;

ANALYZE TABLE GROUPER_PIT_ATTR_ASSN_VALUE COMPUTE STATISTICS;  

ANALYZE TABLE GROUPER_PIT_ATTR_DEF_NAME COMPUTE STATISTICS;    

ANALYZE TABLE GROUPER_PIT_ATTR_DEF_NAME_SET COMPUTE STATISTICS;

ANALYZE TABLE GROUPER_PIT_FIELDS COMPUTE STATISTICS;           

ANALYZE TABLE GROUPER_PIT_GROUPS COMPUTE STATISTICS;           

ANALYZE TABLE GROUPER_PIT_GROUP_SET COMPUTE STATISTICS;        

ANALYZE TABLE GROUPER_PIT_MEMBERS COMPUTE STATISTICS;           

ANALYZE TABLE GROUPER_PIT_MEMBERSHIPS COMPUTE STATISTICS;      

ANALYZE TABLE GROUPER_PIT_ROLE_SET COMPUTE STATISTICS;         

ANALYZE TABLE GROUPER_PIT_STEMS COMPUTE STATISTICS;            

ANALYZE TABLE GROUPER_ROLE_SET COMPUTE STATISTICS;             

ANALYZE TABLE GROUPER_STEMS COMPUTE STATISTICS;                

ANALYZE TABLE GROUPER_TYPES COMPUTE STATISTICS;                 

 

 

 

 

From: [mailto:] On Behalf Of Tim Darby
Sent: Wednesday, November 14, 2012 1:36 PM
To:
Subject: [grouper-users] Grouper UI search performance

 

In 2.1.2, when I use the search tool and specify the Group Source Adapter as the data source, the response is very slow and sometimes times out.  This is using an Oracle 11g database as the source.  I have a 1.5.3 instance to compare with and the response there is fine.  I'm only using indexes created by the installer and they appear to be OK. Also, these two instances are pointed to the same database server, but different databases obviously. Can you point me to where I should look for the problem?

Tim Darby
The University of Arizona
Mosaic, Systems Integration and Architecture

UITS, Rm 335, 520-626-3799

 

 

 


  • RE: [grouper-users] Grouper UI search performance, Chris Hyzer, 12/12/2012

Archive powered by MHonArc 2.6.16.

Top of Page