Skip to Content.
Sympa Menu

grouper-users - RE: [grouper-users] "cursor" based paging

Subject: Grouper Users - Open Discussion List

List archive

RE: [grouper-users] "cursor" based paging


Chronological Thread 
    < Chronological >      < Thread >
  • From: "Hyzer, Chris" <>
  • To: "Gettes, Michael" <>
  • Cc: " Mailing List" <>
  • Subject: RE: [grouper-users] "cursor" based paging
  • Date: Wed, 4 Dec 2019 18:46:38 +0000
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=isc.upenn.edu; dmarc=pass action=none header.from=isc.upenn.edu; dkim=pass header.d=isc.upenn.edu; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=7ShI4t29fA0WCbX1D64QeClhWMuY0sVNtlAnWBr5eNk=; b=XQWQo/rrmJDI4+zVSU5lCMarNRhT1b+LMZwIgE02LgPVKVsJWaMDHgqLk0Ryd6bNBtWZrMkAHzjoKiNJDkBKlqxyIltla3pPaEOmSzpS2tYRSfwKsoNkRDzlhtiQetFIOmspYVLppkPvr8RWxKzBCrROBIL5dzpLkE9ajosV4JsxqcHKg3kBtgdjqofKbQoWYINu756fTBqGIQ7IThg2x5NoaUHs8UfrQ+qwgPC5w6wsOEIrdHtpqpq/0y6RbsY+2o1+0fZfzpdnELH6WxvGDYVJ0FlV4yLIL8ReghY5JD6c2kW5HXU09nAu8Pt17cV+DLqCXLi6X7CYHoLn5S6M4Q==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=TU6MkDteEKY/IvKooe2GhmJD1/0WLUZwKbKdT/6jUfzo++dp9P44DsDd5x2JhRC1GbGWb9uwBBkndzcIMJMaES/4krf5AJb8mjGmSyWHLV1Eo/BjM3tWojhItJl5suvY2zR+8D4GW0+KaOl0E//HcSH5BmzTbflASHsrbQH04N3dKl6uEhneeoMKaZRwLnpxcTDGiEq8i4NuABqRodnH+OvwlT4sD2kswjJ0Yv2Eygz6+Yz0Ki+eFcg6QDz/mcviCAWYapUYutwjzagVwRapyJMPYNZQpcLMLOvwIjBzXTWVphg6y02iUZaeByGehQFGWbm1YAijZCQQ24+9YJKSAw==

It wouldn’t affect that speed but we should fix that.

 

Its slow because:

 

  1. The query (shouldn’t be too slow)
  2. -or- Resolving all of the subjects (maybe we need caching changes?  Maybe we need more things in member table to display subjects without resolving?)
  3. -or- Maybe not display members by default of large groups because who cares to look at first page of 500k group?  Maybe display immediate only if there are only a few groups in the group?
  4. -or- Maybe display the page and get the member list in ajax so you don’t have to wait for it?

 

From: Gettes, Michael <>
Sent: Wednesday, December 04, 2019 11:17 AM
To: Hyzer, Chris <>
Cc: Mailing List <>
Subject: Re: [grouper-users] "cursor" based paging

 

Will this paging be implemented for the UI so opening a 500K member group in the UI could be instantaneous?

 

/mrg



On Dec 1, 2019, at 10:16 PM, Hyzer, Chris <> wrote:

 

[External Email]

The paging in Grouper has been about pageSize and pageNumber and cycling through records.

 

If you page through a large dataset, if the records change while you are paging through, you can get inconsistent results.

 

However, if pass in the last id (or whatever you are sorting on), and ask for a page starting after that record (what we are calling “cursor-paging”), then you will not miss records as they change while the paging is occurring.  Note, no database or memory actual cursors are being used here.

 

This has been implemented in the 2.5 branch and will be in the WS in 2.5.

 

 

Does that make sense?  Anyone interested in a particular use case?

 

For our box implementation we download the box users with netIDs.  Which is getting 70k subjects and resolving them I believe.  The WS call times out sometimes so maybe we should do something like this.  Other ideas?  😊

 

Thanks!

Chris

 


Archive powered by MHonArc 2.6.19.

Top of Page