Skip to Content.
Sympa Menu

grouper-users - Re: [grouper-users] PIT table issue prevents changelog temp to changelog

Subject: Grouper Users - Open Discussion List

List archive

Re: [grouper-users] PIT table issue prevents changelog temp to changelog


Chronological Thread 
  • From: Shilen Patel <>
  • To: Scott Koranda <>
  • Cc: grouper-users <>
  • Subject: Re: [grouper-users] PIT table issue prevents changelog temp to changelog
  • Date: Fri, 18 Jan 2019 21:49:23 +0000
  • Accept-language: en-US
  • Authentication-results: mail-gw.oit.duke.edu; spf=none ; dmarc=none
  • Ironport-phdr: 9a23:cdFDvRD3BWGllaMYGoCzUyQJP3N1i/DPJgcQr6AfoPdwSPT4ocbcNUDSrc9gkEXOFd2Cra4c26yO6+jJYi8p2d65qncMcZhBBVcuqP49uEgeOvODElDxN/XwbiY3T4xoXV5h+GynYwAOQJ6tL1LdrWev4jEMBx7xKRR6JvjvGo7Vks+7y/2+94fcbglUhzexe69+IAmrpgjNq8cahpdvJLwswRXTuHtIfOpWxWJsJV2Nmhv3+9m98p1+/SlOovwt78FPX7n0cKQ+VrxYES8pM3sp683xtBnMVhWA630BWWgLiBVIAgzF7BbnXpfttybxq+Rw1DWGMcDwULs5Qiqp4bt1RxD0iScHLz85/3/Risxsl6JQvRatqwViz4LIfI2ZMfxzdb7fc9wHX2pMRsZfWTJcDIOgYYUBDOQBMuRWoIn8u1QAohSxCBKwBOz0zz9EmmP60Lc43uknDArI3BYgH9ULsHnMsdv1NKYSUeSrw6nO0D7NdelZ2Svj54jMbxsspuqMXbJxccrV10YvERjIgUiNqYzmITyZzPoCvHWG7+d5U++klm0pqxlprzSyxsoglJPFi4wPxlzZ9ih0xJw5KcOmREN/edKoDZlduz+AO4Z0Tc4uWXxktDomxrEcpJK2cjUGxIwpxxHBaPGLb42F7xf+WOuSOzh1hndodbKxihuz7Eetz+3xWdWw3VtPtCVJjsLDumwL2hfO8MaIUOF98V2k2TuX1wDc9OVEIUcsmKreMZEhw7owmoMcsUXNByP6hkv7gLWRdkUl5uik8fnoYqjlppCCLYN7lBzxMrk2lsy+B+Q3LBQOUnCG9em8yrHv50P0TK9XgvA1lqTVqo7WKdofq6KhBg9ayIcj6xKxDze819QYmGEKLElFeBKGi4jmJVfOLevlAveigFSjji1nyO7bMb38GpnNNGTMkK/9fbZh7E5R0AUzzcpY55JJErEOPujzVlbstNzDEBA5KRe0zv3jCNV8zYMeRXmPDrGDPKPTt1+I+vwgI/OKZIALpDbxNeIp6ODzgn8kyhchevyS1pwLdDibGe5vJUmQKS73gdAbGGEGtyIxSeXrjBuJVjsFNFioWKdp3TE6DI+gRb/KWo2pyOia3Ca/E5t+an1FBxaBHWq+JNbMYOsFdC/HepwpqTcDT7X0DtZ5jUv05gbn17pqKPbV8SQEtJXlkcJ4/PDXiQptq25xBsWZlm6SCWZ1giUEWjw7mq1zvB8YqDaYyaYthfteGJRI4u9RFAIzNJrS1et/XsvyWwbMeP+FVVWrBNiqHGJULLM9xtYUaBN7HNOvgw==
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99

OK great.

The only thing that should be inserting to those table is that daemon job.
So I don’t know how you got duplicates in there. And even if you had
multiple instances of the job running at the same time somehow, the
transactions in the database should have still prevented the duplicates.
What database are you using? If you look at your loader logs
(grouper_loader_log) during the time when that member was created, do you see
any signs that multiple instances of CHANGE_LOG_changeLogTempToChangeLog were
running at the same time?

Thanks!

- Shilen

On 1/18/19, 3:51 PM, "Scott Koranda"
<>
wrote:

Hi,

> I wonder if you have more duplicates.

Running

new
edu.internet2.middleware.grouper.misc.SyncPITTables().processAllDuplicates()

showed

Hib3PITGroupSetDAO: Searching for point in time duplicates
Found 29 entries that have duplicates in point in time.

I then wrote some SQL to query for the rows with the correct
sourceId(s), find the id(s), and delete the rows for the
grouper_pit_group_set table. The deletions worked where the row did not
have a foreign key and failed when there was a foreign key. Each
sourceId had 2 and not more than 2 entries.

After that I ran

new
edu.internet2.middleware.grouper.misc.SyncPITTables().processAllDuplicates()

again and this time it processed updated without any errors.

I was then able to run

loaderRunOneJob("CHANGE_LOG_changeLogTempToChangeLog");

Can you provide any insights into how the duplicates came to be in the
PIT tables?

This Grouper deployment is not especially unique or large. It is
manipulated through Grouper WS calls and occasionally through the UI.
The WS calls simply add or remove subjects from groups and occasionally
create groups. There are no loader jobs other than running the PSPNG.

Thanks,

Scott K





Archive powered by MHonArc 2.6.19.

Top of Page