grouper-users - Re: [grouper-users] PIT table issue prevents changelog temp to changelog
Subject: Grouper Users - Open Discussion List
List archive
- From: Shilen Patel <>
- To: Scott Koranda <>
- Cc: grouper-users <>
- Subject: Re: [grouper-users] PIT table issue prevents changelog temp to changelog
- Date: Fri, 18 Jan 2019 21:49:23 +0000
- Accept-language: en-US
- Authentication-results: mail-gw.oit.duke.edu; spf=none ; dmarc=none
- Ironport-phdr: 9a23:cdFDvRD3BWGllaMYGoCzUyQJP3N1i/DPJgcQr6AfoPdwSPT4ocbcNUDSrc9gkEXOFd2Cra4c26yO6+jJYi8p2d65qncMcZhBBVcuqP49uEgeOvODElDxN/XwbiY3T4xoXV5h+GynYwAOQJ6tL1LdrWev4jEMBx7xKRR6JvjvGo7Vks+7y/2+94fcbglUhzexe69+IAmrpgjNq8cahpdvJLwswRXTuHtIfOpWxWJsJV2Nmhv3+9m98p1+/SlOovwt78FPX7n0cKQ+VrxYES8pM3sp683xtBnMVhWA630BWWgLiBVIAgzF7BbnXpfttybxq+Rw1DWGMcDwULs5Qiqp4bt1RxD0iScHLz85/3/Risxsl6JQvRatqwViz4LIfI2ZMfxzdb7fc9wHX2pMRsZfWTJcDIOgYYUBDOQBMuRWoIn8u1QAohSxCBKwBOz0zz9EmmP60Lc43uknDArI3BYgH9ULsHnMsdv1NKYSUeSrw6nO0D7NdelZ2Svj54jMbxsspuqMXbJxccrV10YvERjIgUiNqYzmITyZzPoCvHWG7+d5U++klm0pqxlprzSyxsoglJPFi4wPxlzZ9ih0xJw5KcOmREN/edKoDZlduz+AO4Z0Tc4uWXxktDomxrEcpJK2cjUGxIwpxxHBaPGLb42F7xf+WOuSOzh1hndodbKxihuz7Eetz+3xWdWw3VtPtCVJjsLDumwL2hfO8MaIUOF98V2k2TuX1wDc9OVEIUcsmKreMZEhw7owmoMcsUXNByP6hkv7gLWRdkUl5uik8fnoYqjlppCCLYN7lBzxMrk2lsy+B+Q3LBQOUnCG9em8yrHv50P0TK9XgvA1lqTVqo7WKdofq6KhBg9ayIcj6xKxDze819QYmGEKLElFeBKGi4jmJVfOLevlAveigFSjji1nyO7bMb38GpnNNGTMkK/9fbZh7E5R0AUzzcpY55JJErEOPujzVlbstNzDEBA5KRe0zv3jCNV8zYMeRXmPDrGDPKPTt1+I+vwgI/OKZIALpDbxNeIp6ODzgn8kyhchevyS1pwLdDibGe5vJUmQKS73gdAbGGEGtyIxSeXrjBuJVjsFNFioWKdp3TE6DI+gRb/KWo2pyOia3Ca/E5t+an1FBxaBHWq+JNbMYOsFdC/HepwpqTcDT7X0DtZ5jUv05gbn17pqKPbV8SQEtJXlkcJ4/PDXiQptq25xBsWZlm6SCWZ1giUEWjw7mq1zvB8YqDaYyaYthfteGJRI4u9RFAIzNJrS1et/XsvyWwbMeP+FVVWrBNiqHGJULLM9xtYUaBN7HNOvgw==
- Spamdiagnosticmetadata: NSPM
- Spamdiagnosticoutput: 1:99
OK great.
The only thing that should be inserting to those table is that daemon job.
So I don’t know how you got duplicates in there. And even if you had
multiple instances of the job running at the same time somehow, the
transactions in the database should have still prevented the duplicates.
What database are you using? If you look at your loader logs
(grouper_loader_log) during the time when that member was created, do you see
any signs that multiple instances of CHANGE_LOG_changeLogTempToChangeLog were
running at the same time?
Thanks!
- Shilen
On 1/18/19, 3:51 PM, "Scott Koranda"
<>
wrote:
Hi,
> I wonder if you have more duplicates.
Running
new
edu.internet2.middleware.grouper.misc.SyncPITTables().processAllDuplicates()
showed
Hib3PITGroupSetDAO: Searching for point in time duplicates
Found 29 entries that have duplicates in point in time.
I then wrote some SQL to query for the rows with the correct
sourceId(s), find the id(s), and delete the rows for the
grouper_pit_group_set table. The deletions worked where the row did not
have a foreign key and failed when there was a foreign key. Each
sourceId had 2 and not more than 2 entries.
After that I ran
new
edu.internet2.middleware.grouper.misc.SyncPITTables().processAllDuplicates()
again and this time it processed updated without any errors.
I was then able to run
loaderRunOneJob("CHANGE_LOG_changeLogTempToChangeLog");
Can you provide any insights into how the duplicates came to be in the
PIT tables?
This Grouper deployment is not especially unique or large. It is
manipulated through Grouper WS calls and occasionally through the UI.
The WS calls simply add or remove subjects from groups and occasionally
create groups. There are no loader jobs other than running the PSPNG.
Thanks,
Scott K
- [grouper-users] PIT table issue prevents changelog temp to changelog, Scott Koranda, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Shilen Patel, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Scott Koranda, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Shilen Patel, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Scott Koranda, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Shilen Patel, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Scott Koranda, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Shilen Patel, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Scott Koranda, 01/21/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Shilen Patel, 01/22/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Scott Koranda, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Shilen Patel, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Scott Koranda, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Shilen Patel, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Scott Koranda, 01/18/2019
- Re: [grouper-users] PIT table issue prevents changelog temp to changelog, Shilen Patel, 01/18/2019
Archive powered by MHonArc 2.6.19.