Grouper Call March 8, 2017
Attending: Chris Hyzer (chair), Shilen Patel, Jim Fox, Bert Bee-LIndgren, Emily Eisbruch
New Action Items
[AI] (Chris) will look at grouper-misc TIER instrumentation collector and then share with Shilen the Grouper instrumentation work that Chris initiated.
[AI] (Chris) ask about TIER collector production in March 8, 2017 TIER Component architects call.
[AI] (Shilen) add to instrumentation wiki steps for adding a new count (such as for provisioning data)
[AI] (Bert) create wiki page on the Groups that require members work- GRP-1376
Older Action Items
[AI] (Chris) update the penn pspng script to include attribute names
[AI] (Chris) status page for pspng (Gettes email)
https://grouperdemo.internet2.edu/grouper_v2_3/status?diagnosticType=all
https://spaces.at.internet2.edu/display/Grouper/Grouper+diagnostics
[AI] (Chris) update diagnostics to have apache config for authentication
[AI] (Bert) full sync runs but status in grouper loader log is not set to SUCCESS (Gettes email)
Changelog temp to change log speed
[AI] (Bert) Paul Engle, 2/16, pspng and user defined attributes [GRP-1495]
[AI] (Chris) clarify that the subject description should standalone since it is displayed by itself
[AI] (Bert) Marwan shahar and deleting groups in pspng? (2/20?)
[AI] (Chris) 2/20 : Liam Hoekenga, inherited privileges. Do they work for existing objects?
[AI for Bert]: get back to Akki Kumar about when groups that require a member will be implemented, GRP-1376: PSPNG: Support groups that require a member
[AI] (Chris) Chad Redman 2/22: 2 issues: The source ID drop down list doesn't really show the "IDs" Also order seems random, so it takes a while to find the right source.
[AI] (Chris) Chad Redman: GRP-1489: Can't type multiple lines in Add Members copy/paste
[AI] (Chris) 2/23 Yoann Delattre: null pointer on privileges
[AI] (Bert) 2/23 Paul Engle: pspng authoritative all values of attribute
[AI] (Bert) 2/23 Julio Macavilca: malformed DN
[AI] (Chris) 2/24: Jeff Mccollough The second issue is a redirect to the home screen if group creation is cancelled. It should be leaving the browser at the same level of view it had before the group creation screen is shown.
[AI] (Bert) 2/27: Paul Engle, I was excited when the grouper_loader_log seemed to indicate that the job finished in an hour or so. Less so once I looked at the log and realized it was actually still running its worker threads... :
[AI (Chris) GRP-1483 - ehcache large file sizes
[AI (Chris) GRP-1480 - users with admin priv can't remove group via subject page
[AI] (Chris) GRP-1484: grouper subject api diagnostics can see if subjects are ordered correctly on search (Chris to do by next wed)
[AI (Bert) to follow up with Martin Krenn on ldap passwords externalized
[AI (Bert) document the findings here somewhere on wiki]Grouper and openldap for large groups
[AI] (Chris) add TIER API to the Grouper download page and do testing
[AI] (Chris) patches for accessibility
[AI] ( Chris) check member table to see if subject ID matches (Lookup a subject. Get the identifier. Look up by that identifier. Make sure you get the subject with the right ID and identifier.)
[AI] (Bert) look at subject ID and subject Identifier terms and text on source diagnostics screen
-- https://spaces.at.internet2.edu/display/Grouper/Grouper+subject+API+diagnostics+in+UI
[AI ] (Chris) GrouperSystem in another source (WS)
[AI] (Bert) reply to Chris Sutherin UMBC on pspng examples
[AI] (Bert) reply to Scott Koranda about massaging group names in provisioning
[AI] (Bert) to ply to Shaun K about name null in pspng
[AI] (Bert) to reply to Peter St Onge
[AI ] (Chris) get Grouper installer working for mysql and postgres
[AI ] (Chris), making delete group more efficient for large groups, fix issue with not allowed to delete group (email tues 1/17)
[AI] (Bert) Jeffrey Crawford email 1/12, full sync missing members
[AI] (Bert) Scott Koranda email 1/12, error on change log consumer psp
[AI] Chris share Grouper Apereo training info on the Grouper lists when that info is public
[AI] (Bert) email the list about (a small) Office365 versus Dropbox and next PSP project
[AI] (Bert) document how to build PSP NG and patch it [Bert needs to finish last couple steps] (AI for Chris to try it afterwards) [Done, Bert’s updated the doc]
[AI] (Chris/Bert) put “make_patch” command in github (Done) Bert will update the doc
[AI] (Bert) Put these in jira: Grace Periods, Membership Rules, People/Account subjects
[AI] (Bert) document the solution to “turn off old psp issue” that was raised on the list
[AI] (Bert) create PSP-NG Training Video (after necessary patches) using Camtasia
[AI] (Chris) make sure GrouperSystem can’t exist in other sources for WS
Completed Action Items
[AI] (Shilen) send WAR to Marwan/Pregash (DONE)
[AI] (Shilen) to send instrumentation info to dev list: (DONE) ]https://spaces.at.internet2.edu/display/Grouper/Grouper+instrumentation
[AI] (Shilen) 2/24 email from Jeff Mccollough about delete member performance (DONE)
[AI] (Shilen) multiple nodes loader, needs to check if job is still running (DONE)
Discussion
Current work tasks
Vivek – Attestation
Misagh – on hold
Chris – loader in UI , deprovisioning (https://spaces.at.internet2.edu/display/Grouper/Grouper+deprovisioning), patches
Bert – PSPNG
- Changelog consumers can report inserts/deletes/unresolvable subjects, etc for each batch
- Working on groups that require members and testing that.
- Groups without members get created at last second and deleted when empty.
- Handling of fake members is part of this.
- Will be a patch.
GRP-1376 - Groups that require members
[AI] Bert will create wiki page on the Groups that require members work- GRP-1376
Shilen – instrumentation https://spaces.at.internet2.edu/display/Grouper/Grouper+instrumentation
- Hope that Shib will collect data using similar format.
- Show on Grouper UI the data that’s collected and sent to TIER? Seems reasonable.
- Defaults are for collection increments to be hourly and database flushing also hourly.
- TIER Daemon would be daily. By default 30 days worth would be kept in database.
- These specs would be configurable.
- End time or duration for each row would be helpful.
- Could start this collection process within Grouper until such time as TIER is ready to consume.
- Adding the instrumentation data to the new Grouper UI would be very helpful. Will go in this direction.
[AI] (Chris) will look at grouper-misc tier instrumentation collector and then share with Shilen the Grouper instrumentation work that Chris initiated.
[AI] (Chris) ask about TIER collector production in March 8, 2017 TIER Component architects call.
[AI] (Shilen) add to instrumentation wiki steps for adding a new count (such as for provisioning data)
Note that Grouper Loader Log table in database also tracks this provisioning data. Useful to track this. TIER collector could mine this data and report it
GrouperLoaderType.java
hib3GrouploaderLog.setInsertCount(subjectsToAdd.size());
hib3GrouploaderLog.setDeleteCount(membersToRemove.size());
hib3GrouploaderLog.setStatus(status.name());
//take out the job status
hib3GrouploaderLog.setJobMessage(jobMessage.toString());
TIER Grouper deployment guide,
The community is encouraged to provide feedback during the consultation period of March 17 - April 17, 2017
Issue roundup
· Recursive privilege change (only works on new objects?) (already an AI for Chris )
· Gettes, pspng on multiple hosts?
· Grouper deployment guide beta - Consultation for TIER Grouper Deployment Guide
· Instrumentation and counts
· API authz discussions on TIER api list
· Grouper subject description UI
· Custom attribute in ui and loader
· Org chart discussion
· How to know what a group is authorized to do
· I2midev machines
· (GRP-1492) multiple nodes loader - needs to check if job is still running
· Org structure without members (what to do?)
· (GRP-1493) GoogleAppsChangeLogConsumer.java logs with the wrong class name
· Attribute framework in UI
· Bert - Global Summit
2017 Global Summit
Grouper BOF at 2017 Global Summit, Tuesday, April 25
Next Grouper Call: Wed March 22, 2017