Page History

Core web service API

...

Grouper Web Services

...

Grouper Web Services

Image Added

...

Introduction

Grouper web services (grouper-ws) is a J2EE web application which exposes common Grouper business logic through SOAP and REST.  See Web Services FAQ. and architectural diagram.

To deploy the services, download the warfile and configure the property files (e.g. subject sources, databases, logging, etc).  Configure authentication.

Note: there is a command line and java API web service client called Grouper Client

...

1. Understand the object model.  All grouper-ws services are operations based on simple data structures.  The structures support Strings, ints, arrays, and structure references.
   1. Core web service API
   2. Example structure (only "getters" and "setters" are applicable properties)
   3. Each operation has many samples (authmated captures, versioned, and up to date).  Here is an example
   4. Most options has a sensible default (e.g. MemberFilter defaults to All members)
   5. Lookup objects in various (consistent) ways.  e.g. to delete a group, you can pass the name or uuid of the group.
2. Decide if you are using SOAP or REST (this is real REST, not Axis HTTP/XML)
   1. Both SOAP and REST support the same API
3. Inside SOAP and REST, each operation has two levels of complexity, the normal one, and the Lite one.
   1. Normal operation: can usually be batched (support a list of inputs, e.g. add multiple groups at once), supports complex inputs (arrays or structures)
   2. Lite operation: supports only inputs of scalars (no structures, no arrays... only Strings, ints, etc).  In REST this also means that the request can be sent via query string only
4. If SOAP:
   1. Implement based on WSDL.  Note, you cant get the 1.4 WSDL out of a 2.0 server, since it has backwards compatible changes from 1.5 and 1.6.  You could get this 1.4 WSDL from SVN though...

1. 1. Note, if your servlet is not grouperWs (e.g. grouper-ws) then adjust accordingly.
   2. There is a sample Java client with sample calls
2. If REST:
   1. Decide what format you want to send and receive data.  grouper-ws supports XHTML, XML, and JSON, as well as query strings for input (in URL or message body)
   2. For example, in the URL you can set the content type you want back:

/grouper-ws/servicesRest/xml/v2_1_000/groups/aStem%3AaGroup/members/10021368
/grouper-ws/servicesRest/json/v2_1_000/groups/aStem%3AaGroup/members/10021368
/grouper-ws/servicesRest/xhtml/v2_1_000/groups/aStem%3AaGroup/members/10021368

1. 1. Or you can set the content type of the request and it will use that for the response
   2. There are many samples
2. Understand versioning

https://spaces.at.internet2.edu/confluence/download/attachments/3014660/webServicePresentation.pptPresentation about Grouper web services

.NET client development guide

PHP client development guide

...

• addMember: assign a member to a group
  • If already a member, that is ok
  • Accepts batches of members (non-Lite)
  • Accepts flag to say that any members not in batch should be removed (e.g. replace list)
• deleteMember: unassign a member from a group
  • If not a member, that is ok
  • Accepts batches of members (non-Lite)
• Get Members: return the members (including subject data) in a group (from direct or indirect membership)
  • Will accept member filter (All, Effective, Immediate, Composite)
  • Accepts batches of groups (non-Lite)
• getMemberships
  • Will accept member filter (All, Effective, Immediate, Composite)
  • Accepts batches of subjects and groups (non-Lite)
• hasMember: see if a subject is a member of a group
  • Will return true or false
  • Accepts batches of subject ids or identifers (returns batches of true's / false's) (non-Lite)
  • Will accept member filter (All, Effective, etc)
  • Can query on field (permission)
• getGroups: list groups for a subject
  • Will accept member filter (All, Effective, etc)
  • Accepts batches of subjects (non-Lite)
• groupSave
  • Create / update a group
  • Accepts batches of groups (non-Lite)
• groupDelete
  • Delete a group
  • Accepts batches of groups (non-Lite)
• getGrouperPrivileges
  • View privileges (many combinations of input are acceptable)
  • Can view all privileges for the subject, group, stem, specific privilege and combinations thereof
• assignGrouperPrivileges
  • Add or remove a privilege for a subject and (group or stem)
  • Will not fail if the privilege is already assigned or revoked
• findGroups
  • Can query for groups based on name, uuid, parent stem, or a substring query
  • Can create complex queries with group match (AND, OR, MINUS) (non-Lite)
• findStems
  • Can query for stems based on name, uuid, parent stem, or a substring query
  • Can create complex queries with group match (AND, OR, MINUS) (non-Lite)
• findAttributeDefNames
  • Can query for attributeDefNames/permissionNames based on name, uuid, inheritance, or a substring query
  • Can sort/page
• stemSave
  • Create / update a stem
  • Accepts batches of stems (non-Lite)
• stemDelete
  • Delete a stem
  • Accepts batches (non-Lite)
• memberChangeSubject
  • Change the subject of a current member
  • Accepts batches (non-Lite)
• assignAttributes
  • Assign or remove attributes (new attribute framework) from groups, stems, memberships, members, assignments, etc
  • Accepts batches (non-Lite)
  getAttributeAssignments
• assignAttributesBatch
  • Assign or remove attributes
  • Retrieves attribute assignments (new attribute framework) from groups, stems, memberships, members, assignments, etc
  • Batch or Lite
  • in a batch which allows more options for batch assignments than the non-lite "assignAttributes"
  • There is no Lite option for assignAttributesBatch since you can use the Lite version of assignAttributes
• getAttributeAssignments
  • Retrieves attribute assignments (new attribute framework) from groups, stems, memberships, members, assignments, etc
  • Batch or Lite
• assignPermissions
  assignPermissions
  • Assign or remove permissions from roles or individual subjects (in the context of a role)
  • Batch or Lite
  • getPermissionAssignments
    • Retrieves permission assignments from roles or individual subjects (in the context of a role)
    • Batch or Lite
  • Get Subjects
    • Lookup or search for subjects and attributes
    • Batch or Lite
  • attributeDefNameSave
    • Create / update an attributeDefName
    • Accepts batches of attributeDefNames (non-Lite)
  • attributeDefNameDelete
    • Delete an attributeDefName
    • Accepts batches of attributeDefNames lookups (non-Lite)
  • getAuditEntries
    • Get audit entries
    • Batch or Lite

  Features

  • API
    • Batched operations (e.g. add 100 subjects to a group at once).  There is a separate server-side max-in-batch param in the grouper-ws.properties.
    • Transaction support (if any fails in one batch request, rollback all in that single batch request)
  • Authentication
    • Let container or web server handle
      o   PKI
      o   http-simple-auth
      o   Source IP address filtering (TODO)
    • Custom authenticator
    • WS-Security
      o   PKI
      o   Kerberos
    • LDAP authn
    • Proxying. The web service can execute operations based on an underlying user, not the authenticating user.  Note the authenticating user must have appropriate permissions
  • Error Handling
    • Error codes and error messages are sent in responses, as well as warnings.  In batched mode, batches of response codes are returned.  In REST, the http status code is used as well.
  • Clients
    • Grouper will provide a quick start with Java, and it is up to users to create their own clients.  The SOAP and REST are based on the HTTP documents, so any programming language will work
  • Web Service Implementation
    • Apache Axis for SOAP, and home-grown for REST
  • JSONP is supported, see this jira

  ...

  Note the WS is included in the Grouper Installer.  Checkout the appropriate projects under grouper-ws, read the README.txt in the grouper-ws/grouper-ws cvs directory

  Build Script

  Note the WS is included in the Grouper Installer.  (it will build and configure it). The build script for grouper-ws is pretty basic.  Generally just do the default (dist).  There is also an "ant grouper" target to build a new grouper jar, and "ant quick" to do everything but generate the Axis files (takes 3 minutes).

  ...

  Add a new servlet filter mapping in the web.xml

  Code Block
  <filter-mapping>     <filter-name>Grouper logging filter</filter-name>     <url-pattern>/*</url-pattern> </filter-mapping>

  Set the filter logger to log at debug level

  Code Block
  log4j.logger.edu.internet2.middleware.grouper.ws.j2ee.ServletFilterLogger = DEBUG

  You will see log entries like thismight want to log to a dedicated file instead of putting in the grouper log...

  Code Block

  log4j.appender.grouper_ws = org.apache.log4j.DailyRollingFileAppender log4j.appender.grouper_ws.File = ${grouper.home}logs/grouper_ws.log log4j.appender.grouper_ws.DatePattern = '.'yyyy-MM-dd log4j.appender.grouper_ws.MaxBackupIndex = 30 log4j.appender.grouper_ws.layout = org.apache.log4j.PatternLayout log4j.appender.grouper_ws.layout.ConversionPattern = %d{ISO8601}: %m%n # daemon log log4j.logger.edu.internet2.middleware.grouper.ws.j2ee.ServletFilterLogger = DEBUG, grouper_ws log4j.additivity.edu.internet2.middleware.grouper.ws.j2ee.ServletFilterLogger = false

  
  

  You will see log entries like this

  Code Block
  Code Block
  2012-05-03 09:13:18,575: [http-8088-1] DEBUG ServletFilterLogger.logStuff(98) -  - IP: 127.0.0.1, url: /grouperWs/servicesRest/v2_1_001/groups/aStem%3AaGroup/members, queryString: null, method: PUT, content-type: text/x-json; charset=UTF-8 request params: request body: {"WsRestAddMemberRequest":{"actAsSubjectLookup":{"subjectId":"GrouperSystem"},"replaceAllExisting":"F","subjectLookups":[{"subjectId":"10021368"},{"subjectId":"10039438"}]}} respone headers: (note, not all headers captured, and not in this order) X-Grouper-resultCode: SUCCESS X-Grouper-success: T X-Grouper-resultCode2: NONE HTTP/1.1 201 Content-Type: text/x-json; charset=UTF-8 response: {"WsAddMemberResults":{"responseMetadata":{"millis":"237","serverVersion":"2.1.1"},"resultMetadata":{"resultCode":"SUCCESS","resultMessage":"Success for: clientVersion: 2.1.1, wsGroupLookup: WsGroupLookup[pitGroups=[],groupName=aStem:aGroup], subjectLookups: Array size: 2: [0]: WsSubjectLookup[subjectId=10021368]\n[1]: WsSubjectLookup[subjectId=10039438]\n\n, replaceAllExisting: false, actAsSubject: WsSubjectLookup[subjectId=GrouperSystem], fieldName: null, txType: NONE, includeGroupDetail: false, includeSubjectDetail: false, subjectAttributeNames: null\n, params: null\n, disabledDate: null, enabledDate: null","success":"T"},"results":[{"resultMetadata":{"resultCode":"SUCCESS_ALREADY_EXISTED","success":"T"},"wsSubject":{"id":"10021368","name":"10021368","resultCode":"SUCCESS","sourceId":"jdbc","success":"T"}},{"resultMetadata":{"resultCode":"SUCCESS_ALREADY_EXISTED","success":"T"},"wsSubject":{"id":"10039438","name":"10039438","resultCode":"SUCCESS","sourceId":"jdbc","success":"T"}}],"wsGroupAssigned":{"description":"a group description","displayExtension":"a group","displayName":"a stem:a group","extension":"aGroup","name":"aStem:aGroup","typeOfGroup":"group","uuid":"d9094e4a7c6e4f399d7e1489c875b9f0"}}}

  ...

  See the always available client for more info on this slide

  Children pages

  Children Display

  To do's (post 1.6.0)

  1. add logging filter
  2. fix javadoc warnings
  3. look into axis2 1.5, see if error fixed, see if samples/wsdl changes
  4. add move subject service
  5. improve auto-toString methods in resultMessage
  6. look at acegi
  7. add ip source filtering to grouper

  ...