Welcome

Internet2 is collaborating with Portkey on service evaluation of their AI gateway. 

What is an AI Gateway:

An AI Gateway is a specialized interface that facilitates the integration and interaction between large language models and various applications or systems. It serves as a middleware layer that manages the communication, data processing, and execution of language model capabilities.

Why a NET+ Service Evaluation:

Higher Education institutions and Organizations often need to leverage the capabilities of various publicly available large language models (LLMs) for different tasks such as learning management systems, natural language understanding, sentiment analysis, and data analytics, etc. However, integrating and managing multiple LLMs can be complex and resource intensive. An AI Gateway that connects to all publicly available LLMs can simplify this process, providing a unified interface for seamless interaction with these models.


Service Evaluation

The Internet2 NET+ team is facilitating a NET+ service evaluation for Portkey's AI Gateway which is currently in progress.

Status by CategoryStatus Indicator% Complete

Status

InitiationG100%

SEV team / SP Portkey weekly meeting cadence

Functional AssessmentG25%Test environments provisioned.  NYU shared list of functional requirements during implementation.  Review documented use cases, and add any other use cases put forth by the community. 
SecurityG25%SOC1/SOC2 and Incident Response documentation review in progress.  HECVAT in Progress.  (University of Washington)
AccessibilityG25%VPAT In Progress, functional accessibility testing (University of Washington, UC Berkeley) 
Identity IntegrationG25%

InCommon Federation in progress 

Network IntegrationG0%

Business & Legal

G25%

Facilitation Agreement and Customer Agreement in progress.  (NYU, Princeton, University of Washington, UC Berkeley, Lehigh University)

AI Gateway Service Evaluation Participation

  • New York University (Sponsor)
  • Cornell University
  • Harvard University
  • Princeton University
  • University of California Berkeley 
  • University of Washington
  • Lehigh University

Questions?



 




  • No labels