Internet2 is collaborating with Portkey on service evaluation of their AI gateway.
What is an AI Gateway:
An AI Gateway is a specialized interface that facilitates the integration and interaction between large language models and various applications or systems. It serves as a middleware layer that manages the communication, data processing, and execution of language model capabilities.
Why a NET+ Service Evaluation:
Higher Education institutions and Organizations often need to leverage the capabilities of various publicly available large language models (LLMs) for different tasks such as learning management systems, natural language understanding, sentiment analysis, and data analytics, etc. However, integrating and managing multiple LLMs can be complex and resource intensive. An AI Gateway that connects to all publicly available LLMs can simplify this process, providing a unified interface for seamless interaction with these models.
Service Evaluation
The Internet2 NET+ team is facilitating a NET+ service evaluation for Portkey's AI Gateway which is currently in progress.
Status by Category
Status Indicator
% Complete
Status
Initiation
G
100%
SEV team / SP Portkey weekly meeting cadence
Functional Assessment
G
25%
Test environments provisioned. NYU shared list of functional requirements during implementation. Review documented use cases, and add any other use cases put forth by the community.
Security
G
25%
SOC1/SOC2 and Incident Response documentation review in progress. HECVAT in Progress. (University of Washington)
Accessibility
G
25%
VPAT In Progress, functional accessibility testing (University of Washington, UC Berkeley)
Identity Integration
G
25%
InCommon Federation in progress
Network Integration
G
0%
Business & Legal
G
25%
Facilitation Agreement and Customer Agreement in progress. (NYU, Princeton, University of Washington, UC Berkeley, Lehigh University)