Portkey

Portkey AI is a production-grade AI gateway and control panel that enables developers and organizations to access, manage, and monitor over 1,600 large language models (LLMs) from various providers through a unified API. It offers features like reliability, observability, guardrails, governance, and prompt management.

Use tool

Pricing

Developer

$/mo

Requests per Month: 10K
Overage: No Overage Allowed
AI Gateway: Universal API, Automatic Fallbacks, Loadbalancing, Automatic Retries, Request Timeouts, Automatic user attribution, Config Management, Virtual Keys & Key Management (With Budgeting support)
Simple Caching: 1 Day TTL Support
Observability: Logs, Privacy Mode, Traces, Feedback, Custom Metadata, Filters
Retention Period (Observability): 3 Days
Prompt Management: Upto 3 Templates, Playground, API Deployment, Versioning, Variable Management
Guardrails: Limited Access Eval Templates, Antonomous Fine-Tune, Continuous Improvement
Community Support

Production

$/mo

Includes all core features from the Developer plan
Requests per Month: 100K
Overage: $9/Month for Every 100K Up to 3M Requests
Simple Caching: Unlimited TTL Stream from Cache
Semantic Caching: Unlimited TTL Stream from Cache
Support for AWS, GCP, Azure Private LLM Deployments
Observability: Alerts
Retention Period (Observability): 30 Days
Prompt Management: Unlimited Templates
Guardrails: Unlimited Eval Templates
Security & Compliance: Advanced Role Based Access Control
Security & Compliance: Advanced Team Management
Production Support

Enterprise

$/mo

Includes all features from the Production plan
Requests per Month: Custom
Overage: Custom Pricing
Retention Period (Observability): Custom
Security & Compliance: SSO with Okta Auth
Security & Compliance: SOC2, ISO27001, GDPR, HIPAA Compliance Certificates
Security & Compliance: PII Anonymizer
Security & Compliance: BAA Signing for Compliances
Security & Compliance: VPC Managed Hosting
Security & Compliance: Private Tenancy
Security & Compliance: Configurable Retention Periods
Security & Compliance: Configurable exports to datalakes
Security & Compliance: Org Management
Support: Dedicated Onboarding & Priority Support

Open Source

$/mo

Requests per Month: No Limit
Overage: No Overage Allowed
AI Gateway: Universal API, Automatic Fallbacks, Loadbalancing, Automatic Retries, Request Timeouts, Automatic user attribution, Config Management, Virtual Keys & Key Management (With Budgeting support)
Simple Caching: 1 Day TTL Support
Observability: Logs, Privacy Mode, Traces, Feedback, Custom Metadata, Filters
Retention Period (Observability): 3 Days
Prompt Management: Prompt Templates, Playground, API Deployment, Versioning, Variable Management
Guardrails: Eval Templates, Antonomous Fine-Tune, Continuous Improvement
Community Support

Details

Pricing Tier

Freemium

Sponsor

Ad space