# Portkey Docs

> Comprehensive documentation for Portkey's AI Gateway, Guardrails, Observability, Prompts, and Governance features.

## Docs

- [What is Portkey?](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/introduction/what-is-portkey.md): Portkey AI is a comprehensive platform designed to stream…
- [Make Your First Request](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/introduction/make-your-first-request.md): Integrate Portkey and analyze your first LLM call in 2 mi…
- [Portkey Features](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/introduction/feature-overview.md): Explore the powerful features of Portkey
- [Observability (OpenTelemetry)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability.md): Gain real-time insights, track key metrics, and streamlin…
- [OpenTelemetry for LLM Observability](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/opentelemetry.md): Leverage OpenTelemetry with Portkey for comprehensive LLM…
- [Supported OTel Libraries](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/opentelemetry/list-of-supported-otel-instrumenters.md): Portkey works with any OpenTelemetry-compatible instrumen…
- [Logs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/logs.md): The Logs section presents a chronological list of all the…
- [Tracing](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/traces.md): The **Tracing** capabilities in Portkey empowers you to m…
- [Analytics](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/analytics.md)
- [Feedback](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/feedback.md): Portkey's Feedback APIs provide a simple way to get weigh…
- [Metadata](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/metadata.md): Add custom context to your AI requests for better observa…
- [Filters](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/filters.md)
- [Logs Export](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/logs-export.md): Easily access your Portkey logs data for further analysis…
- [Model Pricing and Cost Management](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/cost-management.md): Learn how Portkey handles pricing data, cost calculations…
- [Budget Limits](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/budget-limits.md)
- [Auto-Instrumentation [BETA]](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/observability/auto-instrumentation.md): Portkey's auto-instrumentation allows you to instrument t…
- [AI Gateway](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway.md): The world's fastest AI Gateway with advanced routing & in…
- [Universal API](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/universal-api.md): Portkey's Universal API provides a consistent interface t…
- [Configs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/configs.md): This feature is available on all Portkey plans.
- [Remote MCP](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/remote-mcp.md): Portkey's AI gateway has MCP server support that many fou…
- [Conditional Routing](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/conditional-routing.md)
- [Multimodal Capabilities](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/multimodal-capabilities.md)
- [Image Generation](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/multimodal-capabilities/image-generation.md): Portkey's AI gateway supports image generation capabiliti…
- [Function Calling](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/multimodal-capabilities/function-calling.md): Portkey's AI Gateway supports function calling capabiliti…
- [Vision](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/multimodal-capabilities/vision.md): Portkey's AI gateway supports vision models like GPT-4V b…
- [Text-to-Speech](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/multimodal-capabilities/text-to-speech.md): Portkey's AI gateway currently supports text-to-speech mo…
- [Speech-to-Text](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/multimodal-capabilities/speech-to-text.md): Portkey's AI gateway supports STT models like Whisper by…
- [Thinking Mode](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/multimodal-capabilities/thinking-mode.md)
- [Cache (Simple & Semantic)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/cache-simple-and-semantic.md)
- [Fallbacks](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/fallbacks.md)
- [Automatic Retries](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/automatic-retries.md): LLM APIs often have inexplicable failures. With Portkey,…
- [Circuit Breaker](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/circuit-breaker.md): Configure per-strategy circuit protection and failure han…
- [Realtime API](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/realtime-api.md): Use OpenAI's Realtime API with logs, cost tracking, and m…
- [Load Balancing](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/load-balancing.md): Load Balancing feature efficiently distributes network tr…
- [Canary Testing](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/canary-testing.md): You can use Portkey's AI gateway to also canary test new…
- [Strict OpenAI Compliance](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/strict-open-ai-compliance.md)
- [Virtual Keys](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/virtual-keys.md): Portkey's virtual key system allows you to securely store…
- [Budget Limits](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/virtual-keys/budget-limits.md): Budget Limits lets you set cost limits on providers/integ…
- [Rate Limits](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/virtual-keys/rate-limits.md): Set Rate Limts to your Integrations/Providers
- [Connect Bedrock with Amazon Assumed Role](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/virtual-keys/bedrock-amazon-assumed-role.md): How to create a new integration for Bedrock using Amazon…
- [Request Timeouts](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/request-timeouts.md): Manage unpredictable LLM latencies effectively with Portk…
- [Files](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/files.md): Upload files to Portkey and reuse the content in your req…
- [Unified Batch Inference](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/batches.md): Run large‑scale inference jobs through one consistent end…
- [Fine-tuning](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/ai-gateway/fine-tuning.md): Run your fine-tuning jobs with Portkey Gateway
- [Model Catalog](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/model-catalog.md): A single pane to view and manage every AI provider and mo…
- [Integrations](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/model-catalog/integrations.md): Securely store and manage AI provider credentials across…
- [Budget Limits](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/model-catalog/budget-limits.md)
- [Rate Limits](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/model-catalog/rate-limits.md)
- [Workspace Provisioning](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/model-catalog/workspace-provisioning.md)
- [AI Model Provisioning](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/model-catalog/model-provisioning.md)
- [Adding Custom Models](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/model-catalog/custom-models.md): Learn how to add custom and fine-tuned models to your Por…
- [Overriding Model Details](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/model-catalog/model-overrides.md): Learn how to set custom pricing for any base model in you…
- [Connect Bedrock with Amazon Assumed Role](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/model-catalog/connect-bedrock-with-amazon-assumed-role.md): How to create an integrate Bedrock using Amazon Assumed R…
- [MCP Gateway](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/mcp-gateway.md): The universal adapter for Model Context Protocol—connect…
- [Quickstart](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/mcp-gateway/quickstart.md)
- [Architecture](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/mcp-gateway/architecture.md)
- [Deployment](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/mcp-gateway/deployment.md)
- [MCP Hub](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/mcp-gateway/mcp-hub.md): Portkey's MCP Hub to connect 1600+ LLMs with any Remote M…
- [MCP Clients](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/mcp-gateway/mcp-clients.md)
- [Prompt Engineering Studio](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/prompt-engineering-studio.md)
- [Prompt Playground](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/prompt-engineering-studio/prompt-playground.md)
- [Prompt Library](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/prompt-engineering-studio/prompt-library.md)
- [Prompt Versioning & Labels](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/prompt-engineering-studio/prompt-versioning.md)
- [Prompt Observability](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/prompt-engineering-studio/prompt-observability.md)
- [Prompt Partials](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/prompt-engineering-studio/prompt-partial.md): With Prompt Partials, you can save your commonly used tem…
- [Prompt API](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/prompt-engineering-studio/prompt-api.md): Learn how to integrate Portkey's prompt templates directl…
- [Tool Library](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/prompt-engineering-studio/tool-library.md)
- [Integrations](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/prompt-engineering-studio/prompt-integration.md)
- [Guides](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/prompt-engineering-studio/prompt-guides.md): Learn how to get the most out of Portkey Prompts with the…
- [Guardrails](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/guardrails.md): Ship to production confidently with Portkey Guardrails on…
- [List of Guardrail Checks](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/guardrails/list-of-guardrail-checks.md)
- [Guardrails for Embedding Requests](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/guardrails/embedding-guardrails.md): Apply security and data validation measures to vector emb…
- [Creating Raw Guardrails (in JSON)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/guardrails/creating-raw-guardrails-in-json.md): With the raw Guardrails mode, we let you define your Guar…
- [PII Redaction](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/guardrails/pii-redaction.md): Replace any sensitive data in requests with standard iden…
- [Bring Your Own Guardrails](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/bring-your-own-guardrails.md): Integrate your custom guardrails with Portkey using webho…
- [MCP](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/mcp.md)
- [Enforcing Request Metadata](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/enforcing-request-metadata.md)
- [Enforcing Org Level Guardrails](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/enforce-orgnization-level-guardrails.md)
- [Enforcing Workspace Level Guardrails](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/enforce-workspace-level-guardials.md)
- [Configure Request Logging](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/configuring-request-logging.md): Control what data is stored for all LLM requests in your…
- [Enforcing Default Configs on API Keys](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/enforce-default-config.md): Learn how to attach default configs to API keys for enfor…
- [Enforce Budget Limits and Rate Limits for Your API Keys](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/enforce-budget-and-rate-limit.md): Configure budget and rate limits on API keys to effective…
- [Enforce Workspace Budget and Rate Limits](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/enforce-workspace-budget-limts-and-rate-limits.md): Configure budget and rate limits at the workspace level t…
- [Configure Logs Access Permissions for Workspace](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/configure-logs-access-permissions-in-workspace.md)
- [Configure Virtual Key Access Permission for Workspaces](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/configure-virtual-key-access-permissions.md)
- [Configure API Key Access Permissions for Workspaces](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/configure-api-key-access-permissions.md)
- [Configure Workspace Provisioning for Your AI Integrations](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/configure-workspace-provisioning-for-your-ai-integrations.md)
- [Configure Model Access Permissioning for AI Integrations](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/configure-model-access-permissioning-for-ai-integratinon.md)
- [Enforce Rate Limits on Your AI Provider](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/enforce-rate-limits-on-your-ai-provider.md)
- [Enforce Budget Limits on Your AI Provider](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/administration/enforce-budget-limits-on-your-ai-provider.md)
- [Enterprise Offering](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering.md)
- [Org Management](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/org-management.md): A high-level introduction to Portkey's organization manag…
- [Organizations](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/org-management/organizations.md): Understand the role and features of Organizations, the hi…
- [Workspaces](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/org-management/workspaces.md): Explore Workspaces, the sub-organizational units that ena…
- [User Roles & Permissions](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/org-management/user-roles-and-permissions.md): Learn about Portkey's comprehensive role-based access con…
- [API Keys (AuthN and AuthZ)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/org-management/api-keys-authn-and-authz.md): Discover how Admin and Workspace API Keys are used to man…
- [JWT Authentication](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/org-management/jwt.md): Configure JWT-based authentication for your organization…
- [Overview](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/org-management/scim/scim.md): SCIM integration with Portkey.
- [Azure Entra](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/org-management/scim/azure-ad.md): Setup Azure Entra for SCIM provisioning with Portkey.
- [Okta](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/org-management/scim/okta.md): Set up Okta for SCIM provisioning with Portkey.
- [SSO](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/org-management/sso.md): SSO support for enterprises
- [Access Control Management](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/access-control-management.md): With customizable user roles, API key management, and com…
- [Budget Limits](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/budget-limits.md)
- [Security @ Portkey](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/security-portkey.md): Portkey AI provides a secure, reliable AI gateway for the…
- [OTel Integration (Analytics Data)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/analytics-logs-export.md)
- [Logs Export](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/logs-export.md)
- [Audit Logs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/audit-logs.md): Track and monitor all administrative activities across yo…
- [Enterprise Components](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/components.md)
- [KMS Integration](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/enterprise-offering/kms.md): Customers can bring their own encryption keys to Portkey…
- [Open Source](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/open-source.md)
- [Feature Comparison](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/product/product-feature-comparison.md): Comparing Portkey's Open-source version and Dev, Pro, Ent…
- [Enterprise Architecture](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/self-hosting/hybrid-deployments/architecture.md): Comprehensive guide to Portkey's hybrid deployment archit…
- [EKS](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/self-hosting/hybrid-deployments/aws/eks.md): This enterprise-focused document provides comprehensive i…
- [AWS Marketplace](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/self-hosting/hybrid-deployments/aws/marketplace.md): This enterprise-focused document provides comprehensive i…
- [GCP](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/self-hosting/hybrid-deployments/gcp.md): This enterprise-focused document provides comprehensive i…
- [Azure](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/self-hosting/hybrid-deployments/azure.md): This enterprise-focused document provides comprehensive i…
- [Prometheus Metrics](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/self-hosting/prometheus-metrics.md): Comprehensive monitoring and observability for Portkey En…
- [Upgrade to Model Catalog](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/support/upgrade-to-model-catalog.md): Learn how to upgrade to Model Catalog to replace Virtual…
- [How to Contribute](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/README.md)
- [Contact Us](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/support/contact-us.md)
- [Developer Forum](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/support/developer-forum.md): Are you navigating the challenging journey of transitioni…
- [Common Errors & Resolutions](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/support/common-errors-and-resolutions.md): Since Portkey functions as a gateway - you may encounter…
- [December '23 Migration](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/support/portkeys-december-migration.md)
- [Integrations](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/ecosystem.md)
- [Submit an Integration](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/partner.md)
- [Overview](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms.md): Portkey connects with all major LLM providers and orchest…
- [OpenAI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/openai.md): Learn to integrate OpenAI with Portkey, enabling seamless…
- [Structured Outputs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/openai/structured-outputs.md): Structured Outputs ensure that the model always follows y…
- [Prompt Caching](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/openai/prompt-caching-openai.md)
- [Files](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/openai/files.md): Upload files to OpenAI
- [Batches](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/openai/batches.md): Perform batch inference with OpenAI
- [Fine-tune](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/openai/fine-tuning.md): Fine-tune your models with OpenAI
- [Remote MCP Support](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/openai/remote-mcp.md)
- [Anthropic](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/anthropic.md)
- [Prompt Caching](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/anthropic/prompt-caching.md)
- [Computer use tool](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/anthropic/computer-use.md)
- [Remote MCP Support](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/anthropic/remote-mcp.md)
- [Count Tokens](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/anthropic/count-tokens.md)
- [Google Gemini](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/gemini.md)
- [Google Vertex AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/vertex-ai.md)
- [Files](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/vertex-ai/files.md): Upload files to Google Cloud Storage for Vertex AI fine-t…
- [Batches](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/vertex-ai/batches.md): Perform batch inference with Vertex AI
- [Fine-tune](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/vertex-ai/fine-tuning.md): Fine-tune your models with Vertex AI
- [Controlled Generations](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/vertex-ai/controlled-generations.md): Controlled Generations ensure that the model always follo…
- [Embeddings](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/vertex-ai/embeddings.md): Get embeddings from Vertex AI
- [Azure AI Foundry](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/azure-foundry.md): Learn how to integrate Azure AI Foundry with Portkey to a…
- [Azure OpenAI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/azure-openai/azure-openai.md): Azure OpenAI is a great alternative to accessing the best…
- [Fine-tune](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/azure-openai/fine-tuning.md): Fine-tune your models with Azure OpenAI
- [Files](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/azure-openai/files.md): Upload files to Azure OpenAI
- [Batches](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/azure-openai/batches.md): Perform batch inference with Azure OpenAI
- [AWS Bedrock](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/bedrock/aws-bedrock.md)
- [Files](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/bedrock/files.md): Upload files to S3 for Bedrock batch inference
- [Batches](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/bedrock/batches.md): Perform batch inference with Bedrock
- [Fine-tune](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/bedrock/fine-tuning.md): Fine-tune your models with Bedrock
- [Prompt Caching on Bedrock](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/bedrock/prompt-caching.md)
- [Embeddings](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/bedrock/embeddings.md): Get embeddings from Bedrock
- [AWS Bedrock Knowledge Bases](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/bedrock/bedrock-knowledgebase.md): Create, manage, and connect your LLMs to organizational d…
- [AWS SageMaker](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/aws-sagemaker.md): Route to your AWS Sagemaker models through Portkey
- [Ollama](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/ollama.md)
- [LocalAI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/local-ai.md)
- [vLLM](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/vllm.md): Integrate vLLM-hosted custom models with Portkey and take…
- [Triton](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/triton.md): Integrate Trtiton-hosted custom models with Portkey and t…
- [AI21](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/ai21.md)
- [Anyscale](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/anyscale-llama2-mistral-zephyr.md): Integrate Anyscale endpoints with Portkey seamlessly and…
- [Cerebras](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/cerebras.md)
- [Cohere](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/cohere.md)
- [Fireworks](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/fireworks.md)
- [Files](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/fireworks/files.md): Upload files to Fireworks
- [Fine-tune](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/fireworks/fine-tuning.md): Fine-tune your models with Bedrock
- [Dashscope](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/dashscope.md): Integrate Dashscope with Portkey for seamless completions…
- [Deepinfra](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/deepinfra.md)
- [Deepbricks](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/deepbricks.md): Portkey provides a robust and secure gateway to facilitat…
- [Deepgram](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/deepgram.md): Portkey provides a robust and secure gateway to use and o…
- [DeepSeek](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/deepseek.md): Portkey provides a robust and secure gateway to facilitat…
- [Github](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/github.md)
- [Groq](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/groq.md)
- [Hugging Face](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/huggingface.md)
- [Inference.net](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/inference.net.md): Portkey provides a robust and secure gateway to facilitat…
- [Featherless AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/featherless.md)
- [Jina AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/jina-ai.md)
- [Lambda Labs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/lambda.md): Integrate Lambda with Portkey AI for seamless completions…
- [Lemonfox-AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/lemon-fox.md): Integrate LemonFox with Portkey for seamless completions,…
- [Lepton AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/lepton.md)
- [Lingyi (01.ai)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/lingyi-01.ai.md)
- [Mistral AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/mistral-ai.md)
- [Monster API](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/monster-api.md): MonsterAPIs provides access to generative AI model APIs a…
- [Moonshot](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/moonshot.md)
- [Ncompass](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/ncompass.md)
- [Nomic](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/nomic.md)
- [Nscale (EU Sovereign)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/nscale.md)
- [Novita AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/novita-ai.md)
- [Nebius](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/nebius.md)
- [OpenRouter](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/openrouter.md)
- [Perplexity AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/perplexity-ai.md)
- [Predibase](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/predibase.md)
- [Reka AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/reka-ai.md)
- [Recraft AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/recraft-ai.md)
- [SambaNova](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/sambanova.md): Portkey provides a robust and secure gateway to facilitat…
- [Segmind](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/segmind.md)
- [Snowflake Cortex](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/snowflake-cortex.md)
- [Stability AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/stability-ai.md)
- [SiliconFlow](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/siliconflow.md)
- [Together AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/together-ai.md)
- [Upstage AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/upstage.md): Integrate Upstage with Portkey AI for seamless completion…
- [Voyage AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/voyage-ai.md): Portkey provides a robust and secure gateway to facilitat…
- [Workers AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/workers-ai.md)
- [xAI (Grok)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/x-ai.md): Portkey supports xAI's chat completions, completions, and…
- [ZhipuAI / ChatGLM / BigModel](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/zhipu.md)
- [Replicate](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/replicate.md)
- [Suggest a new integration!](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/suggest-a-new-integration.md)
- [Bring Your Own LLM](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/llms/byollm.md): Integrate your privately hosted LLMs with Portkey for uni…
- [Microsoft Azure](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/cloud/azure.md): Discover how you can build your Gen AI platform on Azure…
- [Aporia](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/aporia.md)
- [Acuvity](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/acuvity.md): Acuvity is model agnostic GenAI security solution. It is…
- [Azure Guardrails](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/azure-guardrails.md): Integrate Microsoft Azure's powerful content moderation s…
- [AWS Bedrock Guardrails](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/bedrock-guardrails.md): Secure your AI applications with AWS Bedrock's guardrail…
- [Lasso Security](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/lasso.md): Lasso Security protects your GenAI apps from data leaks,…
- [Mistral](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/mistral.md): Mistral moderation service helps detect and filter harmfu…
- [Pangea](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/pangea.md): Pangea AI Guard helps analyze and redact text to prevent…
- [Patronus AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/patronus-ai.md): Patronus excels in industry-specific guardrails for RAG w…
- [Palo Alto Networks Prisma AIRS](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/palo-alto-panw-prisma.md): Comprehensive AI security platform providing runtime prot…
- [Pillar](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/pillar.md)
- [Prompt Security](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/prompt-security.md): Prompt Security detects and protects against prompt injec…
- [Javelin](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/javelin.md): Javelin provides comprehensive AI security guardrails inc…
- [Replace Custom Regex Patterns](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/guardrails/regex.md): Redact custom patterns with Regex in Portkey.
- [Exa Online Search](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/plugins/exa.md): Transform offline LLMs into online models with real-time…
- [Milvus](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/vector-databases/milvus.md)
- [Qdrant](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/vector-databases/qdrant.md)
- [Overview](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents.md): Portkey helps bring your agents to production
- [OpenAI Agents SDK (Python)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/openai-agents.md): Use Portkey with OpenAI Agents SDK to take your AI Agents…
- [OpenAI Agents SDK (TypeScript)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/openai-agents-ts.md): Use Portkey with OpenAI Agents SDK to take your AI Agents…
- [Autogen](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/autogen.md): Use Portkey with Autogen to take your AI Agents to produc…
- [Agno AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/agno-ai.md): Use Portkey with Agno to build production-ready autonomou…
- [Control Flow](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/control-flow.md): Use Portkey with Control Flow to take your AI Agents to p…
- [CrewAI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/crewai.md): Use Portkey with CrewAI to take your AI Agents to product…
- [Langchain Agents](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/langchain-agents.md)
- [Langroid](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/langroid.md)
- [LangGraph](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/langgraph.md): Use Portkey with LangGraph to take your AI agent workflow…
- [LiveKit](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/livekit.md): Build production-ready voice AI agents with Portkey's ent…
- [Llama Agents by Llamaindex](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/llama-agents.md): Use Portkey with Llama Agents to take your AI Agents to p…
- [OpenAI Swarm](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/openai-swarm.md): The Portkey x Swarm integration brings advanced AI gatewa…
- [Pydantic AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/pydantic-ai.md): Use Portkey with PydanticAI to take your AI Agents to pro…
- [Phidata](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/phidata.md): Use Portkey with Phidata to take your AI Agents to produc…
- [Strands Agents](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/strands.md): Use Portkey with AWS's Strands Agents to take your AI Age…
- [Bring Your own Agents](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/agents/bring-your-own-agents.md): You can also use Portkey if you are doing custom agent or…
- [Overview](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/ai-apps.md)
- [AnythingLLM](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/anythingllm.md): Add usage tracking, cost controls, and security guardrail…
- [Claude Code](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/claude-code.md): Integrate Portkey with Claude Code for enterprise-grade A…
- [Anthropic Computer Use](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/anthropic-computer-use.md)
- [Cline](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/cline.md): Add enterprise-grade observability, cost tracking, and go…
- [Cursor](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/cursor.md): Learn how to integrate Portkey's enterprise features with…
- [Langflow](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/langflow.md): Add enterprise-grade features to your Langflow AI workflo…
- [Goose](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/goose.md): Add usage tracking, cost controls, and security guardrail…
- [GitHub Copilot](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/github-copilot.md): Use Portkey with GitHub Copilot for centralized governanc…
- [Jan](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/janhq.md): Add usage tracking, cost controls, and security guardrail…
- [OpenAI Agent Builder (TS)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/openai-agent-builder.md): Use Portkey with OpenAI Agent Builder to add observabilit…
- [OpenAI Agent Builder (Python)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/openai-agent-builder-python.md): Use Portkey with OpenAI Agent Builder to add observabilit…
- [LibreChat](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/librechat.md): Cost tracking, observability, and more for LibreChat
- [Web Search for Any LLM in LibreChat](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/librechat-web-search.md)
- [Open WebUI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/openwebui.md): Enterprise-grade cost tracking, observability, and more f…
- [Image Genration with OpenWebUI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/openwebui/image-generation-with-openwebui.md)
- [n8n](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/n8n.md): Add usage tracking, cost controls, and security guardrail…
- [OpenAI Codex CLI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/codex.md): Add usage tracking, cost controls, and security guardrail…
- [Roo Code](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/roo-code.md): Add enterprise-grade observability, cost tracking, and go…
- [Zed](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/zed.md): Learn how to integrate Portkey's enterprise features with…
- [Overview](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries.md)
- [Autogen (DEPRECATED)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/autogen.md): AutoGen is a framework that enables the development of LL…
- [DSPy](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/dspy.md): Integrate DSPy with Portkey for production-ready LLM pipe…
- [Instructor](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/instructor.md): With Portkey, you can confidently take your Instructor pi…
- [Langchain (Python)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/langchain-python.md): Supercharge Langchain apps with Portkey: Multi-LLM, obser…
- [Langchain (JS/TS)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/langchain-js.md): Portkey adds core production capabilities to any Langchai…
- [LlamaIndex (Python)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/llama-index-python.md): The **Portkey x LlamaIndex** integration brings advanced…
- [Promptfoo](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/promptfoo.md): Portkey brings advanced **AI gateway** capabilities, full…
- [Vercel](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/vercel.md): Integrate Portkey with Vercel AI SDK for production-ready…
- [MindsDb](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/mindsdb.md): Integrate MindsDB with Portkey to build enterprise-grade…
- [ToolJet](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/tooljet.md): ToolJet is a low-code platform that lets you build apps b…
- [MongoDB](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/mongodb.md)
- [Supabase](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/supabase.md)
- [Portkey with Any OpenAI Compatible Project](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/openai-compatible.md): Learn how to integrate Portkey's enterprise features with…
- [Microsoft Semantic Kernel](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/libraries/microsoft-semantic-kernel.md)
- [Arize Phoenix](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/arize.md): Extend Portkey’s powerful AI Gateway with Arize Phoenix f…
- [Pydantic Logfire](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/logfire.md): Modern Python observability with automatic OpenAI instrum…
- [FutureAGI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/future-agi.md): Integrate FutureAGI with Portkey for automated LLM evalua…
- [Langfuse](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/langfuse.md): Integrate Langfuse observability with Portkey's AI gatewa…
- [Langsmith](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/langsmith.md): Integrate LangSmith observability with Portkey's AI gatew…
- [Phoenix(Arize) Open-Telemetry](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/phoenix.md): AI observability and debugging platform with OpenInferenc…
- [MLflow Tracing](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/ml-flow.md): Enhance LLM observability with automatic tracing and inte…
- [OpenLIT](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/openlit.md): Simplify AI development with OpenTelemetry-native observa…
- [OpenTelemetry Python SDK](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/opentelemetry-python-sdk.md): Direct OpenTelemetry instrumentation with full control ov…
- [HoneyHive](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/honeyhive.md): Integrate HoneyHive observability with Portkey's AI gatew…
- [Traceloop (OpenLLMetry)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/tracing-providers/traceloop.md)
- [Claude Desktop](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-clients/claude.md): Connect your MCP servers to Claude Desktop through Portke…
- [Cursor](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-clients/cursor.md): Connect your MCP servers to Cursor IDE through Portkey's…
- [LibreChat](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-clients/librechat.md): Connect your MCP servers to LibreChat through Portkey's s…
- [VS Code](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-clients/vs-code.md): Connect your MCP servers to Visual Studio Code through Po…
- [Claude Code](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-clients/claude-code.md): Connect your MCP servers to Claude Code CLI through Portk…
- [Postman MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/postman-mcp-server.md): The Postman MCP Server connects Postman to AI tools, enab…
- [Atlassian Remote MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/atlassian-mcp-server.md): The Atlassian Remote MCP Server is a cloud-based bridge b…
- [Datadog MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/datadog-mcp-server.md): The Datadog MCP server enables AI agents to interact with…
- [Figma MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/figma-mcp-server.md): The Figma MCP server connects Figma's design environment…
- [Firebase MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/firebase-mcp-server.md): The Firebase MCP server gives AI agents programmatic acce…
- [Firecrawl MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/firecrawl-mcp-server.md): The Firecrawl MCP server enables AI agents to perform web…
- [GitHub MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/github-mcp-server.md): The GitHub MCP server enables AI agents to safely interac…
- [Gitlab MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/gitlab-mcp-server.md): The GitLab MCP server enables AI agents to interact with…
- [Cerebras Code MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/cerebras-code-mcp-server.md): The **Cerebras Code MCP Server (v1.3.3)** integrates high…
- [Grafana MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/grafana-mcp-server.md): The Grafana MCP server enables AI agents to interact with…
- [Kubernetes MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/kubernetes-mcp-server.md): The Kubernetes MCP server provides a flexible Model Conte…
- [Linear MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/linear-mcp-server.md): The Linear MCP server provides a standardized interface f…
- [Notion MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/notion-mcp-server.md): The Notion MCP server enables AI agents to interact with…
- [Open Library MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/open-library-mcp-server.md): The Open Library MCP server provides AI agents with acces…
- [Playwright MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/playwright-mcp-server.md): The Playwright MCP server provides browser automation cap…
- [Qdrant MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/qdrant-mcp-server.md): The Qdrant MCP server enables AI agents to store and retr…
- [Stripe MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/stripe-mcp-server.md): The Stripe MCP server exposes Stripe's payments and billi…
- [Vectara MCP server](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/integrations/mcp-servers/vectara-mcp-server.md): The Vectara MCP server provides AI agents with access to…
- [Introduction](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/introduction.md): This documentation provides detailed information about th…
- [Supported Providers](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/supported-providers.md)
- [Authentication](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/authentication.md)
- [Headers](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/headers.md): Header requirements and options for the Portkey API
- [Errors](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/error-codes.md)
- [Response Schema](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/response-schema.md)
- [Gateway Config Object](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/config-object.md)
- [OpenAPI Specification](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/open-api-specification.md)
- [Supported SDKs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/sdk/list.md): Find the best way to use Portkey in your preferred langua…
- [Python](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/sdk/python.md): Official Portkey Python SDK to help take your AI apps to…
- [Node.js](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/sdk/node.md): Official Portkey Node.js SDK – robust, modern, and fully…
- [C# (.NET)](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/sdk/c-sharp.md): Integrate Portkey in your `.NET` app easily using the Ope…
- [Chat](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/chat.md)
- [Create a Response](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/responses/responses.md)
- [Get a Response](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/responses/retrieve-response.md)
- [Delete a Response](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/responses/delete-response.md)
- [List Input Items](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/responses/retrieve-inputs.md)
- [Prompt Completions](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/prompts/prompt-completion.md): Execute your saved prompt templates on Portkey
- [Prompt Render](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/prompts/render.md): Renders a prompt template with its variable values filled…
- [Insert a Log](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/data-plane/logs/insert-a-log.md): Submit one or more log entries
- [Create Feedback](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/data-plane/feedback/create-feedback.md): This endpoint allows users to submit feedback for a parti…
- [Update Feedback](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/data-plane/feedback/update-feedback.md): This endpoint allows users to update existing feedback.
- [Retrieve a Log Export](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/retrieve-a-log-export.md)
- [Update a Log Export](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/update-a-log-export.md)
- [List a Log Export](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/list-log-exports.md)
- [Create a Log Export](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/create-a-log-export.md)
- [Start a Log Export](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/start-a-log-export.md)
- [Cancel a Log Export](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/cancel-a-log-export.md)
- [Download a Log Export](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/data-plane/logs/log-exports-beta/download-a-log-export.md)
- [Embeddings](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/embeddings.md)
- [Create Image](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/images/create-image.md)
- [Create Image Edit](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/images/create-image-edit.md)
- [Create Image Variation](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/images/create-image-variation.md)
- [Models](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/models/models.md): Lists the currently available models that can be used thr…
- [Create Speech](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/audio/create-speech.md)
- [Create Transcription](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/audio/create-transcription.md)
- [Create Translation](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/audio/create-translation.md)
- [Gateway to Other APIs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/gateway-for-other-apis.md): Access any custom provider endpoint through Portkey API
- [Completions](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/completions.md)
- [Moderations](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/moderations.md)
- [Create Fine-tuning Job](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/fine-tuning/create-fine-tuning-job.md): Finetune a provider model
- [List Fine-tuning Jobs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/fine-tuning/list-fine-tuning-jobs.md)
- [Retrieve Fine-tuning Job](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/fine-tuning/retrieve-fine-tuning-job.md)
- [List Fine-tuning Events](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/fine-tuning/list-fine-tuning-events.md)
- [List Fine-tuning Checkpoints](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/fine-tuning/list-fine-tuning-checkpoints.md)
- [Cancel Fine-tuning](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/fine-tuning/cancel-fine-tuning.md)
- [Create Batch](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/batch/create-batch.md)
- [List Batch](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/batch/list-batch.md)
- [Retrieve Batch](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/batch/retrieve-batch.md)
- [Cancel Batch](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/batch/cancel-batch.md)
- [Upload File](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/files/upload-file.md)
- [List Files](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/files/list-files.md)
- [Retrieve File](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/files/retrieve-file.md)
- [Retrieve File Content](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/files/retrieve-file-content.md)
- [Delete File](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/files/delete-file.md)
- [Create Assistant](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/assistants/create-assistant.md)
- [List Assistant](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/assistants/list-assistants.md)
- [Retrieve Assistant](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/assistants/retrieve-assistant.md)
- [Modify Assistant](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/assistants/modify-assistant.md)
- [Delete Assistant](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/assistants/delete-assistant.md)
- [Create Thread](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/threads/create-thread.md)
- [Retrieve Thread](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/threads/retrieve-thread.md)
- [Modify Thread](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/threads/modify-thread.md)
- [Delete Thread](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/threads/delete-thread.md)
- [Create Message](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/messages/create-message.md)
- [List Message](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/messages/list-messages.md)
- [Retrieve Message](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/messages/retrieve-message.md)
- [Modify Message](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/messages/modify-message.md)
- [Delete Message](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/messages/delete-message.md)
- [Create Run](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/runs/create-run.md)
- [Create thread and Run](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/runs/create-thread-and-run.md)
- [list Run](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/runs/list-runs.md)
- [Retrieve Run](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/runs/retrieve-run.md)
- [Modify Run](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/runs/modify-run.md)
- [Submit Tool Outputs to Run](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/runs/submit-tool-outputs-to-run.md)
- [Cancel Run](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/runs/cancel-run.md)
- [List Run Steps](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/run-steps/list-run-steps.md)
- [Retrieve Run Steps](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/inference-api/assistants-api/run-steps/retrieve-run-steps.md)
- [Introduction](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/introduction.md): Manage your Portkey organization and workspaces programma…
- [Errors](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/error.md): Error codes returned by the Admin API and how to resolve…
- [Create Config](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/configs/create-config.md)
- [List Configs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/configs/list-configs.md)
- [Retrieve Config](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/configs/retrieve-config.md)
- [Update Config](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/configs/update-config.md)
- [Delete Config](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/configs/delete-config.md)
- [Create Integration](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/integrations/create-integration.md)
- [List Integrations](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/integrations/list-integrations.md)
- [Retrieve Integration](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/integrations/retrieve-integration.md)
- [Update Integration](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/integrations/update-integration.md)
- [Delete Integration](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/integrations/delete-integration.md)
- [List Model Access](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/integrations/models/list-model-access.md): Retrieves all model access for a specific integration wit…
- [Update Model Access](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/integrations/models/update-model-access.md): Updates model access, pricing configuration, and settings…
- [Delete Custom Model](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/integrations/models/delete-custom-model.md): Removes multiple custom models from an integration by the…
- [List Workspace Access](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/integrations/workspaces/list-workspace-access.md): Retrieves workspace access configuration for an integrati…
- [Update Workspace Access](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/integrations/workspaces/update-workspace-access.md): Updates workspace access permissions, usage limits, and r…
- [Create Provider](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/providers/create-provider.md)
- [List Providers](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/providers/list-providers.md)
- [Retrieve Provider](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/providers/retrieve-provider.md)
- [Update Provider](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/providers/update-provider.md)
- [Delete Provider](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/providers/delete-provider.md)
- [Create Virtual Key](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/virtual-keys/create-virtual-key.md)
- [List Virtual Key](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/virtual-keys/list-virtual-keys.md)
- [Retrieve Virtual Key](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/virtual-keys/retrieve-virtual-key.md)
- [Update Virtual Key](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/virtual-keys/update-virtual-key.md)
- [Delete Virtual Key](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/virtual-keys/delete-virtual-key.md)
- [Create Prompt](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/create-prompt.md)
- [List Prompts](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/list-prompts.md)
- [Retrieve Prompt](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/retrieve-prompt.md)
- [Update Prompt](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/update-prompt.md)
- [Delete Prompt](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/delete-prompt.md)
- [Publish Prompt](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/publish-prompt.md)
- [List Prompt Versions](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/list-prompt-versions.md)
- [Retrieve Prompt Version](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/retrieve-prompt-version.md)
- [Update Prompt Version](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/update-prompt-version.md)
- [Create Partial](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/create-partial.md)
- [List Partials](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/list-partials.md)
- [Retrieve Partial](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/retrieve-partial.md)
- [Update Partial](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/update-partial.md)
- [Delete Partial](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/delete-partial.md)
- [List Partial Versions](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/list-partial-versions.md)
- [Publish Partial](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/partials/publish-partial.md)
- [Create Label](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/labels/create-label.md): Creates a new label in the system
- [List Labels](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/labels/list-labels.md): Returns a list of labels based on filters
- [Retrieve Label](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/labels/retrieve-label.md): Returns a specific label by its ID
- [Update Label](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/labels/update-label.md): Updates an existing label
- [Delete Label](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/labels/delete-label.md): Deletes a label
- [Create Prompt Collection](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/collections/create-collection.md): Creates a new collection in the specified workspace
- [List Prompt Collections](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/collections/list-collections.md): Lists all collections in the specified workspace
- [Retrieve Prompt Collection](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/collections/retrieve-collection.md): Retrieves details of a specific collection
- [Update Prompt Collection](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/collections/update-collection.md): Updates a collection's details
- [Delete Prompt Collection](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/prompts/collections/delete-collection.md): Deletes a collection
- [Update API Key](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/api-keys/update-api-key.md)
- [Create API Key](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/api-keys/create-api-key.md)
- [Delete an API Key](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/api-keys/delete-an-api-key.md)
- [Retrieve an API Key](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/api-keys/retrieve-an-api-key.md)
- [List API Key](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/api-keys/list-api-keys.md)
- [Get User Grouped Data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/summary/get-all-cache-data.md)
- [Get Metadata Grouped Data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-metadata-grouped-data.md)
- [Get Model Grouped Data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-model-grouped-data.md)
- [Get User Grouped Data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-user-grouped-data.md)
- [Get cache hit latency data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cache-hit-latency-data.md)
- [Get cache hit rate data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cache-hit-rate-data.md)
- [Get cost data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cost-data.md)
- [Get error rate data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-error-rate-data.md)
- [Get errors data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-errors-data.md)
- [Get feedback data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-data.md)
- [Get feedback per ai models data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-per-ai-models-data.md)
- [Get feedback score distribution data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-score-distribution-data.md)
- [Get latency data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-latency-data.md)
- [Get requests data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-requests-data.md)
- [Get requests per user data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-requests-per-user-data.md)
- [Get rescued requests data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-rescued-requests-data.md)
- [Get status code data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-status-code-data.md)
- [Get tokens data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-tokens-data.md)
- [Get unique status code data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-unique-status-code-data.md)
- [Get users data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-users-data.md)
- [Get weighted feedback data](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-weighted-feedback-data.md)
- [Retrieve a user](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/users/retrieve-a-user.md)
- [Retrieve all users](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/users/retrieve-all-users.md)
- [Update a user](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/users/update-a-user.md)
- [Remove a user](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/users/remove-a-user.md)
- [Invite a User](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/user-invites/invite-a-user.md): Send an invite to user for your organization
- [Retrieve an user invite](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/user-invites/retrieve-an-invite.md)
- [Retrieve all user invite](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/user-invites/retrieve-all-user-invites.md)
- [Delete a user invite](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/user-invites/delete-a-user-invite.md)
- [Resend a user invite](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/user-invites/resend-a-user-invite.md): Resend an invite to user for your organization
- [Create Workspace](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/workspaces/create-workspace.md)
- [Retrieve all Workspaces](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/workspaces/retrieve-all-workspaces.md)
- [Retrieve a Workspace](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/workspaces/retrieve-a-workspace.md)
- [Update Workspace](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/workspaces/update-workspace.md)
- [Delete a Workspace](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/workspaces/delete-a-workspace.md)
- [Add a Workspace Member](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/workspace-members/add-a-workspace-member.md)
- [Retrieve all Workspace Member](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/workspace-members/retrieve-all-workspace-members.md)
- [Retrieve a Workspace Member](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/workspace-members/retrieve-a-workspace-member.md)
- [Update Workspace Member](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/workspace-members/update-workspace-member.md)
- [Remove Workspace Member](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/workspace-members/remove-workspace-member.md)
- [List Audit Logs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/audit-logs/list-audit-logs.md)
- [Create Guardrail](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/guardrails/create-guardrail.md): Creates a new guardrail with specified checks and actions
- [List Guardrails](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/guardrails/list-guardrails.md): Retrieves a paginated list of guardrails for the specifie…
- [Retrieve Guardrail](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/guardrails/retrieve-guardrail.md): Retrieves details of a specific guardrail by ID or slug
- [Update Guardrail](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/guardrails/update-guardrail.md): Updates an existing guardrail's name, checks, or actions
- [Delete Guardrail](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/control-plane/guardrails/delete-guardrail.md): Deletes an existing guardrail
- [OpenAPI Specification](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/api-reference/admin-api/open-api-specification.md)
- [How to Run Structured Output Evals at Scale](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/run-batch-evals.md)
- [Building an LLM-as-a-Judge System for AI (Customer Support) Agent](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/prompts/llm-as-a-judge.md)
- [Prompts](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/prompts.md)
- [Ultimate AI SDR](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/prompts/ultimate-ai-sdr.md): Building a sophisticated AI SDR agent leveraging internet…
- [Build a chatbot using Portkey's Prompt Templates](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/prompts/build-a-chatbot-using-portkeys-prompt-templates.md): Portkey's prompt templates offer a powerful solution for…
- [Optimizing Prompts for Customer Support using Portkey | LLama Prompt Ops Integration](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/prompts/llama-prompts.md)
- [Executive Summary](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/executive-summary.md): Overview of LLM cost optimization and performance improve…
- [1. Introduction](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/introduction.md): An overview of the challenges and opportunities in LLM co…
- [2. Understanding LLM Cost Drivers](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/llm-cost-drivers.md): An overview of the factors that influence costs in Large…
- [3. FrugalGPT Techniques for Cost Optimization](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/frugalgpt-techniques.md)
- [4. Advanced Strategies for Performance Improvement](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/advanced-strategies.md)
- [5. Architectural Considerations](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/architectural-considerations.md)
- [6. Operational Best Pracitces](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/operational-best-practices.md)
- [7. Cost Effective Development Practices](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/cost-effective-development.md)
- [8. User Education and Change Management](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/user-education.md)
- [9. Future Trends in LLM Cost Optimization](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/future-trends.md)
- [10. Conclusion and Key Takeaways](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/whitepapers/optimizing-llm-costs/conclusion-and-key-takeaways.md): Summarizing the key strategies for LLM cost optimization…
- [Overview](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/getting-started.md)
- [A/B Test Prompts and Models](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/getting-started/a-b-test-prompts-and-models.md): A/B testing with large language models in production is c…
- [Tackling Rate Limiting](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/getting-started/tackling-rate-limiting.md): LLMs are **costly** to run. As their usage increases, the…
- [Function Calling](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/getting-started/function-calling.md): Get the LLM to interact with external APIs!
- [Image Generation](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/getting-started/image-generation.md)
- [Getting started with AI Gateway](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/getting-started/getting-started-with-ai-gateway.md)
- [Llama 3 on Groq](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/getting-started/llama-3-on-groq.md)
- [Return Repeat Requests from Cache](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/getting-started/return-repeat-requests-from-cache.md): If you have multiple users of your GenAI app triggering t…
- [Trigger Automatic Retries on LLM Failures](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/getting-started/trigger-automatic-retries-on-llm-failures.md)
- [101 on Portkey's Gateway Configs](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/getting-started/101-on-portkey-s-gateway-configs.md): You are likely familiar with how to make an API call to G…
- [Overview](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations.md)
- [Llama 3 on Portkey + Together AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/llama-3-on-portkey-+-together-ai.md): Try out the new Llama 3 model directly using the OpenAI S…
- [Introduction to GPT-4o](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/introduction-to-gpt-4o.md)
- [Anyscale](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/anyscale.md): Portkey helps bring Anyscale APIs to production with its…
- [Mistral](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/mistral.md): Portkey helps bring Mistral's APIs to production with its…
- [Vercel AI](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/vercel-ai.md): Portkey is a control panel for your Vercel AI app. It mak…
- [Deepinfra](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/deepinfra.md)
- [Groq](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/groq.md)
- [Langchain](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/langchain.md)
- [Mixtral 8x22b](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/mixtral-8x22b.md)
- [Segmind](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/segmind.md)
- [Sync Open WebUI Feedback → Portkey](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/integrations/openwebui-to-portkey.md): How to export thumbs-up/down from Open WebUI and ingest i…
- [Overview](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases.md)
- [Unified LLM API with Automatic Failover & Error Handling](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/enterprise-ready-unified-api.md): Build a single API interface with automatic failover and…
- [Multi-Tenant LLM Access with Enterprise Control for Customer-Facing Apps](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/multi-tenant-ai-feature.md)
- [Testing Application Resilience with Fallbacks](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/fallbacks-test.md)
- [How to use Portkey Guardrails for PII Protection](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/guardrail-pii-use-case.md): Portkey Guardrails is a powerful tool for protecting Pers…
- [Few-Shot Prompting](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/few-shot-prompting.md): LLMs are highly capable of following a given structure. B…
- [Enforcing JSON Schema with Anyscale & Together](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/enforcing-json-schema-with-anyscale-and-together.md): Get the LLM to adhere to your JSON schema using Anyscale…
- [Detecting Emotions with GPT-4o](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/emotions-with-gpt-4o.md)
- [Build an article suggestion app with Supabase pgvector, and Portkey](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/build-an-article-suggestion-app-with-supabase-pgvector-and-portkey.md): Consider that you have list of support articles that you…
- [Setting up resilient Load balancers with failure-mitigating Fallbacks](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/setting-up-resilient-load-balancers-with-failure-mitigating-fallbacks.md): Companies often face challenges of scaling their services…
- [Run Portkey on Prompts from Langchain Hub](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/run-portkey-on-prompts-from-langchain-hub.md): Writing the right prompt is often hard to get a quality L…
- [Smart Fallback with Model-Optimized Prompts](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/smart-fallback-with-model-optimized-prompts.md): Portkey can help you easily create fallbacks from one LLM…
- [How to use OpenAI SDK with Portkey Prompt Templates](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/how-to-use-openai-sdk-with-portkey-prompt-templates.md): Portkeys Prompt Playground allows you to test and tinker…
- [Setup OpenAI -> Azure OpenAI Fallback](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/setup-openai-greater-than-azure-openai-fallback.md): Portkey Fallbacks can automatically switch your app's req…
- [Fallback from SDXL to Dall-e-3](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/fallback-from-sdxl-to-dall-e-3.md): Generative AI models have revolutionized text generation…
- [Comparing Top10 LMSYS Models with Portkey](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/comparing-top10-lmsys-models-with-portkey.md)
- [Tracking LLM Costs Per User with Portkey](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/track-costs-using-metadata.md): Monitor and analyze user-level LLM costs across 1600+ mod…
- [Comparing DeepSeek Models Against OpenAI, Anthropic & More Using Portkey](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/deepseek-r1.md)
- [Portkey with OpenAI Computer Use](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/guides/use-cases/openai-computer-use.md): Leverage Portkey with OpenAI's Computer Use tool for auto…
- [September](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2025/september.md)
- [August](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2025/august.md)
- [July](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2025/july.md)
- [June](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2025/june.md)
- [May](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2025/may.md)
- [April](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2025/apr.md)
- [March](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2025/mar.md)
- [February](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2025/feb.md)
- [January](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2025/jan.md)
- [December](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2024/dec.md)
- [November](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2024/nov.md)
- [October](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/2024/oct.md)
- [Enterprise Gateway](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/enterprise.md)
- [Helm Chart](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/helm-chart.md)
- [Data Service](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/data-service.md)
- [Latest Updates](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/product.md)
- [Node.js](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/node-sdk-changelog.md)
- [Python](https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/changelog/python-sdk-changelog.md)

## OpenAPI Specs

- [openapi](https://raw.githubusercontent.com/Portkey-AI/openapi/refs/heads/master/openapi.yaml)