> ## Documentation Index
> Fetch the complete documentation index at: https://portkey-docs-mintlify-bedrock-guardrails-docs-36443.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Portkey connects with all major LLM providers and orchestration frameworks.

## Supported AI Providers

<CardGroup cols={3}>
  <Card title="OpenAI" href="/integrations/llms/openai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/open-ai.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=1bad4a989fbd014a4e96d665a6eb085e" alt="OpenAI" width="245" height="138" data-path="images/supported-llm/open-ai.avif" />
    </Frame>
  </Card>

  <Card title="Anthropic" href="/integrations/llms/anthropic">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/4-30rIA0OTIWFzdD/images/supported-llm/anthroic.avif?fit=max&auto=format&n=4-30rIA0OTIWFzdD&q=85&s=bdd0acf5000deba996d744756da157a2" alt="Anthropic" width="245" height="138" data-path="images/supported-llm/anthroic.avif" />
    </Frame>
  </Card>

  <Card title="Azure OpenAI" href="/integrations/llms/azure-openai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/microsoft-assure.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=2f6509de9985b567ecf3d7a740b103f0" alt="Azure OpenAI" width="245" height="138" data-path="images/supported-llm/microsoft-assure.avif" />
    </Frame>
  </Card>

  <Card title="AWS Bedrock" href="/integrations/llms/aws-bedrock">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/4-30rIA0OTIWFzdD/images/supported-llm/amazon.avif?fit=max&auto=format&n=4-30rIA0OTIWFzdD&q=85&s=ce8ddbf4a862bcbeae53e6df8478d509" alt="AWS Bedrock" width="245" height="138" data-path="images/supported-llm/amazon.avif" />
    </Frame>
  </Card>

  <Card title="Cerebras" href="/integrations/llms/cerebras">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/1G9bsW0hvqFKxIXh/images/llms/cerebras.avif?fit=max&auto=format&n=1G9bsW0hvqFKxIXh&q=85&s=3df40f47d50d81bab7e7a4d74a21c2d0" alt="Cerebras" width="770" height="480" data-path="images/llms/cerebras.avif" />
    </Frame>
  </Card>

  <Card title="Google Gemini" href="/integrations/llms/gemini">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/google-gemini.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=7e78cfa8e4b56b5a80a9f68e2e2646ca" alt="Google Gemini" width="245" height="138" data-path="images/supported-llm/google-gemini.avif" />
    </Frame>
  </Card>

  <Card title="Vertex AI" href="/integrations/llms/vertex-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/vertex-ai.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=34d900e0ec65845154119bb32e94d2dd" alt="Vertex AI" width="245" height="138" data-path="images/supported-llm/vertex-ai.avif" />
    </Frame>
  </Card>

  <Card title="Cohere" href="/integrations/llms/cohere">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/cohere.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=3fdd432c0560da48f7621cb6f8fa030d" alt="Cohere" width="245" height="138" data-path="images/supported-llm/cohere.avif" />
    </Frame>
  </Card>

  <Card title="Perplexity AI" href="/integrations/llms/perplexity-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/perplexity-ai.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=22d36df2b6b09af9ce34a7d8843e1a5d" alt="Perplexity AI" width="245" height="138" data-path="images/supported-llm/perplexity-ai.avif" />
    </Frame>
  </Card>

  <Card title="AI21" href="/integrations/llms/ai21">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/4-30rIA0OTIWFzdD/images/supported-llm/ai21.avif?fit=max&auto=format&n=4-30rIA0OTIWFzdD&q=85&s=a7411bdaaec1b6cb80b18258a325c4fe" alt="AI21" width="245" height="138" data-path="images/supported-llm/ai21.avif" />
    </Frame>
  </Card>

  <Card title="Anyscale" href="/integrations/llms/anyscale-llama2-mistral-zephyr">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/4-30rIA0OTIWFzdD/images/supported-llm/anyscale.avif?fit=max&auto=format&n=4-30rIA0OTIWFzdD&q=85&s=93e0df0790d1bc5d318218ed21fa5de5" alt="Anyscale" width="245" height="138" data-path="images/supported-llm/anyscale.avif" />
    </Frame>
  </Card>

  <Card title="Byollm" href="/integrations/llms/byollm" />

  <Card title="Dashscope" href="/integrations/llms/dashscope">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/dashscope.jpeg?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=eb54da797114105fd6b27de1e1744e24" alt="Dashscope" width="128" height="128" data-path="images/supported-llm/dashscope.jpeg" />
    </Frame>
  </Card>

  <Card title="Deepbricks" href="/integrations/llms/deepbricks">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/deepbricks.jpeg?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=fb29df12e5a6d43db91893932450bdc8" alt="Deepbricks" width="225" height="225" data-path="images/supported-llm/deepbricks.jpeg" />
    </Frame>
  </Card>

  <Card title="DeepInfra" href="/integrations/llms/deepinfra">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/deepinfa.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=07299560532ebc9288324a4c4141a2a5" alt="DeepInfra" width="245" height="138" data-path="images/supported-llm/deepinfa.avif" />
    </Frame>
  </Card>

  <Card title="DeepSeek" href="/integrations/llms/deepseek">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/deepseek.webp?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=544db92be63e0fdbdb23c206c8caae0c" alt="DeepSeek" width="780" height="165" data-path="images/supported-llm/deepseek.webp" />
    </Frame>
  </Card>

  <Card title="Fireworks AI" href="/integrations/llms/fireworks">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/fireworks.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=75abcb2c954ee35f3af24819db6ea440" alt="Fireworks AI" width="240" height="136" data-path="images/supported-llm/fireworks.png" />
    </Frame>
  </Card>

  <Card title="Featherless AI" href="/integrations/llms/featherless">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/featherless.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=aec8928f884b9c6c055a9edae9f46230" alt="featherless-AI" width="225" height="225" data-path="images/supported-llm/featherless.png" />
    </Frame>
  </Card>

  <Card title="Github Models" href="/integrations/llms/github">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/1G9bsW0hvqFKxIXh/images/llms/github.png?fit=max&auto=format&n=1G9bsW0hvqFKxIXh&q=85&s=5960fbff4c00a29f467f473b9190299b" alt="Github" width="954" height="482" data-path="images/llms/github.png" />
    </Frame>
  </Card>

  <Card title="Google Palm" href="/integrations/llms/google-palm">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/google-palm.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=807498f5e03abb89bcd620459e1f3494" alt="Google Palm" width="245" height="138" data-path="images/supported-llm/google-palm.avif" />
    </Frame>
  </Card>

  <Card title="Groq" href="/integrations/llms/groq">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/groq.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=94f60f09e570efdf45076be553f32231" alt="Groq" width="245" height="138" data-path="images/supported-llm/groq.avif" />
    </Frame>
  </Card>

  <Card title="Jina AI" href="/integrations/llms/jina-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/jina.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=b236379e7260e1901328cafdb1210ed4" alt="Jina AI" width="225" height="225" data-path="images/supported-llm/jina.png" />
    </Frame>
  </Card>

  <Card title="Lambda" href="/integrations/llms/lambda">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/lambda.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=5797442c26b049294033ea5808a9a057" alt="Lambda" width="225" height="225" data-path="images/supported-llm/lambda.png" />
    </Frame>
  </Card>

  <Card title="Lemonfox AI" href="/integrations/llms/lemon-fox">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/lemonfox-ai.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=97714186151bfa47bbd558c39fb637b0" alt="Lemonfox AI" width="225" height="225" data-path="images/supported-llm/lemonfox-ai.png" />
    </Frame>
  </Card>

  <Card title="Lepton AI" href="/integrations/llms/lepton">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/lepton.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=dd97548ab2cacda8fbb779d5f4102da1" alt="Lepton AI" width="311" height="85" data-path="images/supported-llm/lepton.png" />
    </Frame>
  </Card>

  <Card title="Lingyi (01.ai)" href="/integrations/llms/lingyi-01.ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/lingyi.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=32cd62fe09b6ba93204f9dc8d62104d5" alt="Lingyi (01.ai)" width="200" height="200" data-path="images/supported-llm/lingyi.png" />
    </Frame>
  </Card>

  <Card title="LocalAI" href="/integrations/llms/local-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/local.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=04e9f943d94b074b740889cae9b83948" alt="LocalAI" width="245" height="132" data-path="images/supported-llm/local.avif" />
    </Frame>
  </Card>

  <Card title="Mistral AI" href="/integrations/llms/mistral-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/mistral.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=fa38b24696daeda05e7d570ae25a2982" alt="Mistral AI" width="245" height="138" data-path="images/supported-llm/mistral.avif" />
    </Frame>
  </Card>

  <Card title="MonsterAPI" href="/integrations/llms/monster-api">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/monster.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=ae0576eaa53db6aa03dc990bb328c7f3" alt="MonsterAPI" width="245" height="138" data-path="images/supported-llm/monster.avif" />
    </Frame>
  </Card>

  <Card title="Moonshot" href="/integrations/llms/moonshot">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/moonshoot.jpg?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=00c5d36fd10a5f16aea4f053acc460fd" alt="Moonshot" width="224" height="224" data-path="images/supported-llm/moonshoot.jpg" />
    </Frame>
  </Card>

  <Card title="nCompass" href="/integrations/llms/ncompass">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/xdYi_MmmlZqAH1Qq/images/llms/ncompass.jpeg?fit=max&auto=format&n=xdYi_MmmlZqAH1Qq&q=85&s=ff8c4269207e9b3de2c0455aefaf9d7f" alt="nCompass" width="200" height="200" data-path="images/llms/ncompass.jpeg" />
    </Frame>
  </Card>

  <Card title="Nebius" href="/integrations/llms/nebius">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/nebius.jpeg?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=d926327fecf2c2348bcfed9902f2198b" alt="Nebius" width="200" height="200" data-path="images/supported-llm/nebius.jpeg" />
    </Frame>
  </Card>

  <Card title="Nomic AI" href="/integrations/llms/nomic">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/nomic.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=ba4befe3846845ffd31d95962d720680" alt="Nomic AI" width="245" height="138" data-path="images/supported-llm/nomic.avif" />
    </Frame>
  </Card>

  <Card title="Nscale" href="/integrations/llms/nscale">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/nscale.jpeg?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=88f3bf9798168736f2c2684eacbe0186" alt="Nscale" width="259" height="194" data-path="images/supported-llm/nscale.jpeg" />
    </Frame>
  </Card>

  <Card title="Ollama" href="/integrations/llms/ollama">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/ollama.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=d85ff7986d2a64a7282eb481cad868f7" alt="Ollama" width="245" height="138" data-path="images/supported-llm/ollama.avif" />
    </Frame>
  </Card>

  <Card title="Openrouter" href="/integrations/llms/openrouter">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/openrouter.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=fa09ad3a363663624f0da2beba2a26a5" alt="Openrouter" width="224" height="224" data-path="images/supported-llm/openrouter.png" />
    </Frame>
  </Card>

  <Card title="Predibase" href="/integrations/llms/predibase">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/predise.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=940ab6159e8f10dda0fe8a69bc6459d3" alt="Predibase" width="245" height="132" data-path="images/supported-llm/predise.avif" />
    </Frame>
  </Card>

  <Card title="Recraft AI" href="/integrations/llms/recraft-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/xdYi_MmmlZqAH1Qq/images/llms/recraft.jpeg?fit=max&auto=format&n=xdYi_MmmlZqAH1Qq&q=85&s=07cc037cc5d17085a682e44f33f9574d" alt="Recraft" width="200" height="200" data-path="images/llms/recraft.jpeg" />
    </Frame>
  </Card>

  <Card title="Siliconflow" href="/integrations/llms/siliconflow">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/siliconflow.jpeg?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=2ee13f3500b5a41ecd7b706c5431245e" alt="Siliconflow" width="200" height="200" data-path="images/supported-llm/siliconflow.jpeg" />
    </Frame>
  </Card>

  <Card title="Snowflake Cortex" href="/integrations/llms/snowflake-cortex">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/1G9bsW0hvqFKxIXh/images/llms/Snowflake%20Cortex%20Logo.png?fit=max&auto=format&n=1G9bsW0hvqFKxIXh&q=85&s=505566e5ed7129495252ba67afc358a8" alt="Snowflake" width="225" height="225" data-path="images/llms/Snowflake Cortex Logo.png" />
    </Frame>
  </Card>

  <Card title="Stability AI" href="/integrations/llms/stability-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/stability.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=fbe529c4baecbdc2d661c86780ab6e1b" alt="Stability AI" width="245" height="138" data-path="images/supported-llm/stability.avif" />
    </Frame>
  </Card>

  <Card title="Together AI" href="/integrations/llms/together-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/together-ai.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=530eae2902e177336186eac3e81c77de" alt="Together AI" width="245" height="138" data-path="images/supported-llm/together-ai.avif" />
    </Frame>
  </Card>

  <Card title="Triton" href="/integrations/llms/triton">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/triton.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=2c8e855473f1f8ba3e7aaba01375bcf7" alt="Triton" width="254" height="198" data-path="images/supported-llm/triton.png" />
    </Frame>
  </Card>

  <Card title="Upstage" href="/integrations/llms/upstage">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/upstage.jpeg?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=b6441e115b0a5b7fc64172236a034fb3" alt="Upstage" width="200" height="200" data-path="images/supported-llm/upstage.jpeg" />
    </Frame>
  </Card>

  <Card title="Voyage-AI" href="/integrations/llms/voyage-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/voyage.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=1d93c93c556a8ebc6fd9fc2804efad2e" alt="Voyage-AI" width="314" height="160" data-path="images/supported-llm/voyage.png" />
    </Frame>
  </Card>

  <Card title="Workers AI" href="/integrations/llms/workers-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/worksai.jpg?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=27c305fe4880c2985a977d9ce456b927" alt="Workers AI" width="225" height="225" data-path="images/supported-llm/worksai.jpg" />
    </Frame>
  </Card>

  <Card title="ZhipuAI" href="/integrations/llms/zhipu">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/zhipu.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=dd46c1ea7e335b6c2e56eb59dda48264" alt="ZhipuAI" width="245" height="132" data-path="images/supported-llm/zhipu.avif" />
    </Frame>
  </Card>
</CardGroup>

## Endpoints Supported

For a detailed breakdown of supported endpoints and features per provider, refer to the table below:

<Card title="Supported Providers" href="/provider-endpoints/supported-providers" />

## Supported Frameworks

Portkey has native integrations with the following frameworks. Click to read their getting started guides.

<CardGroup cols={3}>
  <Card title="Langchain" href="/integrations/libraries/langchain-python">
    <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/langchain.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=e120a7adacdaa04e8c89adfec4593db0" alt="Langchain" width="245" height="138" data-path="images/supported-llm/langchain.avif" />
  </Card>

  <Card title="LlamaIndex" href="/integrations/libraries/llama-index-python">
    <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/llama.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=de04332b4313a3ef0fe81f84dafdc046" alt="LlamaIndex" width="245" height="138" data-path="images/supported-llm/llama.avif" />
  </Card>

  <Card title="Autogen" href="/integrations/libraries/autogen">
    <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/autogen.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=2a37755fb766bb8a86eb8c17a42109cb" alt="Autogen" width="245" height="138" data-path="images/supported-llm/autogen.avif" />
  </Card>

  <Card title="Vercel" href="/integrations/libraries/vercel">
    <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/vercel.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=1c0b1b4642cb3ecc41759c13a29fbb5d" alt="Vercel" width="245" height="132" data-path="images/supported-llm/vercel.avif" />
  </Card>

  <Card title="Instructor" href="/integrations/libraries/instructor">
    <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/instructor.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=366ba46016d3367eda5394805ce37adc" alt="Instructor" width="245" height="132" data-path="images/supported-llm/instructor.avif" />
  </Card>

  <Card title="DSPy" href="/integrations/libraries/dspy">
    <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/dspy.png?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=67c62373cc3478135ceef9478b4a1ea4" alt="DSPy" width="300" height="168" data-path="images/supported-llm/dspy.png" />
  </Card>

  <Card title="Promptfoo" href="/integrations/libraries/promptfoo">
    <img src="https://mintcdn.com/portkey-docs-mintlify-bedrock-guardrails-docs-36443/XJvosNaNYKCGX08L/images/supported-llm/prompftoo.avif?fit=max&auto=format&n=XJvosNaNYKCGX08L&q=85&s=7738a514c8ecae50c8972b97645df693" alt="Promptfoo" width="245" height="132" data-path="images/supported-llm/prompftoo.avif" />
  </Card>
</CardGroup>

Have a suggestion for an integration with Portkey? Tell us on [Discord](https://discord.gg/DD7vgKK299), or drop a message on [support@portkey.ai](mailto:support@portkey.ai).

While you're here, why not [give us a star](https://git.new/ai-gateway-docs)? It helps us a lot!