Skip to content
Back to search

gateway

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/portkey-ai--gateway/badge.svg)](/listings/portkey-ai--gateway)

HTML

<a href="/listings/portkey-ai--gateway"><img src="/api/listings/portkey-ai--gateway/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

1. Setup your AI Gateway

# Run the gateway locally (needs Node.js and npm)
npx @portkey-ai/gateway

> The Gateway is running on `http://localhost:8787/v1` > > The Gateway Console is running on `http://localhost:8787/public/`

<sup> Deployment guides: &nbsp; <a href="https://portkey.wiki/gh-18"><img height="12" width="12" src="https://cfassets.portkey.ai/logo/dew-color.svg" /> Portkey Cloud (Recommended)</a> &nbsp; <a href="./docs/installation-deployments.md#docker"><img height="12" width="12" src="https://cdn.simpleicons.org/docker/3776AB" /> Docker</a> &nbsp; <a href="./docs/installation-deployments.md#nodejs-server"><img height="12" width="12" src="https://cdn.simpleicons.org/node.js/3776AB" /> Node.js</a> &nbsp; <a href="./docs/installation-deployments.md#cloudflare-workers"><img height="12" width="12" src="https://cdn.simpleicons.org/cloudflare/3776AB" /> Cloudflare</a> &nbsp; <a href="./docs/installation-deployments.md#replit"><img height="12" width="12" src="https://cdn.simpleicons.org/replit/3776AB" /> Replit</a> &nbsp; <a href="./docs/installation-deployments.md"> Others...</a>

</sup>

2. Make your first request

# pip install -qU portkey-ai

from portkey_ai import Portkey

# OpenAI compatible client
client = Portkey(
    provider="openai", # or 'anthropic', 'bedrock', 'groq', etc
    Authorization="sk-***" # the provider API key
)

# Make a request through your AI Gateway
client.chat.completions.create(
    messages=[{"role": "user", "content": "What's the weather like?"}],
    model="gpt-4o-mini"
)

<sup>Supported Libraries: &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/javascript/3776AB" /> JS](https://portkey.wiki/gh-19) &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/python/3776AB" /> Python](https://portkey.wiki/gh-20) &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/gnubash/3776AB" /> REST](https://portkey.sh/gh-84) &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/openai/3776AB" /> OpenAI SDKs](https://portkey.wiki/gh-21) &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/langchain/3776AB" /> Langchain](https://portkey.wiki/gh-22) &nbsp; [LlamaIndex](https://portkey.wiki/gh-23) &nbsp; [Autogen](https://portkey.wiki/gh-24) &nbsp; [CrewAI](https://portkey.wiki/gh-25) &nbsp; [More..](https://portkey.wiki/gh-26) </sup>

On the Gateway Console (`http://localhost:8787/public/`) you can see all of your local logs in one place.

3. Routing & Guardrails

`Configs` in the LLM gateway allow you to create routing rules, add reliability and setup guardrails.

config = {
  "retry": {"attempts": 5},

  "output_guardrails": [{
    "default.contains": {"operator": "none", "words": ["Apple"]},
    "deny": True
  }]
}

# Attach the config to the client
client = client.with_options(config=config)

client.chat.completions.create(
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Reply randomly with Apple or Bat"}]
)

# This would always response with "Bat" as the guardrail denies all replies containing "Apple". The retry config would retry 5 times before giving up.

<div align="center"> </div>

You can do a lot more stuff with configs in your AI gateway. [Jump to examples →](https://portkey.wiki/gh-27)

<br/>

Enterprise Version (Private deployments)

<sup>

[<img height="12" width="12" src="https://cfassets.portkey.ai/amazon-logo.svg" /> AWS](https://portkey.wiki/gh-28) &nbsp; [<img height="12" width="12" src="https://cfassets.portkey.ai/azure-logo.svg" /> Azure](https://portkey.wiki/gh-29) &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/googlecloud/3776AB" /> GCP](https://portkey.wiki/gh-30) &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/redhatopenshift/3776AB" /> OpenShift](https://portkey.wiki/gh-31)

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 338 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. <p align="right">
  2. <strong>English</strong> | <a href="./.github/README.cn.md">中文</a> | <a href="./.github/README.jp.md">日本語</a>
  3. </p>
  4. > [!IMPORTANT]
  5. > :rocket: Gateway 2.0 (Pre-Release) Portkey's core enterprise gateway is merging into open-source with our 2.0 release. You can try the pre-release branch [here](https://github.com/portkey-ai/gateway/tree/2.0.0).
  6. > Read more about what's next for Portkey in our [**Series A announcement**](https://portkey.wiki/rohit-a).
  7. <div align="center">
  8. 🆕 **[Portkey Models](https://github.com/Portkey-AI/models)** - Open-source LLM pricing for 2,300+ models across 40+ providers. [Explore →](https://portkey.ai/models)
  9. # AI Gateway
  10. #### Route to 250+ LLMs with 1 fast & friendly API
  11. <img src="https://cfassets.portkey.ai/sdk.gif" width="550px" alt="Portkey AI Gateway Demo showing LLM routing capabilities" style="margin-left:-35px">
  12. [Docs](https://portkey.wiki/gh-1) | [Enterprise](https://portkey.wiki/gh-2) | [Hosted Gateway](https://portkey.wiki/gh-3) | [Changelog](https://portkey.wiki/gh-4) | [API Reference](https://portkey.wiki/gh-5)
  13. [![License](https://img.shields.io/github/license/Ileriayo/markdown-badges)](./LICENSE)
  14. [![Discord](https://img.shields.io/discord/1143393887742861333)](https://portkey.wiki/gh-6)
  15. [![Twitter](https://img.shields.io/twitter/url/https/twitter/follow/portkeyai?style=social&label=Follow%20%40PortkeyAI)](https://portkey.wiki/gh-7)
  16. [![npm version](https://badge.fury.io/js/%40portkey-ai%2Fgateway.svg)](https://portkey.wiki/gh-8)
  17. [![Better Stack Badge](https://uptime.betterstack.com/status-badges/v1/monitor/q94g.svg)](https://portkey.wiki/gh-9)
  18. <a href="https://us-east-1.console.aws.amazon.com/cloudformation/home?region=us-east-1#/stacks/quickcreate?stackName=portkey-gateway&templateURL=https://portkey-gateway-ec2-quicklaunch.s3.us-east-1.amazonaws.com/portkey-gateway-ec2-quicklaunch.template.yaml"><img src="https://img.shields.io/badge/Deploy_to_EC2-232F3E?style=for-the-badge&logo=amazonwebservices&logoColor=white" alt="Deploy to AWS EC2" width="105"/></a> [![Ask DeepWiki](https://deepwiki.com/badge.svg)](https://deepwiki.com/Portkey-AI/gateway)
  19. </div>
  20. <br/>
  21. The [**AI Gateway**](https://portkey.wiki/gh-10) is designed for fast, reliable & secure routing to 1600+ language, vision, audio, and image models. It is a lightweight, open-source, and enterprise-ready solution that allows you to integrate with any language model in under 2 minutes.
  22. - [x] **Blazing fast** (<1ms latency) with a tiny footprint (122kb)
  23. - [x] **Battle tested**, with over 10B tokens processed everyday
  24. - [x] **Enterprise-ready** with enhanced security, scale, and custom deployments
  25. <br>
  26. #### What can you do with the AI Gateway?
  27. - Integrate with any LLM in under 2 minutes - [Quickstart](#quickstart-2-mins)
  28. - Prevent downtimes through **[automatic retries](https://portkey.wiki/gh-11)** and **[fallbacks](https://portkey.wiki/gh-12)**
  29. - Scale AI apps with **[load balancing](https://portkey.wiki/gh-13)** and **[conditional routing](https://portkey.wiki/gh-14)**
  30. - Protect your AI deployments with **[guardrails](https://portkey.wiki/gh-15)**
  31. - Go beyond text with **[multi-modal capabilities](https://portkey.wiki/gh-16)**
  32. - Explore **[agentic workflow](https://portkey.wiki/gh-17)** integrations
  33. - Manage MCP servers with enterprise auth & observability using **[MCP Gateway](https://portkey.ai/docs/product/mcp-gateway)**
  34. <br><br>
  35. > [!TIP]
  36. > Starring this repo helps more developers discover the AI Gateway 🙏🏻
  37. >
  38. > ![star-2](https://github.com/user-attachments/assets/53597dce-6333-4ecc-a154-eb05532954e4)
  39. >
  40. <br>
  41. <br>
  42. ## Quickstart (2 mins)
  43. ### 1. Setup your AI Gateway
  44. ```bash
  45. # Run the gateway locally (needs Node.js and npm)
  46. npx @portkey-ai/gateway
  47. ```
  48. > The Gateway is running on `http://localhost:8787/v1`
  49. >
  50. > The Gateway Console is running on `http://localhost:8787/public/`
  51. <sup>
  52. Deployment guides:
  53. &nbsp; <a href="https://portkey.wiki/gh-18"><img height="12" width="12" src="https://cfassets.portkey.ai/logo/dew-color.svg" /> Portkey Cloud (Recommended)</a>
  54. &nbsp; <a href="./docs/installation-deployments.md#docker"><img height="12" width="12" src="https://cdn.simpleicons.org/docker/3776AB" /> Docker</a>
  55. &nbsp; <a href="./docs/installation-deployments.md#nodejs-server"><img height="12" width="12" src="https://cdn.simpleicons.org/node.js/3776AB" /> Node.js</a>
  56. &nbsp; <a href="./docs/installation-deployments.md#cloudflare-workers"><img height="12" width="12" src="https://cdn.simpleicons.org/cloudflare/3776AB" /> Cloudflare</a>
  57. &nbsp; <a href="./docs/installation-deployments.md#replit"><img height="12" width="12" src="https://cdn.simpleicons.org/replit/3776AB" /> Replit</a>
  58. &nbsp; <a href="./docs/installation-deployments.md"> Others...</a>
  59. </sup>
  60. ### 2. Make your first request
  61. <!-- <details open>
  62. <summary>Python Example</summary> -->
  63. ```python
  64. # pip install -qU portkey-ai
  65. from portkey_ai import Portkey
  66. # OpenAI compatible client
  67. client = Portkey(
  68. provider="openai", # or 'anthropic', 'bedrock', 'groq', etc
  69. Authorization="sk-***" # the provider API key
  70. )
  71. # Make a request through your AI Gateway
  72. client.chat.completions.create(
  73. messages=[{"role": "user", "content": "What's the weather like?"}],
  74. model="gpt-4o-mini"
  75. )
  76. ```
  77. <sup>Supported Libraries:
  78. &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/javascript/3776AB" /> JS](https://portkey.wiki/gh-19)
  79. &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/python/3776AB" /> Python](https://portkey.wiki/gh-20)
  80. &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/gnubash/3776AB" /> REST](https://portkey.sh/gh-84)
  81. &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/openai/3776AB" /> OpenAI SDKs](https://portkey.wiki/gh-21)
  82. &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/langchain/3776AB" /> Langchain](https://portkey.wiki/gh-22)
  83. &nbsp; [LlamaIndex](https://portkey.wiki/gh-23)
  84. &nbsp; [Autogen](https://portkey.wiki/gh-24)
  85. &nbsp; [CrewAI](https://portkey.wiki/gh-25)
  86. &nbsp; [More..](https://portkey.wiki/gh-26)
  87. </sup>
  88. On the Gateway Console (`http://localhost:8787/public/`) you can see all of your local logs in one place.
  89. <img src="https://github.com/user-attachments/assets/362bc916-0fc9-43f1-a39e-4bd71aac4a3a" width="400" />
  90. ### 3. Routing & Guardrails
  91. `Configs` in the LLM gateway allow you to create routing rules, add reliability and setup guardrails.
  92. ```python
  93. config = {
  94. "retry": {"attempts": 5},
  95. "output_guardrails": [{
  96. "default.contains": {"operator": "none", "words": ["Apple"]},
  97. "deny": True
  98. }]
  99. }
  100. # Attach the config to the client
  101. client = client.with_options(config=config)
  102. client.chat.completions.create(
  103. model="gpt-4o-mini",
  104. messages=[{"role": "user", "content": "Reply randomly with Apple or Bat"}]
  105. )
  106. # This would always response with "Bat" as the guardrail denies all replies containing "Apple". The retry config would retry 5 times before giving up.
  107. ```
  108. <div align="center">
  109. <img src="https://portkey.ai/blog/content/images/size/w1600/2024/11/image-15.png" width=600 title="Request flow through Portkey's AI gateway with retries and guardrails" alt="Request flow through Portkey's AI gateway with retries and guardrails"/>
  110. </div>
  111. You can do a lot more stuff with configs in your AI gateway. [Jump to examples →](https://portkey.wiki/gh-27)
  112. <br/>
  113. ### Enterprise Version (Private deployments)
  114. <sup>
  115. [<img height="12" width="12" src="https://cfassets.portkey.ai/amazon-logo.svg" /> AWS](https://portkey.wiki/gh-28)
  116. &nbsp; [<img height="12" width="12" src="https://cfassets.portkey.ai/azure-logo.svg" /> Azure](https://portkey.wiki/gh-29)
  117. &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/googlecloud/3776AB" /> GCP](https://portkey.wiki/gh-30)
  118. &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/redhatopenshift/3776AB" /> OpenShift](https://portkey.wiki/gh-31)
  119. &nbsp; [<img height="12" width="12" src="https://cdn.simpleicons.org/kubernetes/3776AB" /> Kubernetes](https://portkey.wiki/gh-85)
  120. </sup>
  121. The LLM Gateway's [enterprise version](https://portkey.wiki/gh-86) offers advanced capabilities for **org management**, **governance**, **security** and [more](https://portkey.wiki/gh-87) out of the box. [View Feature Comparison →](https://portkey.wiki/gh-32)
  122. The enterprise deployment architecture for supported platforms is available here - [**Enterprise Private Cloud Deployments**](https://portkey.ai/docs/self-hosting/hybrid-deployments/architecture)
  123. <a href="https://portkey.sh/demo-13"><img src="https://portkey.ai/blog/content/images/2024/08/Get-API-Key--5-.png" height=50 alt="Book an enterprise AI gateway demo" /></a><br/>
  124. <br>
  125. ## MCP Gateway
  126. [MCP Gateway](https://portkey.ai/docs/product/mcp-gateway) provides a centralized control plane for managing MCP (Model Context Protocol) servers across your organization.
  127. - **Authentication** — Single auth layer at the gateway. Users authenticate once; your MCP servers receive verified requests
  128. - **Access Control** — Control which teams and users can access which servers and tools. Revoke access instantly
  129. - **Observability** — Every tool call logged with full context: who called what, parameters, response, latency
  130. - **Identity Forwarding** — Forward user identity (email, team, roles) to MCP servers automatically
  131. Works with Claude Desktop, Cursor, VS Code, and any MCP-compatible client. [Get started →](https://portkey.ai/docs/product/mcp-gateway/quickstart)
  132. <br>
  133. ## Core Features
  134. ### Reliable Routing
  135. - <a href="https://portkey.wiki/gh-37">**Fallbacks**</a>: Fallback to another provider or model on failed requests using the LLM gateway. You can specify the errors on which to trigger the fallback. Improves reliability of your application.
  136. - <a href="https://portkey.wiki/gh-38">**Automatic Retries**</a>: Automatically retry failed requests up to 5 times. An exponential backoff strategy spaces out retry attempts to prevent network overload.
  137. - <a href="https://portkey.wiki/gh-39">**Load Balancing**</a>: Distribute LLM requests across multiple API keys or AI providers with weights to ensure high availability and optimal performance.
  138. - <a href="https://portkey.wiki/gh-40">**Request Timeouts**</a>: Manage unruly LLMs & latencies by setting up granular request timeouts, allowing automatic termination of requests that exceed a specified duration.
  139. - <a href="https://portkey.wiki/gh-41">**Multi-modal LLM Gateway**</a>: Call vision, audio (text-to-speech & speech-to-text), and image generation models from multiple providers — all using the familiar OpenAI signature
  140. - <a href="https://portkey.wiki/gh-42">**Realtime APIs**</a>: Call realtime APIs launched by OpenAI through the integrate websockets server.
  141. ### Security & Accuracy
  142. - <a href="https://portkey.wiki/gh-88">**Guardrails**</a>: Verify your LLM inputs and outputs to adhere to your specified checks. Choose from the 40+ pre-built guardrails to ensure compliance with security and accuracy standards. You can <a href="https://portkey.wiki/gh-43">bring your own guardrails</a> or choose from our <a href="https://portkey.wiki/gh-44">many partners</a>.
  143. - [**Secure Key Management**](https://portkey.wiki/gh-45): Use your own keys or generate virtual keys on the fly.
  144. - [**Role-based access control**](https://portkey.wiki/gh-46): Granular access control for your users, workspaces and API keys.
  145. - <a href="https://portkey.wiki/gh-47">**Compliance & Data Privacy**</a>: The AI gateway is SOC2, HIPAA, GDPR, and CCPA compliant.
  146. ### Cost Management
  147. - [**Smart caching**](https://portkey.wiki/gh-48): Cache responses from LLMs to reduce costs and improve latency. Supports simple and semantic* caching.
  148. - [**Usage analytics**](https://portkey.wiki/gh-49): Monitor and analyze your AI and LLM usage, including request volume, latency, costs and error rates.
  149. - [**Provider optimization***](https://portkey.wiki/gh-89): Automatically switch to the most cost-effective provider based on usage patterns and pricing models.
  150. ### Collaboration & Workflows
  151. - <a href="https://portkey.ai/docs/integrations/agents">**Agents Support**</a>: Seamlessly integrate with popular agent frameworks to build complex AI applications. The gateway seamlessly integrates with [Autogen](https://portkey.wiki/gh-50), [CrewAI](https://portkey.wiki/gh-51), [LangChain](https://portkey.wiki/gh-52), [LlamaIndex](https://portkey.wiki/gh-53), [Phidata](https://portkey.wiki/gh-54), [Control Flow](https://portkey.wiki/gh-55), and even [Custom Agents](https://portkey.wiki/gh-56).
  152. - [**Prompt Template Management***](https://portkey.wiki/gh-57): Create, manage and version your prompt templates collaboratively through a universal prompt playground.
  153. <br/><br/>
  154. <sup>
  155. *&nbsp;Available in hosted and enterprise versions
  156. </sup>
  157. <br>
  158. ## Portkey Models
  159. Open-source LLM pricing database for 40+ providers - used by the Gateway for cost tracking.
  160. [GitHub](https://github.com/Portkey-AI/models) | [Model Explorer](https://portkey.ai/models)
  161. <br>
  162. ## Cookbooks
  163. ### ☄️ Trending
  164. - Use models from [Nvidia NIM](/cookbook/providers/nvidia.ipynb) with AI Gateway
  165. - Monitor [CrewAI Agents](/cookbook/monitoring-agents/CrewAI_with_Telemetry.ipynb) with Portkey!
  166. - Comparing [Top 10 LMSYS Models](/cookbook/use-cases/LMSYS%20Series/comparing-top10-LMSYS-models-with-Portkey.ipynb) with AI Gateway.
  167. ### 🚨 Latest
  168. * [Create Synthetic Datasets using Nemotron](/cookbook/use-cases/Nemotron_GPT_Finetuning_Portkey.ipynb)
  169. * [Use the LLM Gateway with Vercel's AI SDK](/cookbook/integrations/vercel-ai.md)
  170. * [Monitor Llama Agents with Portkey's LLM Gateway](/cookbook/monitoring-agents/Llama_Agents_with_Telemetry.ipynb)
  171. [View all cookbooks →](https://portkey.wiki/gh-58)
  172. <br/><br/>
  173. ## Supported Providers
  174. Explore Gateway integrations with [45+ providers](https://portkey.wiki/gh-59) and [8+ agent frameworks](https://portkey.wiki/gh-90).
  175. | | Provider | Support | Stream |
  176. | -------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------- | ------- | ------ |
  177. | <img src="docs/images/openai.png" width=35 /> | [OpenAI](https://portkey.wiki/gh-60) | ✅ | ✅ |
  178. | <img src="docs/images/azure.png" width=35> | [Azure OpenAI](https://portkey.wiki/gh-61) | ✅ | ✅ |
  179. | <img src="docs/images/anyscale.png" width=35> | [Anyscale](https://portkey.wiki/gh-62) | ✅ | ✅ |
  180. | <img src="https://upload.wikimedia.org/wikipedia/commons/2/2d/Google-favicon-2015.png" width=35> | [Google Gemini](https://portkey.wiki/gh-63) | ✅ | ✅ |
  181. | <img src="docs/images/anthropic.png" width=35> | [Anthropic](https://portkey.wiki/gh-64) | ✅ | ✅ |
  182. | <img src="docs/images/cohere.png" width=35> | [Cohere](https://portkey.wiki/gh-65) | ✅ | ✅ |
  183. | <img src="https://assets-global.website-files.com/64f6f2c0e3f4c5a91c1e823a/654693d569494912cfc0c0d4_favicon.svg" width=35> | [Together AI](https://portkey.wiki/gh-66) | ✅ | ✅ |
  184. | <img src="https://www.perplexity.ai/favicon.svg" width=35> | [Perplexity](https://portkey.wiki/gh-67) | ✅ | ✅ |
  185. | <img src="https://docs.mistral.ai/img/favicon.ico" width=35> | [Mistral](https://portkey.wiki/gh-68) | ✅ | ✅ |
  186. | <img src="https://docs.nomic.ai/img/nomic-logo.png" width=35> | [Nomic](https://portkey.wiki/gh-69) | ✅ | ✅ |
  187. | <img src="https://files.readme.io/d38a23e-small-studio-favicon.png" width=35> | [AI21](https://portkey.wiki/gh-91) | ✅ | ✅ |
  188. | <img src="https://platform.stability.ai/small-logo-purple.svg" width=35> | [Stability AI](https://portkey.wiki/gh-71) | ✅ | ✅ |
  189. | <img src="https://deepinfra.com/_next/static/media/logo.4a03fd3d.svg" width=35> | [DeepInfra](https://portkey.sh/gh-92) | ✅ | ✅ |
  190. | <img src="https://ollama.com/public/ollama.png" width=35> | [Ollama](https://portkey.wiki/gh-72) | ✅ | ✅ |
  191. | <img src="https://novita.ai/favicon.ico" width=35> | [Novita AI](https://portkey.wiki/gh-73) | ✅ | ✅ | `/chat/completions`, `/completions` |
  192. > [View the complete list of 200+ supported models here](https://portkey.wiki/gh-74)
  193. <br>
  194. <br>
  195. ## Agents
  196. Gateway seamlessly integrates with popular agent frameworks. [Read the documentation here](https://portkey.wiki/gh-75).
  197. | Framework | Call 200+ LLMs | Advanced Routing | Caching | Logging & Tracing* | Observability* | Prompt Management* |
  198. |------------------------------|--------|-------------|---------|------|---------------|-------------------|
  199. | [Autogen](https://portkey.wiki/gh-93) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
  200. | [CrewAI](https://portkey.wiki/gh-94) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
  201. | [LangChain](https://portkey.wiki/gh-95) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
  202. | [Phidata](https://portkey.wiki/gh-96) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
  203. | [Llama Index](https://portkey.wiki/gh-97) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
  204. | [Control Flow](https://portkey.wiki/gh-98) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
  205. | [Build Your Own Agents](https://portkey.wiki/gh-99) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
  206. | <img src="https://io.net/favicon.ico" width=35> | [IO Intelligence](https://io.net/intelligence) | ✅ | ✅ |
  207. <br>
  208. *Available on the [hosted app](https://portkey.wiki/gh-76). For detailed documentation [click here](https://portkey.wiki/gh-100).
  209. ## Gateway Enterprise Version
  210. Make your AI app more <ins>reliable</ins> and <ins>forward compatible</ins>, while ensuring complete <ins>data security</ins> and <ins>privacy</ins>.
  211. ✅&nbsp; Secure Key Management - for role-based access control and tracking <br>
  212. ✅&nbsp; Simple & Semantic Caching - to serve repeat queries faster & save costs <br>
  213. ✅&nbsp; Access Control & Inbound Rules - to control which IPs and Geos can connect to your deployments <br>
  214. ✅&nbsp; PII Redaction - to automatically remove sensitive data from your requests to prevent indavertent exposure <br>
  215. ✅&nbsp; SOC2, ISO, HIPAA, GDPR Compliances - for best security practices <br>
  216. ✅&nbsp; Professional Support - along with feature prioritization <br>
  217. [Schedule a call to discuss enterprise deployments](https://portkey.sh/demo-13)
  218. <br>
  219. ## Contributing
  220. The easiest way to contribute is to pick an issue with the `good first issue` tag 💪. Read the contribution guidelines [here](/.github/CONTRIBUTING.md).
  221. Bug Report? [File here](https://portkey.wiki/gh-78) | Feature Request? [File here](https://portkey.wiki/gh-78)
  222. ### Getting Started with the Community
  223. Join our weekly AI Engineering Hours every Friday (8 AM PT) to:
  224. - Meet other contributors and community members
  225. - Learn advanced Gateway features and implementation patterns
  226. - Share your experiences and get help
  227. - Stay updated with the latest development priorities
  228. [Join the next session →](https://portkey.wiki/gh-101) | [Meeting notes](https://portkey.wiki/gh-102)
  229. <br>
  230. ## Community
  231. Join our growing community around the world, for help, ideas, and discussions on AI.
  232. - View our official [Blog](https://portkey.wiki/gh-78)
  233. - Chat with us on [Discord](https://portkey.wiki/community)
  234. - Follow us on [Twitter](https://portkey.wiki/gh-79)
  235. - Connect with us on [LinkedIn](https://portkey.wiki/gh-80)
  236. - Read the documentation in [Japanese](./.github/README.jp.md)
  237. - Visit us on [YouTube](https://portkey.wiki/gh-103)
  238. - Join our [Dev community](https://portkey.wiki/gh-82)
  239. <!-- - Questions tagged #portkey on [Stack Overflow](https://stackoverflow.com/questions/tagged/portkey) -->
  240. ![Rubeus Social Share (4)](https://github.com/Portkey-AI/gateway/assets/971978/89d6f0af-a95d-4402-b451-14764c40d03f)

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.