Skip to content
Back to search

busbar

The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today

Check it deeper on your machine

It has changed since its scan on 11 Nov 2026.

As a Claude Code plugin, install it and then ask Claude Code:

/plugin marketplace add keithmackay/mackayi/plugin install scanskillsafety@mackayiDo a deep scan of https://github.com/GetBusbar/busbar with scanskillsafety

Or from a terminal, clone it and run it:

git clone https://github.com/keithmackay/scanskillsafety-skill ~/.claude/skills/scanskillsafetynode ~/.claude/skills/scanskillsafety/cli.cjs --deep 'https://github.com/GetBusbar/busbar'

It checks the exact commit: every file, its packages against OSV (api.osv.dev), how it compares with this page's scan (findsafeskills.com receives the repository's address), and, if you agree, Claude reading every file with your own Claude subscription. It never runs the code.

Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/getbusbar--busbar/badge.svg)](/listings/getbusbar--busbar)

HTML

<a href="/listings/getbusbar--busbar"><img src="/api/listings/getbusbar--busbar/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 351 lines · 1 finding marked

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. <p align="center">
  2. <img src="assets/busbar-logo.png" alt="Busbar" width="96" height="96">
  3. </p>
  4. <h1 align="center">Busbar</h1>
  5. <p align="center"><a href="http://www.GetBusbar.com?utm_source=github.com">GetBusbar.com</a></p>
  6. <p align="center">
  7. <strong>The self-hosted execution boundary for AI systems.</strong><br>
  8. Control where AI can go, what it may use, what authority it receives,
  9. what it may cost, and what evidence is retained—before it acts.
  10. </p>
  11. <p align="center">
  12. <a href="https://github.com/GetBusbar/busbar/actions/workflows/ci.yml"><img src="https://github.com/GetBusbar/busbar/actions/workflows/ci.yml/badge.svg" alt="CI"></a>
  13. <a href="https://codecov.io/gh/GetBusbar/busbar"><img src="https://codecov.io/gh/GetBusbar/busbar/branch/main/graph/badge.svg" alt="Coverage"></a>
  14. <a href="https://github.com/GetBusbar/busbar/releases"><img src="https://img.shields.io/github/v/release/GetBusbar/busbar?include_prereleases" alt="Release"></a>
  15. <a href="https://hub.docker.com/r/getbusbar/busbar"><img src="https://img.shields.io/docker/image-size/getbusbar/busbar?sort=semver&label=image" alt="Image size"></a>
  16. <a href="LICENSE"><img src="https://img.shields.io/badge/license-Apache--2.0-blue.svg" alt="License: Apache 2.0"></a>
  17. <a href="https://getbusbar.com"><img src="https://img.shields.io/badge/website-getbusbar.com-0A66C2" alt="Website"></a>
  18. <a href="https://discord.com/invite/nnK5evXERp"><img src="https://img.shields.io/badge/Discord-join%20chat-5865F2?logo=discord&logoColor=white" alt="Discord"></a>
  19. </p>
  20. Busbar sits between AI applications and the destinations they can reach:
  21. ```text
  22. Applications and agents → Busbar → Models, MCP tools, and A2A agents
  23. ```
  24. For traffic routed through Busbar, operators can verify, govern, route,
  25. and record model calls, tool use, and agent delegation before they reach
  26. approved destinations.
  27. Busbar is a self-hosted, customer-operated static Rust binary. It keeps
  28. provider credentials at the boundary, preserves supported native SDK
  29. workflows, and puts policy, budgets, routing, resilience, and execution
  30. evidence in one enforcement point.
  31. > **What this README demonstrates today:** Busbar's model execution
  32. > plane—native provider protocols, credential boundary, routing,
  33. > budgets, resilience, and audit evidence. MCP tool governance and A2A
  34. > agent trust use the same execution-boundary model.
  35. <picture>
  36. <source media="(prefers-color-scheme: dark)" srcset="assets/readme/matrix-dark.svg">
  37. <img src="assets/readme/matrix-light.svg" alt="Six by six matrix of ingress protocol against upstream protocol. All 36 pairs served. The same-protocol diagonal is forwarded byte for byte.">
  38. </picture>
  39. Six model wire protocols, first class on both sides: OpenAI, OpenAI
  40. Responses, Anthropic, Gemini, Cohere, and Bedrock Converse.
  41. Same-protocol routes are byte-for-byte identical to calling the provider
  42. directly, because Busbar forwards the original request bytes rather than
  43. re-serializing them. Cross-protocol routes translate modelled fields into
  44. the target provider's native shape.
  45. Self-hosted, always. No hosted service, no signup, and nothing phones
  46. home. Provider credentials stay in your infrastructure, at the
  47. enforcement boundary.
  48. ---
  49. ## Built for the governed hot path
  50. An enforcement boundary only works if teams can deploy it on every
  51. governed request path. Busbar is designed to make the decision in the
  52. path without becoming the bottleneck.
  53. <picture>
  54. <source media="(prefers-color-scheme: dark)" srcset="assets/readme/perf-dark.svg">
  55. <img src="assets/readme/perf-light.svg" alt="73 microseconds added latency p50, 65.1 microseconds of gateway CPU per request, 67,837 requests per second sustained with zero failures.">
  56. </picture>
  57. <picture>
  58. <source media="(prefers-color-scheme: dark)" srcset="assets/readme/memory-dark.svg">
  59. <img src="assets/readme/memory-light.svg" alt="Resident set size flat at 7.3 MiB idle, 22.4 MiB under sustained load, returning to 16.1 MiB when the load stops.">
  60. </picture>
  61. *Busbar 1.5.1, AWS m7g.4xlarge (Graviton3), 4-core pin, measured 2026-08-03. Same-protocol OpenAI cell. Across all 36 cells idle stayed between 7.32 and 7.42 MiB.*
  62. ---
  63. ## A boundary, not just a proxy
  64. <picture>
  65. <source media="(prefers-color-scheme: dark)" srcset="assets/readme/field-dark.svg">
  66. <img src="assets/readme/field-light.svg" alt="Wire protocol pairs served, idle resident memory and container image size, comparing Busbar with LiteLLM, Kong and Portkey.">
  67. </picture>
  68. | | Busbar | LiteLLM&nbsp;Py | LiteLLM&nbsp;Rust | Kong | Portkey |
  69. |---|---|---|---|---|---|
  70. | Wire protocol pairs served, of 36 | **36** | 8 | 1 | 4 | 8 |
  71. | Added latency p99, µs | **82** | 8,221 | 106 | 389 | 3,720 |
  72. | CPU per request at c=8, µs | **65** | 6,775 | 89 | 210 | 1,486 |
  73. | Requests/sec, zero failures | **67,837** | 170 | 48,354 | 22,418 | 855 |
  74. | Time to first token p50, µs | **129** | 9,088 | 181 | 105,907 | 27,908 |
  75. | Idle resident memory | **7.3 MiB** | 1,080 MiB | 253 MiB | 403 MiB | 124 MiB |
  76. | | Container image | Install |
  77. |---|---|---|
  78. | Busbar | **5.74 MiB**, 3 layers | one **12.39 MiB** binary, no runtime |
  79. | LiteLLM | 360.77 MiB, 21 layers | **558 MiB** across 107 packages |
  80. Measured 2026-08-03 on an m7g.4xlarge pinned to 4 cores. Image sizes are compressed registry layers for `getbusbar/busbar:latest` and `ghcr.io/berriai/litellm:main-latest`, linux/amd64.
  81. Busbar overlaps with AI gateways on protocol support, routing, and
  82. resilience. Its direction is broader: it is the customer-operated
  83. enforcement point for AI execution, beginning with model traffic and
  84. extending to governed tool and agent access.
  85. Three things we will say against ourselves:
  86. - **LiteLLM's provider catalogue is far larger than ours**, and that is a real reason to pick it. The coverage row counts ingress-to-upstream *wire protocol* pairs, not providers.
  87. - **LiteLLM Rust is early beta** with a deliberately narrow surface, and its overhead is the same class as ours. The difference there is scope, not speed.
  88. - **Kong is a general API gateway** with an LLM plugin bolted on. That is why its streaming row reads 106 ms and ours reads 129 µs.
  89. Every cell is published with its own verdict and reason at [onthebench.ai](https://onthebench.ai). The harness is open source, so you can disagree with it in public. &nbsp; [Busbar vs LiteLLM](https://getbusbar.com/docs/vs-litellm/)
  90. ---
  91. ## Put the boundary in the path
  92. Your application already speaks one of these protocols. Change the base
  93. URL and key; Busbar becomes the point where model destinations,
  94. credentials, routing, budgets, and execution evidence are controlled.
  95. ```diff
  96. - client = OpenAI(api_key=OPENAI_KEY)
  97. + client = OpenAI(api_key=BUSBAR_TOKEN, base_url="http://localhost:8080/v1")
  98. # "fast" is a pool you define in config: 80% Claude, 20% GPT, Bedrock on failover
  99. client.chat.completions.create(model="fast", messages=[{"role": "user", "content": "Hi"}])
  100. ```
  101. That request left as OpenAI, may have been served by Anthropic, and came back as OpenAI. If Anthropic had failed before the first byte, Busbar would have moved to the next lane without your client noticing.
  102. <details>
  103. <summary><strong>The same swap in the other five SDKs</strong></summary>
  104. ```python
  105. # Anthropic: the SDK appends /v1/messages, so the pool name goes in the base URL
  106. import anthropic
  107. client = anthropic.Anthropic(api_key="busbar-token", base_url="http://localhost:8080/fast")
  108. client.messages.create(model="ignored", max_tokens=1024, messages=[{"role": "user", "content": "Hi"}])
  109. # OpenAI Responses: same client as above, same base URL
  110. client.responses.create(model="fast", input="Hi")
  111. # Gemini
  112. from google import genai
  113. from google.genai import types
  114. client = genai.Client(api_key="busbar-token",
  115. http_options=types.HttpOptions(base_url="http://localhost:8080"))
  116. client.models.generate_content(model="fast", contents="Hi")
  117. # Cohere v2
  118. import cohere
  119. client = cohere.ClientV2(api_key="busbar-token", base_url="http://localhost:8080")
  120. client.chat(model="fast", messages=[{"role": "user", "content": "Hi"}])
  121. # Bedrock Converse: a SigV4 boto3 client, load balanced across non-Bedrock backends
  122. import boto3
  123. client = boto3.client("bedrock-runtime", region_name="us-east-1",
  124. endpoint_url="http://localhost:8080")
  125. client.converse(modelId="fast", messages=[{"role": "user", "content": [{"text": "Hi"}]}])
  126. ```
  127. Every one of these was run against Busbar 1.5.3 while writing this file. Full route and auth reference: [Protocols](https://getbusbar.com/docs/protocols/).
  128. </details>
  129. ---
  130. ## Model routing and resilience
  131. Model routing is one execution-plane capability. A pool is a weighted
  132. group of lanes that share a circuit breaker; a lane that fails before
  133. the first byte is replaced mid-request, and the breaker attributes the
  134. fault so a bad key benches one lane instead of tripping a healthy one.
  135. ```yaml
  136. providers:
  137. anthropic: { api_key: { env: ANTHROPIC_KEY } }
  138. openai: { api_key: { env: OPENAI_KEY } }
  139. bedrock: { api_key: { env: AWS_KEYPAIR } } # ACCESS_KEY_ID:SECRET_ACCESS_KEY
  140. models:
  141. claude: { provider: anthropic, upstream_model: claude-sonnet-4-5, max_concurrent: 40 }
  142. gpt: { provider: openai, upstream_model: gpt-4o, max_concurrent: 40 }
  143. claude-aws: { provider: bedrock, upstream_model: "anthropic.claude-3-5-sonnet-20241022-v2:0" }
  144. pools:
  145. fast:
  146. members:
  147. - { model: claude, weight: 8 } # 80 percent of traffic
  148. - { model: gpt, weight: 2 } # 20 percent
  149. - { model: claude-aws, weight: 1 } # same model, other cloud, picks up load when the others trip
  150. breaker:
  151. trip: { mode: consecutive, consecutive_n: 3 }
  152. base_cooldown_secs: 15
  153. failover:
  154. timeout_secs: 20
  155. max_hops: 2
  156. ```
  157. Your client never sees the hop, because the hop happens before the first byte reaches it, even on a streaming request. Once that first byte is out Busbar does not switch providers under your client: it records the fault against that lane and ends the stream with an error event, and the client retries. The state machine, the fault classes and the recovery probe are in [Reliability](https://getbusbar.com/docs/reliability/).
  158. ---
  159. ## Run it
  160. One binary and one YAML file. No interpreter, no database, no sidecar.
  161. ```bash
  162. curl -fsSL https://getbusbar.com/install.sh | sh # busbar + providers.yaml into ./
    • Note: Pipes a downloaded script directly into a shell (curl | sh / wget | bash)
    • Line 216 on GitHub
  163. cat > config.yaml <<'EOF'
  164. providers:
  165. anthropic: { api_key: { env: ANTHROPIC_KEY } } # the NAME of the env var, never the key
  166. models:
  167. claude: { provider: anthropic, upstream_model: claude-sonnet-4-5 }
  168. pools:
  169. fast:
  170. members:
  171. - { model: claude, weight: 1 }
  172. EOF
  173. export ANTHROPIC_KEY=sk-ant-...
  174. BUSBAR_CONFIG=./config.yaml ./busbar &
  175. curl -s localhost:8080/v1/chat/completions -H 'content-type: application/json' \
  176. -d '{"model":"fast","messages":[{"role":"user","content":"Hello!"}]}'
  177. ```
  178. Or the container, which ships a bootable default config, so one line is the whole thing:
  179. ```bash
  180. docker run --rm -p 8080:8080 -e ANTHROPIC_KEY -e BUSBAR_ADMIN_TOKEN getbusbar/busbar
  181. ```
  182. `busbar --validate` parses your config and every provider reference and exits non-zero on anything wrong, with no server, no network and no state, so it belongs in CI. Full walkthrough: [Getting started](https://getbusbar.com/docs/getting-started/).
  183. ---
  184. ## Kubernetes
  185. One container, no sidecar, nothing to run beside it. The image is 5.74 MiB compressed and the process idles at 7.3 MiB, both stamped in the comparison below, so it fits a 32Mi request and a 128Mi limit with room to spare.
  186. ```bash
  187. helm repo add busbar https://getbusbar.github.io/helm-charts
  188. helm install busbar busbar/busbar -f my-values.yaml
  189. ```
  190. <details>
  191. <summary><strong>Plain Deployment, Service and ConfigMap, without Helm</strong></summary>
  192. ```yaml
  193. apiVersion: v1
  194. kind: ConfigMap
  195. metadata: { name: busbar-config }
  196. data:
  197. config.yaml: |
  198. listen: "0.0.0.0:8080"
  199. config: { locked: true } # GitOps: config changes ship as a new ConfigMap
  200. providers:
  201. anthropic: { api_key: { env: ANTHROPIC_KEY } }
  202. openai: { api_key: { env: OPENAI_KEY } }
  203. models:
  204. claude: { provider: anthropic, upstream_model: claude-sonnet-4-5, max_concurrent: 20 }
  205. gpt: { provider: openai, upstream_model: gpt-4o, max_concurrent: 20 }
  206. pools:
  207. fast:
  208. members:
  209. - { model: claude, weight: 8 }
  210. - { model: gpt, weight: 2 }
  211. ---
  212. apiVersion: apps/v1
  213. kind: Deployment
  214. metadata: { name: busbar }
  215. spec:
  216. replicas: 2
  217. selector: { matchLabels: { app: busbar } }
  218. template:
  219. metadata: { labels: { app: busbar } }
  220. spec:
  221. containers:
  222. - name: busbar
  223. image: getbusbar/busbar:1.5.3
  224. env:
  225. - { name: BUSBAR_CONFIG, value: /etc/busbar/config.yaml }
  226. envFrom:
  227. - secretRef: { name: busbar-keys } # ANTHROPIC_KEY, OPENAI_KEY
  228. ports: [ { name: http, containerPort: 8080 } ]
  229. readinessProbe: { httpGet: { path: /healthz, port: http } }
  230. livenessProbe: { httpGet: { path: /healthz, port: http } }
  231. resources:
  232. requests: { cpu: 100m, memory: 32Mi }
  233. limits: { memory: 128Mi }
  234. securityContext:
  235. runAsNonRoot: true
  236. runAsUser: 65532
  237. readOnlyRootFilesystem: true
  238. allowPrivilegeEscalation: false
  239. capabilities: { drop: [ ALL ] }
  240. volumeMounts:
  241. - { name: config, mountPath: /etc/busbar, readOnly: true }
  242. volumes:
  243. - name: config
  244. configMap: { name: busbar-config }
  245. ---
  246. apiVersion: v1
  247. kind: Service
  248. metadata: { name: busbar }
  249. spec:
  250. selector: { app: busbar }
  251. ports: [ { name: http, port: 80, targetPort: http } ]
  252. ```
  253. `config: { locked: true }` is what lets the root filesystem be read-only: a mutable config needs a writable overlay path and Busbar refuses to boot without one. This Service is cluster-internal and the data plane has no auth chain, so turn on virtual keys before you expose it ([Governance](https://getbusbar.com/docs/guides/governance/)).
  254. </details>
  255. ---
  256. ## What Busbar governs
  257. Busbar's model execution plane includes native protocol support,
  258. provider credentials at the boundary, virtual keys, group budgets and
  259. spend tracking, weighted routing, per-lane concurrency caps,
  260. fault-attributed circuit breaking, in-flight failover, native TLS and
  261. mTLS, Prometheus and OTLP telemetry, and per-request audit webhooks.
  262. The broader execution-boundary model spans three planes:
  263. - **Model control:** Native model traffic, routing, budgets, provider
  264. credentials, resilience, and execution evidence.
  265. - **Tool governance:** Caller grants, approved schemas, budget
  266. enforcement, and drift quarantine for MCP tools.
  267. - **Agent trust:** Verification, pinning, re-verification, egress
  268. control, and target-bound credentials for A2A agents.
  269. The SemVer-protected contract is the runtime: the data-plane HTTP
  270. surface and supported wire-protocol contracts do not break inside a
  271. major version. `config.yaml` is an operator artifact outside that
  272. freeze; changes ship with `busbar --migrate-config` and a loud
  273. fail-closed boot rather than silent behavior changes.
  274. Single Rust binary, MSRV 1.97, Apache-2.0. Docs at
  275. [getbusbar.com](https://getbusbar.com), contributor documentation in
  276. [`docs/`](docs/).

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.