ifixai-community
iFixAi tools for Claude Code. Claude guides you through an independent, open-source audit of your own agent: is it doing the job it's supposed to do, given your business rules and org structure? Test any model (Anthropic, OpenAI, Gemini, Azure, Bedrock, …) graded by the judge(s) of your choice.
Safety scan
A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.
Check it deeper on your machine
It has changed since its scan on 11 Nov 2026.
As a Claude Code plugin, install it and then ask Claude Code:
/plugin marketplace add keithmackay/mackayi/plugin install scanskillsafety@mackayiDo a deep scan of https://github.com/ifixai-ai/iFixAi with scanskillsafety
Or from a terminal, clone it and run it:
git clone https://github.com/keithmackay/scanskillsafety-skill ~/.claude/skills/scanskillsafetynode ~/.claude/skills/scanskillsafety/cli.cjs --deep 'https://github.com/ifixai-ai/iFixAi'
It checks the exact commit: every file, its packages against OSV (api.osv.dev), how it compares with this page's scan (findsafeskills.com receives the repository's address), and, if you agree, Claude reading every file with your own Claude subscription. It never runs the code.
Badge for your README
Markdown
[](/listings/ifixai-ai-ifixai)HTML
<a href="/listings/ifixai-ai-ifixai"><img src="/api/listings/ifixai-ai-ifixai/badge.svg" alt="findsafeskills safety rating" /></a>Install
Install instructions from the README
As written by the repo's author. findsafeskills has not verified these steps.
Now try it yourself. Pick a path from the table above; full walkthrough: **[docs/get-started.md](docs/get-started.md)**.
Guided wizard (recommended)
pip install "ifixai[openai]" # or anthropic, gemini, etc.: install the provider extra you'll test ifixai setup # arrow-key wizard: pick provider, model, judge, suite → writes ifixai.yaml ifixai run # no flags needed; reports land in ./ifixai-results/
`ifixai setup` detects API keys already in your environment and surfaces them at the top of each prompt. No key found? The wizard tells you which env var to export; if it's still missing when you run, you'll be prompted for it before the first API call.
**Windows note:** if PowerShell can't find `ifixai` after `pip install`, add Python's `Scripts\` folder to your PATH, or run it as `python -m ifixai`. This is the usual Python-on-Windows PATH gap, not an iFixAi issue.
Plugin (Claude Code and Codex)
The recommended way to run from an agent: a one-time native install with an auto-provisioning hook, so there is nothing to set up per run. Ask in plain English (*"run iFixAi on my setup"*) and the agent discovers your config, builds the fixture, names the cost before anything is billed, runs the diagnostic on the model(s) and judge(s) you pick, then walks you through the scorecard.
**Claude Code**, from inside [Claude Code](https://claude.com/claude-code):
/plugin marketplace add ifixai-ai/iFixAi /plugin install ifixai@ifixai-community
Then ask *"run iFixAi on my setup"*, or type **`/ifixai:ifixai`**. (Restart Claude Code or run `/reload-plugins` if it doesn't appear.) Already on `ifixai@ifixai-ai`? That keeps working, and to move to the new marketplace name you run `/plugin marketplace remove ifixai-ai` first, then the two commands above.
**Codex**, in your terminal:
codex plugin marketplace add ifixai-ai/iFixAi codex plugin add ifixai@ifixai-community
Then start Codex and ask *"run iFixAi on my setup"*. Codex asks once to trust the plugin's hook, then provisions the engine on the first session. Already on `ifixai@ifixai-ai`? `codex plugin marketplace upgrade` fails on the renamed marketplace, so run `codex plugin marketplace remove ifixai-ai` first, then the two commands above.
Skill (every agent)
Prefer a single scaffolded file, or use an agent without a plugin? One zero-install command writes a native **`/ifixai-skill`** slash command into any agent: **Claude Code, Codex**, Cursor, VS Code / Copilot, Windsurf, Cline, Continue, Gemini, or Zed (plus an `AGENTS.md` bridge). Only `uv` and Python 3.10+ are needed; no API key or provider extra to scaffold:
uvx ifixai install --agents cursor # any slug: claude, codex, vscode, windsurf, cline, continue, gemini, zed uvx ifixai install --agents all # scaffold every agent at once uvx ifixai install --list # every supported agent and where its file lands
Then run **`/ifixai-skill`** in that agent. It reads your setup, builds the fixture, shows the cost via a free `--dry-run`, and runs only after you say yes (the run is zero-install too, driving `uvx --from "ifixai[<provider>]" ifixai run`). On a new project, name the agent with `--agents` (auto-detect only finds agents whose folder already exists). Already have the CLI on your PATH? Drop the `uvx` prefix. The command is named `ifixai-skill` so it never collides with the Claude Code plugin's `/ifixai`; pass `--name ifixai` for the bare name.
Explicit flags
# 1. Install the CLI + the extra for the provider you'll test pip install "ifixai[anthropic]" # 2. Prove the pipeline runs: built-in mock, no keys, no network, ~1s. # Expect a FAILING scorecard (15/60) — the bundled default fixture ships # seeded defects on purpose so you see what failures look like. # Defect map: ifixai/fixtures/default/README.md ifixai run --provider mock --api-key not-used --eval-mode self
What was scanned
The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.
.claude-plugin/marketplace.json · Manifest · 17 lines
View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)
This file has changed since it was scanned, so this is not exactly the text that was scanned, and no line is marked. The findings are listed with the safety scan above.
- {
- "name": "ifixai-community",
- "description": "iFixAi tools for Claude Code. Claude guides you through an independent, open-source audit of your own agent: is it doing the job it's supposed to do, given your business rules and org structure? Test any model (Anthropic, OpenAI, Gemini, Azure, Bedrock, …) graded by the judge(s) of your choice.",
- "owner": {
- "name": "iFixAi",
- "url": "https://github.com/ifixai-ai/iFixAi"
- },
- "plugins": [
- {
- "name": "ifixai",
- "source": "./plugin",
- "description": "Independent auditing for AI agents, open source. Claude discovers your setup, confirms the cost, and audits your agent against the one question other tools skip: is it doing the job it's supposed to do, given your business rules and org structure? Test any model (Anthropic, OpenAI, Gemini, Azure, Bedrock, …) graded by self, one independent judge, or a cross-vendor panel; each provider is billed to its own account via a key in your settings, never the command line. Results render as an interactive artifact (with a static-report fallback).",
- "category": "testing",
- "tags": ["evaluation", "alignment", "safety", "diagnostic", "agent-testing"]
- }
- ]
- }
README.md · README · 180 lines
View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)
This file has changed since it was scanned, so this is not exactly the text that was scanned, and no line is marked. The findings are listed with the safety scan above.
- <p align="center">
- <a href="https://www.ifixai.ai/?utm_source=github&utm_medium=readme&utm_content=masthead">
- <picture>
- <source media="(prefers-color-scheme: dark)" srcset="docs/assets/brand/ifixai-masthead-dark.svg" />
- <img src="docs/assets/brand/ifixai-masthead-light.svg" alt="iFixAi: Independent auditing for AI agents" width="440" />
- </picture>
- </a>
- </p>
- <p align="center">
- <a href="README.md">English</a> · <a href="README.zh-CN.md">简体中文</a> · <a href="README.ja.md">日本語</a> · <a href="README.ko.md">한국어</a>
- </p>
- <p align="center">Catch your agent's mistakes and blind spots before the shit hits the fan.</p>
- <p align="center">
- <a href="https://www.producthunt.com/products/ifixai?embed=true&utm_source=badge-top-post-badge&utm_medium=badge&utm_campaign=badge-ifixai" target="_blank" rel="noopener noreferrer"><picture><source media="(min-width: 600px)" srcset="https://api.producthunt.com/widgets/embed-image/v1/top-post-badge.svg?post_id=1252633&theme=neutral&period=daily&t=1790752077394" width="250" height="54" /><img src="https://api.producthunt.com/widgets/embed-image/v1/top-post-badge.svg?post_id=1252633&theme=neutral&period=daily&t=1790752077394" alt="iFixAi - Independent auditing of AI agents to uncover misalignment | Product Hunt" width="48.5%" /></picture></a>
- <a href="https://trendshift.io/repositories/29638?utm_source=repository-badge&utm_medium=badge&utm_campaign=badge-repository-29638" target="_blank" rel="noopener noreferrer"><picture><source media="(min-width: 600px)" srcset="https://trendshift.io/api/badge/repositories/29638" width="250" height="55" /><img src="https://trendshift.io/api/badge/repositories/29638" alt="iFixAi on GitHub Trending | Trendshift" width="48.5%" /></picture></a>
- <br />
- <a href="https://trendshift.io/repositories/29638?utm_source=trendshift-badge&utm_medium=badge&utm_campaign=badge-trendshift-29638" target="_blank" rel="noopener noreferrer"><picture><source media="(min-width: 600px)" srcset="https://trendshift.io/api/badge/trendshift/repositories/29638/daily?language=Python" width="250" height="55" /><img src="https://trendshift.io/api/badge/trendshift/repositories/29638/daily?language=Python" alt="iFixAi — Python repository of the day on Trendshift" width="48.5%" /></picture></a>
- <a href="https://trendshift.io/repositories/29638" target="_blank" rel="noopener noreferrer"><picture><source media="(min-width: 600px)" srcset="https://trendshift.io/api/badge/trendshift/repositories/29638/weekly?language=Python" width="250" height="55" /><img src="https://trendshift.io/api/badge/trendshift/repositories/29638/weekly?language=Python" alt="iFixAi — #1 Python repository of the week on Trendshift" width="48.5%" /></picture></a>
- <br />
- <a href="https://runacap.com/ross-index/q3-2026/" target="_blank" rel="noopener noreferrer"><picture><source media="(min-width: 600px)" srcset="https://runacap.com/wp-content/uploads/2026/02/ROSS_badge_white_Q3_2026.svg" width="250" height="54" /><img src="https://runacap.com/wp-content/uploads/2026/02/ROSS_badge_white_Q3_2026.svg" alt="ROSS Index - Fastest Growing Open-Source Startups in Q3 2026 | Runa Capital" width="48.5%" /></picture></a>
- </p>
- <p align="center">
- <a href="https://www.ifixai.ai/?utm_source=github&utm_medium=readme&utm_content=hero">
- <picture>
- <source media="(max-width: 600px)" srcset="docs/assets/brand/hero-audit-phone.svg" width="100%" />
- <source media="(prefers-color-scheme: dark)" srcset="docs/assets/brand/hero-audit-dark.svg" />
- <img src="docs/assets/brand/hero-audit-light.svg" alt="A customer support agent's refund ticket as its evals see it, every check green, then through an iFixAi audit: it hid a fraud flag, paid a refund a manager had declined and changed a payout account without authorisation, while closing the ticket was handled correctly. Illustrative scenario." width="728" />
- </picture>
- </a>
- </p>
- <p align="center">
- <a href="https://www.ifixai.ai/?utm_source=github&utm_medium=readme&utm_content=button"><picture><source media="(max-width: 600px)" srcset="docs/assets/brand/button-site.svg" width="48.5%" /><source media="(prefers-color-scheme: dark)" srcset="docs/assets/brand/button-site-dark.svg" /><img src="docs/assets/brand/button-site-light.svg" alt="Visit ifixai.ai" height="76" /></picture></a>
- </p>
- <p align="center">
- <a href="#quick-start">Quick start</a> • <a href="#test-your-own-agent">Test your agent</a> • <a href="#what-you-get-back">What you get back</a> • <a href="docs/">Docs</a> • <a href="CONTRIBUTING.md">Contributing</a>
- </p>
- <p align="center">
- <a href="https://pypi.org/project/ifixai/"><img src="https://img.shields.io/pypi/v/ifixai?logo=pypi&logoColor=white&color=6366f1" alt="PyPI version" /></a>
- <a href="https://pepy.tech/projects/ifixai"><img src="https://img.shields.io/pepy/dt/ifixai?color=6366f1" alt="Downloads" /></a>
- <a href="https://github.com/ifixai-ai/iFixAi/stargazers"><img src="https://img.shields.io/github/stars/ifixai-ai/iFixAi?style=flat&logo=github&color=6366f1" alt="GitHub stars" /></a>
- <a href="pyproject.toml"><img src="https://img.shields.io/badge/python-3.10%2B-6366f1?logo=python&logoColor=white" alt="Python 3.10+" /></a>
- <a href="#plugin-claude-code-and-codex"><img src="https://img.shields.io/badge/plugin-Claude%20Code%20%C2%B7%20Codex-6366f1?logo=claude&logoColor=white" alt="Plugin for Claude Code and Codex" /></a>
- <a href="LICENSE"><img src="https://img.shields.io/github/license/ifixai-ai/iFixAi?color=6366f1" alt="License: Apache 2.0" /></a>
- <a href="https://github.com/ifixai-ai/iFixAi/actions/workflows/ci.yml"><img src="https://github.com/ifixai-ai/iFixAi/actions/workflows/ci.yml/badge.svg" alt="CI" /></a>
- </p>
- ## How can you trust your AI agent?
- How do you know it will do its job the way it's supposed to, respecting your business as a whole: its intentions, its goals and who in the organization may do what? And how do you know it won't do something nobody asked for or authorized?
- That's why we built iFixAi, the independent auditor for agentic operational alignment and assurance. It puts your agent in a simulation of your business, sends it the requests a real day brings, including the ones that push it past its role, and a judge grades every reply. Every finding shows what was asked and what your agent did.
- The risk goes beyond cybersecurity, governance or compliance on their own, so iFixAi's inspections combine AI red teaming, governance, assurance and philosophy.
- ## Quick start
- See it work in a minute. No API key needed: it runs on a built-in demo agent with canned replies and canned grades, so you see the flow before you connect anything real. For a real audit, iFixAi picks a judge from a different provider than your agent. You need Python 3.10 or newer (a stock Mac's `python3` is 3.9, so check `python3 --version`). In a fresh virtualenv (`python3 -m venv .venv && source .venv/bin/activate`):
- ```bash
- pip install ifixai
- ifixai author reference -o reference.yaml
- ifixai validate reference.yaml
- ifixai run --provider mock --eval-mode self --fixture reference.yaml
- ```
- This builds the simulation environment for an example agent, a support agent at a fictional fintech ([its profile](ifixai/fixtures/reference/profile.json)), checks it, and runs the [10 default inspections](#what-a-default-run-covers) on the demo agent. The scorecard prints in your terminal and the reports land in `./ifixai-results/`.
- On Windows, run `py -m venv .venv`, then `.venv\Scripts\activate`. If `ifixai` isn't found, use `python -m ifixai.cli.main`.
- ## Test your own agent
- Any agent with a chat endpoint must be audited, and iFixAi can audit it. An OpenAI-compatible endpoint works as it is; anything else takes [a few lines of Python](docs/testing-your-agent.md). Any model can be the judge: OpenAI, Anthropic, Gemini, Azure, Bedrock, OpenRouter and more. iFixAi picks one from the keys you've set, never your agent's own provider.
- There are two ways to run it.
- ### With your coding agent (recommended)
- Install the plugin or the skill, then ask your coding agent to *"run iFixAi on my agent"*. It finds your agent, builds its simulation environment, shows the cost before anything is billed, runs the audit and explains what it found.
- #### Plugin (Claude Code and Codex)
- In [Claude Code](https://claude.com/claude-code), run these, then ask, or type `/ifixai:ifixai` (`/reload-plugins` if it doesn't show up):
- ```
- /plugin marketplace add ifixai-ai/iFixAi
- /plugin install ifixai@ifixai-community
- ```
- Already installed? Run `/plugin marketplace update ifixai-community`, then `/reload-plugins`, to get the latest.
- Codex: run these in your terminal, then start Codex and ask. Moving from `ifixai@ifixai-ai`? See [plugin/README.md](plugin/README.md).
- ```
- codex plugin marketplace add ifixai-ai/iFixAi
- codex plugin add ifixai@ifixai-community
- ```
- #### Skill (Cursor, VS Code, Windsurf, Zed and more)
- ```bash
- uvx ifixai install --agents cursor
- ```
- Then type `/ifixai-skill` in that agent. Swap `cursor` for `claude`, `vscode`, `windsurf`, `cline`, `continue`, `gemini`, `zed` or `all`. More in [get started](docs/get-started.md#run-it-from-your-coding-agent).
- ### With the guided CLI
- 1. Describe your agent: copy the [reference profile](ifixai/fixtures/reference/profile.json) to `my-agent.json` and edit it ([how](docs/fixture_authoring.md)). Or let the plugin or skill do it: your coding agent reads your agent's code and writes the profile for you.
- 2. Build its simulation environment and check it. Install the extra for the judge you'll use: `openai` here, or `anthropic`, `gemini` and so on.
- ```bash
- pip install "ifixai[openai]"
- ifixai author my-agent.json -o my-agent.yaml
- ifixai validate my-agent.yaml
- ```
- 3. Set up the run with the wizard. It asks for your agent's endpoint, the judge and the suite, finds the judge's key and saves it all to `ifixai.yaml`. Then pass your agent's own token, see the plan before anything is billed, and run:
- ```bash
- ifixai setup
- export AGENT_API_KEY=... # your agent's own token
- ifixai run --fixture ./my-agent.yaml --api-key "$AGENT_API_KEY" --dry-run
- ifixai run --fixture ./my-agent.yaml --api-key "$AGENT_API_KEY"
- ```
- `--dry-run` shows how many tests and judge calls the run makes, and any checks that don't apply to your agent and why, then stops.
- Prefer flags, for scripts or CI? The same run in one command. This example grades with an OpenAI key; for another judge, set that provider's key.
- ```bash
- export OPENAI_API_KEY=sk-...
- export AGENT_API_KEY=... # your agent's own token
- ifixai run --provider http --endpoint <agent-url> --api-key "$AGENT_API_KEY" --fixture ./my-agent.yaml --dry-run
- ```
- `<agent-url>` is your agent's base URL, up to `/v1`. Use a staging copy, because the probes are real requests. No auth on it? Swap `--api-key "$AGENT_API_KEY"` for `--auth-method none`.
- ## What you get back
- - A pass or fail for each inspection, with the evidence behind it.
- - An A to F grade from five core pillars: fabrication, manipulation, deception, unpredictability and opacity.
- - Three mandatory minimums (B01, B08 and P01). Failing any of them caps the grade at D.
- - Reports in JSON and Markdown, so you can compare runs or gate CI with `--min-score`.
- More on [scoring](docs/scoring.md) and [every inspection](docs/inspections.md).
- ## What a default run covers
- `ifixai run` runs these 10 inspections. They're quick, they all work over chat, and together they're enough for a grade. Add `--full-run` for all 61 inspections; any that can't apply to your agent are set aside first, and the run tells you why.
- | Impact | ID | Checks that your agent… |
- |---|---|---|
- | High | `B01` | only lets a role use the tools it is allowed to use · *mandatory minimum* |
- | High | `B08` | cannot be talked into more access than the user has · *mandatory minimum* |
- | High | `P01` | never runs a destructive action for someone not allowed to · *mandatory minimum* |
- | High | `B12` | resists prompt injection |
- | High | `B09` | spots and blocks requests that break your policies |
- | High | `B27` | does not hand one user's private data to another |
- | Medium | `B06` | says when it is unsure instead of guessing with confidence |
- | Medium | `B16` | reports a failure instead of pretending it worked |
- | Medium | `B18` | sticks to the task it was given |
- | Medium | `B20` | follows exact instructions on format, length, and content |
- Other suites and options: [CLI](docs/cli.md#suite-options).
- ## Docs
- - New here: [Get started](docs/get-started.md)
- - Doing something: [Test your agent](docs/testing-your-agent.md) · [Build a simulation environment](docs/fixture_authoring.md)
- - Looking it up: [CLI](docs/cli.md) · [Python API](docs/python-api.md) · [Scoring](docs/scoring.md) · [Inspections](docs/inspections.md)
- - How it works: [Methodology](docs/methodology.md) · [Case studies](case_studies/)
- - Beyond live runs: [Audit recorded actions](docs/trajectory-assurance.md) · [Policy Lab](docs/business-policy-lab.md)
- - Contributing: [CONTRIBUTING.md](CONTRIBUTING.md) · [good first issues](https://github.com/ifixai-ai/iFixAi/issues?q=is%3Aopen+label%3A%22good+first+issue%22). Questions: a [GitHub issue](https://github.com/ifixai-ai/iFixAi/issues) or **info@ime.life**. Security: [SECURITY.md](SECURITY.md). License: [Apache 2.0](LICENSE).
Ratings and comments
Sign in to rate this skill.
Sign inFree to use. If it’s helped, pass it on.