Skip to content
Back to search

llm-as-judge

Agent skill that has an independent model score the last turn from 0 to 10.

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/orenatobr--llm-as-judge/badge.svg)](/listings/orenatobr--llm-as-judge)

HTML

<a href="/listings/orenatobr--llm-as-judge"><img src="/api/listings/orenatobr--llm-as-judge/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

For Claude Code, copy the skill folders into your personal skills directory:

git clone https://github.com/orenatobr/llm-as-judge.git
mkdir -p ~/.claude/skills
cp -R llm-as-judge/skills/* ~/.claude/skills/
mkdir -p ~/.claude/scripts
cp llm-as-judge/scripts/* ~/.claude/scripts/
chmod +x ~/.claude/scripts/*.sh

Start a new Claude Code session. Skills load from the `description` in each `SKILL.md`, so they trigger on their own and can also be called by name.

Other agents: each skill is a folder with a `SKILL.md` (YAML frontmatter plus Markdown). Tools that read the Agent Skills format can load `skills/` as it is. For the rest, paste the body of the `SKILL.md` into the agent's instruction file.

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 49 lines
  1. # llm-as-judge
  2. An independent model scores the agent's last turn on what code cannot check: whether the answer follows the request, whether the tone fits, and whether a diff does what the request asked. Below 7 the agent iterates on the feedback. At 7 or above it moves on. `scripts/llm-judge.sh` calls the `claude` CLI with Claude Fable 5.1 and falls back to Opus 5.5. It runs only after `quality-gate` passed for the same turn.
  3. ## Install
  4. For Claude Code, copy the skill folders into your personal skills directory:
  5. ```bash
  6. git clone https://github.com/orenatobr/llm-as-judge.git
  7. mkdir -p ~/.claude/skills
  8. cp -R llm-as-judge/skills/* ~/.claude/skills/
  9. mkdir -p ~/.claude/scripts
  10. cp llm-as-judge/scripts/* ~/.claude/scripts/
  11. chmod +x ~/.claude/scripts/*.sh
  12. ```
  13. Start a new Claude Code session. Skills load from the `description` in each `SKILL.md`, so they trigger on their own and can also be called by name.
  14. Other agents: each skill is a folder with a `SKILL.md` (YAML frontmatter plus Markdown). Tools that read the Agent Skills format can load `skills/` as it is. For the rest, paste the body of the `SKILL.md` into the agent's instruction file.
  15. ## Usage
  16. Run `/quality-gate` first, then `/llm-as-judge`. The skill passes `--state`, `--turn` and `--transcript` to the script. A Stop hook can automate both, but this repo does not ship one.
  17. ## Requirements
  18. `claude` CLI on PATH, `jq`, `git` and `python3`. Install [quality-gate](https://github.com/orenatobr/quality-gate) as well, because the judge refuses to run until the gate has passed.
  19. ## Related skills
  20. [quality-gate](https://github.com/orenatobr/quality-gate) (must run first).
  21. ## What is in this repo
  22. | Path | Purpose |
  23. |------|---------|
  24. | `skills/llm-as-judge/` | The `llm-as-judge` skill. |
  25. | `scripts/` | Helper scripts that the skill calls. |
  26. | `CHANGELOG.md` | Notable changes, in Keep a Changelog format. |
  27. | `AGENTS.md` | Rules for AI agents that edit this repo. |
  28. ## Contributing
  29. `main` is protected: changes land through a pull request with one approval. See [AGENTS.md](AGENTS.md) for the conventions.
  30. ## License
  31. MIT, see [LICENSE](LICENSE).

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.