Skip to content
Back to search

killdiff

Zero-config polyglot diff-only mutation tester catching hollow AI-generated tests in seconds (CLI, stdio MCP server, and GitHub Action).

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/flipcyde101--killdiff/badge.svg)](/listings/flipcyde101--killdiff)

HTML

<a href="/listings/flipcyde101--killdiff"><img src="/api/listings/flipcyde101--killdiff/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

npx killdiff --demo

Spins up a temporary git repo with a simulated refund-approval PR (`src/auth.mjs` + weak unit tests that pass baseline), mutates only the changed diff lines in parallel isolated sandboxes, and flags every surviving logic bug where tests failed to fail (`25%` score: 3 killed, 9 survived out of 12 mutants).

---

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 112 lines
  1. # killdiff
  2. **Zero-config polyglot diff-only mutation tester that catches hollow AI-generated tests in seconds. CLI, stdio MCP server (`verify_diff_tests`), and GitHub Action with zero runtime dependencies.**
  3. [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](./LICENSE)
  4. [![Node >=24](https://img.shields.io/badge/node-%3E%3D24.0.0-brightgreen.svg)](https://nodejs.org)
  5. [![Zero Dependencies](https://img.shields.io/badge/dependencies-0-informational.svg)](#architecture)
  6. [![Watch the 15-second killdiff demo](https://github.com/flipcyde101/killdiff/releases/download/v0.1.0/killdiff-poster.png)](https://github.com/flipcyde101/killdiff/releases/download/v0.1.0/killdiff-demo.mp4)
  7. [Watch the 15-second killdiff demo (MP4)](https://github.com/flipcyde101/killdiff/releases/download/v0.1.0/killdiff-demo.mp4)
  8. ---
  9. ## Catch Hollow AI Tests in Seconds (Zero Setup)
  10. ```bash
  11. npx killdiff --demo
  12. ```
  13. Spins up a temporary git repo with a simulated refund-approval PR (`src/auth.mjs` + weak unit tests that pass baseline), mutates only the changed diff lines in parallel isolated sandboxes, and flags every surviving logic bug where tests failed to fail (`25%` score: 3 killed, 9 survived out of 12 mutants).
  14. ---
  15. ## Quick Start
  16. ```bash
  17. # Mutate only lines changed against main
  18. npx killdiff main...HEAD
  19. # Enforce an 80% mutation score gate in CI with Markdown PR table
  20. npx killdiff origin/main...HEAD --max 25 --fail-under 80 --markdown
  21. # Output SARIF 2.1.0 for GitHub Code Scanning
  22. npx killdiff main...HEAD --sarif > killdiff.sarif
  23. # Override test runner explicitly
  24. npx killdiff main...HEAD --cmd "pytest -q"
  25. ```
  26. ---
  27. ## Connect to Your Coding Agent (Stdio MCP)
  28. `killdiff mcp` exposes `verify_diff_tests` so **Antigravity**, Claude Code, Codex, Cursor, and OpenCode can verify their own newly written tests actually kill logic mutations before handing a PR back to you.
  29. ```json
  30. {
  31. "mcpServers": {
  32. "killdiff": {
  33. "command": "npx",
  34. "args": ["-y", "killdiff", "mcp"]
  35. }
  36. }
  37. }
  38. ```
  39. ---
  40. ## Reusable GitHub Action
  41. ```yaml
  42. - uses: flipcyde101/killdiff@v0.1.0
  43. with:
  44. range: origin/main...HEAD
  45. max-mutants: 25
  46. fail-under: 80
  47. ```
  48. ---
  49. ## How `killdiff` Stays Fast & Safe
  50. - **Diff-only scope:** Parses `git diff --unified=0` so only executable code on changed lines is mutated (skips test files, comments, strings, imports, and type declarations).
  51. - **Polyglot on Day 1:** Mutates TypeScript/JavaScript, Python, Go, and Rust across boundary (`>=`/`>`, `<=`/`<`), equality (`===`/`!==`, `==`/`!=`), logical (`&&`/`||`, `and`/`or`), boolean (`true`/`false`, `True`/`False`), and arithmetic (`+`/`-`) operators.
  52. - **Isolated parallel sandboxes:** Never edits your real working tree. Creates ephemeral temp workspaces symlinking/junctioning `node_modules`/`.venv`/`target` for fast setup and cleans up automatically.
  53. - **Baseline & timeout guards:** Verifies baseline tests pass before mutating, caps runs with `--max 25`, and terminates infinite-loop mutants cleanly as `TIMEOUT` (counted as killed).
  54. ---
  55. ## Honest Comparison
  56. | Feature | `killdiff` | StrykerJS / `mutmut` | `cargo-mutants` | Static AI-slop linters |
  57. |---|---|---|---|---|
  58. | **Languages** | TS/JS, Python, Go, Rust | Single-language silos | Rust only | Regex/AST heuristics |
  59. | **Config required** | **Zero config** (auto-detects runner) | Per-project config file | Minimal | Minimal |
  60. | **Closed-loop agent MCP (`verify_diff_tests`)** | **Yes** | No | No | No |
  61. | **Mathematically proves tests fail on logic bugs** | **Yes** | Yes | Yes | No |
  62. | **Where competitors win** | (Lexical diff-scoped speed) | Full compiler-AST mutators across entire repositories | Deep Rust compiler integration & AST mutants | Instant millisecond feedback without running test suites |
  63. ---
  64. ## Architecture
  65. ```mermaid
  66. flowchart LR
  67. Diff["git diff --unified=0\n(Changed lines only)"] --> Lexer["Comment & String-Aware\nPolyglot Mutator\n(TS/JS · Py · Go · Rust)"]
  68. Lexer --> Pool["Parallel Isolated Sandboxes\n(junction/symlink deps +\n2.5x baseline timeout)"]
  69. Pool --> Report["Terminal · Markdown PR · SARIF 2.1.0\n+ Stdio MCP (verify_diff_tests)"]
  70. ```
  71. ---
  72. ## Local Agent Reliability Suite
  73. - **[kvdiff](https://github.com/flipcyde101/kvdiff)**: Zero-code local proxy pinpointing the exact UTF-8 byte breaking your LLM prompt cache (`Anthropic`, `OpenAI`, `Gemini/Antigravity`, `llama.cpp`/vLLM).
  74. - **[boxcheck](https://github.com/flipcyde101/boxcheck)**: Local DOM geometry, CSS cascade, and layout-collision oracle (CLI + MCP) over raw Node 24 WebSocket CDP.
  75. - **killdiff** *(this repo)*: Zero-config polyglot diff-only mutation tester catching hollow AI-generated tests (CLI + MCP + GitHub Action).
  76. ## License
  77. [MIT](./LICENSE)

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.