Skip to content
Back to search

comfy-pilot

MCP server + embedded terminal that lets Claude Code see and edit your ComfyUI workflows

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/constantineb6--comfy-pilot/badge.svg)](/listings/constantineb6--comfy-pilot)

HTML

<a href="/listings/constantineb6--comfy-pilot"><img src="/api/listings/constantineb6--comfy-pilot/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

**CLI (Recommended):**

comfy node install comfy-pilot

**ComfyUI Manager:** 1. Open ComfyUI 2. Click **Manager** → **Install Custom Nodes** 3. Search for "Comfy Pilot" 4. Click **Install** 5. Restart ComfyUI

**Git Clone:**

cd ~/Documents/ComfyUI/custom_nodes && git clone https://github.com/ConstantineB6/comfy-pilot.git

Claude Code CLI will be installed automatically if not found.

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 204 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. # Comfy Pilot
  2. [![Stars](https://img.shields.io/github/stars/ConstantineB6/Comfy-Pilot)](https://github.com/ConstantineB6/Comfy-Pilot/stargazers)
  3. [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
  4. [![ComfyUI Registry](https://img.shields.io/badge/ComfyUI-Registry-blue)](https://registry.comfy.org/publishers/constantine/nodes/comfy-pilot)
  5. Talk to your ComfyUI workflows. Comfy Pilot gives Claude Code direct access to see, edit, and run your workflows — with an embedded terminal right inside ComfyUI.
  6. ![Comfy Pilot](thumbnail.jpg)
  7. ## Why?
  8. Building ComfyUI workflows means manually searching for nodes, dragging connections, and tweaking values one at a time. With Comfy Pilot, you just describe what you want:
  9. - *"Build me an SDXL workflow with ControlNet"* — Claude creates all the nodes, connects them, and sets the parameters
  10. - *"Look at the output and increase the detail"* — Claude sees your generated image and adjusts the workflow
  11. - *"Download the FLUX schnell model and set up a workflow for it"* — Claude downloads the model and builds a workflow from scratch
  12. No copy-pasting node names. No hunting through menus. Just say what you want.
  13. ## Installation
  14. **CLI (Recommended):**
  15. ```bash
  16. comfy node install comfy-pilot
  17. ```
  18. **ComfyUI Manager:**
  19. 1. Open ComfyUI
  20. 2. Click **Manager** → **Install Custom Nodes**
  21. 3. Search for "Comfy Pilot"
  22. 4. Click **Install**
  23. 5. Restart ComfyUI
  24. **Git Clone:**
  25. ```bash
  26. cd ~/Documents/ComfyUI/custom_nodes && git clone https://github.com/ConstantineB6/comfy-pilot.git
  27. ```
  28. Claude Code CLI will be installed automatically if not found.
  29. ## Requirements
  30. - ComfyUI
  31. - Python 3.8+
  32. ## Features
  33. - **MCP Server** - Gives Claude Code direct access to view, edit, and run your ComfyUI workflows
  34. - **Embedded Terminal** - Full xterm.js terminal running Claude Code right inside ComfyUI
  35. - **Image Viewing** - Claude can see outputs from Preview Image and Save Image nodes
  36. - **Graph Editing** - Create, delete, move, and connect nodes programmatically
  37. ## Demo
  38. https://github.com/user-attachments/assets/325b1194-2334-48a1-94c3-86effd1fef02
  39. ## Usage
  40. 1. Restart ComfyUI after installation
  41. 2. The floating Claude Code terminal appears in the top-right corner
  42. 3. The MCP server is automatically configured for Claude Code
  43. 4. Ask Claude to help with your workflow:
  44. - "What nodes are in my current workflow?"
  45. - "Add a KSampler node connected to my checkpoint loader"
  46. - "Look at the preview image and tell me what you see"
  47. - "Run the workflow up to node 5"
  48. ## MCP Tools
  49. The MCP server provides these tools to Claude Code:
  50. | Tool | Description |
  51. |------|-------------|
  52. | `get_workflow` | Get the current workflow from the browser |
  53. | `summarize_workflow` | Human-readable workflow summary |
  54. | `get_node_types` | Search available node types with filtering |
  55. | `get_node_info` | Get detailed info about a specific node type |
  56. | `get_status` | Queue status, system stats, and execution history |
  57. | `run` | Run workflow (optionally up to a specific node) or interrupt |
  58. | `edit_graph` | Batch create, delete, move, connect, and configure nodes |
  59. | `view_image` | View images from Preview Image / Save Image nodes |
  60. | `search_custom_nodes` | Search ComfyUI Manager registry for custom nodes |
  61. | `install_custom_node` | Install a custom node from the registry |
  62. | `uninstall_custom_node` | Uninstall a custom node |
  63. | `update_custom_node` | Update a custom node to latest version |
  64. | `download_model` | Download models from Hugging Face, CivitAI, or direct URLs |
  65. ### Example: Creating Nodes
  66. ```
  67. Create a KSampler and connect it to my checkpoint loader
  68. ```
  69. Claude will use `edit_graph` to:
  70. 1. Create the KSampler node
  71. 2. Connect the MODEL output from CheckpointLoader to KSampler's model input
  72. 3. Position it appropriately in the graph
  73. ### Example: Viewing Images
  74. ```
  75. Look at the preview image and describe what you see
  76. ```
  77. Claude will use `view_image` to fetch and analyze the image output.
  78. ### Example: Downloading Models
  79. ```
  80. Download the FLUX.1 schnell model for me
  81. ```
  82. Claude will use `download_model` to download from Hugging Face to your ComfyUI models folder. Supports:
  83. - Hugging Face (including gated models with token auth)
  84. - CivitAI
  85. - Direct download URLs
  86. ## Terminal Controls
  87. - **Drag** title bar to move
  88. - **Drag** bottom-right corner to resize
  89. - **−** Minimize
  90. - **×** Close
  91. - **↻** Reconnect session
  92. ## Architecture
  93. ```
  94. ┌─────────────────────────────────────────────────────┐
  95. │ Browser (ComfyUI) │
  96. │ ┌─────────────────┐ ┌──────────────────────────┐ │
  97. │ │ xterm.js │ │ Workflow State │ │
  98. │ │ Terminal │ │ (synced to backend) │ │
  99. │ └────────┬────────┘ └────────────┬─────────────┘ │
  100. │ │ WebSocket │ REST API │
  101. └───────────┼────────────────────────┼────────────────┘
  102. │ │
  103. ▼ ▼
  104. ┌─────────────────────────────────────────────────────┐
  105. │ ComfyUI Server │
  106. │ ┌─────────────────┐ ┌──────────────────────────┐ │
  107. │ │ PTY Process │ │ Plugin Endpoints │ │
  108. │ │ (claude CLI) │ │ /claude-code/* │ │
  109. │ └─────────────────┘ └──────────────────────────┘ │
  110. └─────────────────────────────────────────────────────┘
  111. │ │
  112. │ ▼
  113. │ ┌──────────────────────────┐
  114. └──────────▶│ MCP Server │
  115. │ (stdio transport) │
  116. └──────────────────────────┘
  117. ```
  118. ## Files
  119. - `__init__.py` - Plugin backend: WebSocket terminal, REST endpoints
  120. - `js/claude-code.js` - Frontend: xterm.js terminal, workflow sync
  121. - `mcp_server.py` - MCP server for Claude Code integration
  122. - `CLAUDE.md` - Instructions for Claude when working with ComfyUI
  123. ## Troubleshooting
  124. ### "Command 'claude' not found"
  125. Install Claude Code CLI:
  126. **macOS / Linux / WSL:**
  127. ```bash
  128. curl -fsSL https://claude.ai/install.sh | bash
  129. ```
  130. **Windows (PowerShell):**
  131. ```powershell
  132. irm https://claude.ai/install.ps1 | iex
  133. ```
  134. **Windows (CMD):**
  135. ```cmd
  136. curl -fsSL https://claude.ai/install.cmd -o install.cmd && install.cmd && del install.cmd
  137. ```
  138. ### MCP server not connecting
  139. The plugin auto-configures MCP on startup. Check ComfyUI console for errors, or manually add to `~/.claude.json`:
  140. ```json
  141. {
  142. "mcpServers": {
  143. "comfyui": {
  144. "command": "python3",
  145. "args": ["/path/to/comfy-pilot/mcp_server.py"]
  146. }
  147. }
  148. }
  149. ```
  150. ### Terminal disconnected
  151. Click the ↻ button to reconnect, or check ComfyUI console for errors.
  152. ## License
  153. MIT

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.