AIDC-AI

ComfyUI-Copilot: Add AI Assistance to ComfyUI Workflows

ComfyUI-Copilot is a custom node that helps ComfyUI users create, debug, and revise image-generation workflows with AI assistance. It is useful for creators and developers who want workflow support and parameter tuning inside ComfyUI.

TypeScriptMITAIAgentAI Agents
Stars
5.5k
Forks
366
Stars, last 10 days
+12

Our take

Health score

36/100

How it is scored
Activity
31
Community
49
Issues
21
Pull requests
44

+12 stars in the last 10 days

Overview

ComfyUI-Copilot is an AI assistant integrated into ComfyUI as a custom node. It addresses the effort involved in building and troubleshooting node-based image-generation workflows by helping users generate workflows from descriptions, inspect errors, and revise an existing canvas.

It is aimed at ComfyUI creators and developers who want assistance during workflow development rather than a separate image-generation interface. Agent capabilities require configuration with an API key and base URL; the README notes that the hosted API service has been suspended.

Key Features

  • Generate workflow suggestions from a text description, including library-based options and an AI-generated workflow.
  • Analyze workflow errors and suggest fixes for parameters or node connections.
  • Rewrite an existing workflow based on requested changes, such as adding nodes or adjusting parameters.
  • Tune parameter ranges by running combinations and comparing generated results.
  • Recommend nodes and explain selected nodes, including parameter and usage information.
  • Recommend models and downstream node subgraphs based on user requests and the current canvas.

Use Cases

  • ComfyUI beginners can describe a desired image-generation setup and use suggested workflows as a starting point.
  • Workflow authors can use debugging assistance when a canvas has connection or parameter errors.
  • Experienced creators can request structural changes or parameter adjustments without manually rebuilding the entire graph.
  • Users comparing generation settings can batch-run parameter combinations and review visual results.

Getting Started

Clone the repository into ComfyUI's custom nodes directory and install its Python dependencies:

cd ComfyUI/custom_nodes
git clone https://github.com/AIDC-AI/ComfyUI-Copilot.git
cd ComfyUI-Copilot
pip install -r requirements.txt

See the README for activation, model configuration, and platform-specific installation instructions.

Considerations

  • This is a ComfyUI custom node, so it requires an existing ComfyUI installation.
  • The README says the hosted API service is suspended. To use Agent-related capabilities, configure your own API key and base URL in settings.
  • The README also announces that node information queries, job recommendations, and workflow generation from the service will no longer be available soon. Confirm current availability before relying on those features.
  • Workflow rewriting can require substantial context, and the README cautions that long conversations may interrupt the process. Newer models may also be difficult for the LLM to understand.
  • The repository is licensed under MIT. The listed implementation language is TypeScript, while installation dependencies are provided through a Python requirements file.

Found this useful?

Share it with someone who would like ComfyUI-Copilot.