The 'Vidu Q1: Reference to Video' workflow in ComfyUI is designed to generate videos with consistent subjects by utilizing multiple reference images. This technique is particularly useful for maintaining character and style continuity throughout a video sequence. The workflow leverages the Vidu Q1 and Vidu models, which are specialized for video generation tasks. Key nodes in this workflow include the ViduReferenceVideoNode, which processes up to seven reference images to ensure that the generated video maintains a coherent visual style and subject matter. The LoadImage and ImageBatch nodes are used to input and manage the reference images, while the SaveVideo node finalizes the output by saving the generated video file. This workflow is especially beneficial for creators looking to produce videos where character consistency is crucial, such as in animated storytelling or branding videos. By using multiple reference images, users can input different perspectives or scenes, which the workflow then synthesizes into a seamless video, ensuring that the character or style remains uniform across frames.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run "Vidu Q1: Reference to Video" (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
// This workflow, exported in API format (see note below)
const wf = await client.workflows.fromFile("api_vidu_reference_to_video_api.json");
const asset = client.assets.fromFile("input.png");
wf.setInput("28", "image", asset); // LoadImage
const job = await client.run(wf);
await job.getOutputs("21")[0].toFile("output.png"); // SaveVideoThe SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
