Wan2.1 VACE Control Video is a guided video-to-video workflow that preserves the motion and timing of a source video while restyling or re-characterizing it with a text prompt and a reference image. It loads Wan2.1 VACE checkpoints (1.3B or 14B) via UNETLoader and VAELoader, encodes your text with CLIPTextEncode, and conditions generation with control signals derived from simple image preprocessing (Canny by default). GetVideoComponents reads frames and FPS from the input clip, and TrimVideoLatent keeps the latent sequence aligned with your chosen frame range and resolution before sampling.
Under the hood, ModelSamplingSD3 configures the expected sampler schedule for Wan2.1 VACE, and KSampler performs denoising on a sequence of video latents assembled by WanVaceToVideo using your control video, prompt, and reference image. VAEDecode converts the final latents back to frames, CreateVideo assembles them at the desired FPS, and you can export either MP4 (SaveVideo) or animated WebP (SaveAnimatedWEBP). An optional CausVid LoRA (LoraLoader) can accelerate or stabilize motion with very low steps, though you may need to tune its strength. The 14B model yields higher fidelity (and supports 720p) but runs slower and uses more VRAM; the 1.3B variant is faster and suited to 480p outputs.
API
通过代码使用此工作流
每个 Comfy 工作流都是一个 JSON 图。下面的内容就是此工作流的完整数据,ComfyUI 运行时也是如此——你可以从该 URL 获取、放入版本控制,或在 ComfyUI 中加载并逐节点运行。
使用 Comfy SDK 从 TypeScript 或 Python 运行。相同代码可用于 Comfy Cloud 或你自托管的 ComfyUI——只需更改基础 URL。
// Install (beta)
npm i @comfyorg/sdk
// Run "Wan VACE控制视频" (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
// This workflow, exported in API format (see note below)
const wf = await client.workflows.fromFile("video_wan_vace_14B_v2v_api.json");
const asset = client.assets.fromFile("input.png");
wf.setInput("134", "image", asset); // LoadImage
wf.setInput("6", "text", "your prompt here"); // CLIPTextEncode
const job = await client.run(wf);
await job.getOutputs("70")[0].toFile("output.png"); // SaveAnimatedWEBPSDK 需要 API 格式的工作流:在 ComfyUI 中打开此工作流,使用 文件 → 导出工作流(API)。
常见问题















