This ComfyUI workflow, titled 'Vidu Q1: Image to Video,' is designed to transform static images into dynamic 1080p videos with precise motion control. Utilizing the Vidu Q1 model, this workflow allows users to customize movement amplitude, providing a versatile tool for creating engaging video content from still images. The core of this workflow involves the 'ViduImageToVideoNode,' which processes the image input to generate a video output, and the 'SaveVideo' node, which ensures your final product is stored efficiently. Additionally, the 'LoadImage' node is used to import your static images into the workflow seamlessly.
Technically, this workflow leverages the capabilities of the Vidu model to interpret and animate static images, adding motion in a controlled and customizable manner. This is particularly useful for content creators and marketers looking to enhance their visual storytelling by adding dynamic elements to otherwise static visuals. The workflow's integration with the API requires a secure network environment, ensuring that the transformation process is both efficient and secure.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run "Vidu Q1: Image to Video" (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
// This workflow, exported in API format (see note below)
const wf = await client.workflows.fromFile("api_vidu_image_to_video_api.json");
const asset = client.assets.fromFile("input.png");
wf.setInput("22", "image", asset); // LoadImage
const job = await client.run(wf);
await job.getOutputs("21")[0].toFile("output.png"); // SaveVideoThe SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
