This ComfyUI workflow turns plain-language prompts into short, cinematic video using the GeminiVideoOmni node. A Prompt Constructor subgraph (node id 3762e4c1-c5e0-4e1b-9449-e5ea5e9948cd) helps you build a well-formed prompt that explicitly includes duration and aspect ratio—two fields Gemini Omni Video expects in the text. Once composed, the prompt is sent through GeminiVideoOmni to the Gemini API, which synthesizes the clip based on your scene description, camera direction, motion cues, and lighting notes.
While the video is generating, PreviewAny provides an inline preview so you can quickly evaluate framing and motion. When you're happy, SaveVideo writes the final result to your output folder as a single video file. A MarkdownNote included in the canvas captures quick tips and reminders (like always specifying duration and aspect ratio). The layout keeps the most important levers up front, making it ideal for rapid iteration, prototyping, and prompt-driven storytelling.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run this workflow (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
const wf = await client.workflows.fromFile("workflow_api.json");
const job = await client.run(wf);
await job.getOutputs("<output-node-id>")[0].toFile("output.png");The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
