This workflow teaches you how to steer Gemini Omni 1.1 Flash to generate a video that features specific people, products, or objects without ever cutting to the original photos. It does this by binding each loaded reference image to a role tag (for example, <IMAGE_REF_0>, <IMAGE_REF_1>) and then using those tags inside your scene description so the model knows which visual subject to synthesize into the shot. The core is the GeminiVideoOmniV2 node running in reference mode, fed by one or more LoadImage nodes for character and style/product references, and finalized by a SaveVideo node to write the result to disk. A MarkdownNote in the graph documents the prompt pattern and tag usage.
Technically, each reference image is converted into a visual embedding that conditions Gemini Omni 1.1 Flash during generation. When you reference the bound tags in your prompt (for example, "Use <IMAGE_REF_0> as the model; use <IMAGE_REF_1> as the makeup palette product"), the model synthesizes frames that include those subjects while never showing the source images as frames. You can combine character references with a separate style or product board, direct the scene in plain language (actions, camera moves, lighting, location), and, when enabled in the node, generate native audio. This makes it ideal for brand-consistent shorts, character-driven storytelling, and product placement where control over who/what appears on screen matters.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run this workflow (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
const wf = await client.workflows.fromFile("workflow_api.json");
const job = await client.run(wf);
await job.getOutputs("<output-node-id>")[0].toFile("output.png");The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
