What clip length works best?

Keep inputs to 10 seconds or less. Shorter clips process faster and maintain better temporal consistency. Longer inputs may be slower or less stable depending on API limits.

Will the original audio be preserved?

Yes. The workflow is designed to export the edited video with its native audio via SaveVideo. If your source has no audio, the output will be silent.

How do I maximize consistency across frames?

Use simple, specific instructions and include “Keep everything else the same.” Avoid bundling many changes at once, minimize rapid camera motion, and keep the subject’s key attributes explicit (e.g., clothing, colors) if they must not change.

Can it export vertical video for social media?

Yes. Set the aspect ratio to 9:16 in GeminiVideoOmniV2 (and select 1080p or 4K as needed). The workflow will render a vertical output with the edit applied.

Gemini Omni 1.1 Flash: Video Edit

This ComfyUI workflow lets you edit a short video by simply describing the change you want. LoadVideo ingests your clip (the template includes input/hooded_wanderer_planet_bridge.mp4 as a ready-to-run test), and GeminiVideoOmniV2 sends both the video and your plain‑language instruction to Gemini Omni 1.1 Flash. The model applies targeted edits—like swapping backgrounds, restyling a scene, or adding/removing elements—while leaving everything else untouched. For maximum fidelity, include a line such as “Keep everything else the same.” Simple, direct prompts tend to produce the most consistent results.

On output, SaveVideo writes the edited clip to disk with the native audio preserved. You can choose 16:9 or 9:16 and render at 1080p or 4K, making it suitable for landscape or vertical content. A MarkdownNote in the graph provides quick tips. The recommended input duration is 10 seconds or less to ensure responsive processing and stable edits. This setup is ideal for rapid remixes and iterative refinement without regenerating entire scenes from scratch.

API

Use this workflow from code

Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.

8f82ff60ae5e.json

Fetching workflow JSON…

Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.

// Install (beta)
npm i @comfyorg/sdk

// Run this workflow (TypeScript)
import { Comfy } from "@comfyorg/sdk";

const client = new Comfy({ apiKey: "comfyui-..." });
const wf = await client.workflows.fromFile("workflow_api.json");
const job = await client.run(wf);
await job.getOutputs("<output-node-id>")[0].toFile("output.png");

The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).

Comfy Cloud API access requires a plan with an API key.

SDK docs Get an API key

FAQ

Frequently Asked Questions