Gemini Omni Flash: Video Edit

Edit videos with natural language using Gemini Omni Flash, transforming a single input video into one edited output based on your descriptive instructions. Specify the duration and aspect ratio in your prompt, and leverage Omni's world knowledge for intuitive edits like changing backgrounds or adding atmosphere. Ideal for quick social media remixes, cinematic scene adjustments, and iterative video refinements without technical prompts.

Download Workflow Try in Cloud

About

This ComfyUI tutorial workflow lets you edit a single input video using natural language instructions powered by the GeminiVideoOmni node. The graph is straightforward: LoadVideo ingests your source clip, the Prompt Constructor subgraph (node id 331103d2-d660-4a88-abf0-1117dc46b2df) builds a well-formed prompt with the required duration and aspect ratio, GeminiVideoOmni sends the video plus prompt to the Gemini Omni Flash API, and the results are displayed with PreviewAny and saved with SaveVideo. A MarkdownNote in the canvas provides quick tips and reminders.

Technically, LoadVideo decodes frames and metadata, then the Prompt Constructor concatenates your natural language edit with explicit settings like "duration: 5s" and "aspect ratio: 9:16". GeminiVideoOmni uses these to guide the model: the aspect ratio determines the output canvas, and the duration constrains the target clip length. The model returns an edited clip that adheres to your instructions (e.g., background changes, mood/atmosphere adjustments, reframing), which you can quickly review in PreviewAny and export via SaveVideo.

For best results, keep prompts concrete, always include duration and aspect ratio, and iterate in short passes.

What you provide

Reading the workflow

Runs in ComfyUI. This workflow can't run on this page. Open it in Comfy Cloud with everything loaded, or download it for your own ComfyUI.

Try in Cloud

Output

Example

Sample output

Use this workflow from code

Generated from the workflow graph and inputs when possible; stored examples are shown otherwise. Review credentials and endpoints before running code, which may incur charges.

Get API key

What you need

Runs on: Comfy Cloud
Key: COMFY_API_KEY

Needs a paid Cloud plan and credits.

Download API JSON

# Python 3.10+: pip install comfy-sdk==0.4.0
import os

from comfy_sdk import Comfy

api_key = os.environ.get("COMFY_API_KEY", "").strip()
if not api_key: raise RuntimeError("Set COMFY_API_KEY")
os.environ.setdefault("COMFY_BASE_URL", "https://cloud.comfy.org")
client = Comfy(api_key=api_key)
workflow = client.workflows.from_json({
    "2": {
        "class_type": "SaveVideo",
        "inputs": {
            "codec": "auto",
            "filename_prefix": "video/ComfyUI",
            "format": "auto",
            "format.codec": "auto",
            "video": [
                "7",
                0
            ]
        },
        "_meta": {
            "title": "Save Video"
        }
    },
    "3": {
        "class_type": "PreviewAny",
        "inputs": {
            "source": [
                "7",
                1
            ]
        },
        "_meta": {
            "title": "Preview as Text"
        }
    },
    "7": {
        "class_type": "GeminiVideoOmni",
        "inputs": {
            "model": "Omni Flash",
            "model.prompt": [
                "17:16",
                0
            ],
            "model.temperature": 1,
            "model.top_p": 0.95,
            "model.videos.video_1": [
                "8",
                0
            ],
            "seed": 125633706
        },
        "_meta": {
            "title": "Google Gemini Omni (Video)"
        }
    },
    "8": {
        "class_type": "LoadVideo",
        "inputs": {
            "file": "space_horse_rider.mp4"
        },
        "_meta": {
            "title": "Load Video"
        }
    },
    "17:10": {
        "class_type": "CustomCombo",
        "inputs": {
            "choice": "3s "
        },
        "_meta": {
            "title": "Custom Combo"
        }
    },
    "17:11": {
        "class_type": "StringConcatenate",
        "inputs": {
            "delimiter": "",
            "string_a": "Aspect Ratio: ",
            "string_b": [
                "17:9",
                0
            ]
        },
        "_meta": {
            "title": "Concatenate Text"
        }
    },
    "17:12": {
        "class_type": "StringConcatenate",
        "inputs": {
            "delimiter": "",
            "string_a": "Duration: ",
            "string_b": [
                "17:10",
                0
            ]
        },
        "_meta": {
            "title": "Concatenate Text"
        }
    },
    "17:13": {
        "class_type": "StringConcatenate",
        "inputs": {
            "delimiter": ";",
            "string_a": [
                "17:11",
                0
            ],
            "string_b": [
                "17:12",
                0
            ]
        },
        "_meta": {
            "title": "Concatenate Text"
        }
    },
    "17:15": {
        "class_type": "PrimitiveStringMultiline",
        "inputs": {
            "value": "Keep the character and all objects unchanged, convert the style to paper-cut animation."
        },
        "_meta": {
            "title": "Input Text (User Prompt)"
        }
    },
    "17:16": {
        "class_type": "StringConcatenate",
        "inputs": {
            "delimiter": "",
            "string_a": [
                "17:15",
                0
            ],
            "string_b": [
                "17:13",
                0
            ]
        },
        "_meta": {
            "title": "Concatenate Text"
        }
    },
    "17:9": {
        "class_type": "CustomCombo",
        "inputs": {
            "choice": "9:16"
        },
        "_meta": {
            "title": "Custom Combo"
        }
    }
})

# run() also passes api_key to the partner nodes in this workflow.
job = client.run(workflow, api_key=api_key)

API documentation

Gemini Omni Flash: Video Edit

About

What you provide

Inside the workflow

Requires custom nodes

Use this workflow from code

What you need

Questions & answers

About

What you provide

Inside the workflow

Requires custom nodes

Use this workflow from code

What you need

Questions & answers

Do I have to specify duration and aspect ratio?

Does this workflow keep audio?

Does my video stay on my machine?

How can I get more reliable results?