Gemini Omni 1.1 Flash: Reference to Video

Generate video that incorporates specific subjects from multiple reference images using Gemini Omni 1.1 Flash's reference mode: characters, products, and objects from your images appear in the scene while the image itself is never shown as a frame. Bind each image to a role with tags like <IMAGE_REF_0>, combine character references with style references, and direct the scene in plain language with native audio. Ideal for character-driven stories, product placement, and brand-consistent content.

О проекте

This workflow teaches you how to steer Gemini Omni 1.1 Flash to generate a video that features specific people, products, or objects without ever cutting to the original photos. It does this by binding each loaded reference image to a role tag (for example, <IMAGE_REF_0>, <IMAGE_REF_1>) and then using those tags inside your scene description so the model knows which visual subject to synthesize into the shot. The core is the GeminiVideoOmniV2 node running in reference mode, fed by one or more LoadImage nodes for character and style/product references, and finalized by a SaveVideo node to write the result to disk. A MarkdownNote in the graph documents the prompt pattern and tag usage.

Что вы предоставляете

  • Чтение рабочего процесса

Работает в ComfyUI. Этот рабочий процесс нельзя запустить на этой странице. Откройте его в Comfy Cloud, где всё уже загружено, или скачайте его для своей ComfyUI.

Попробовать в Cloud
Вывод
Пример
Sample output

Вопросы и ответы