Gemini Omni 1.1 Flash: Text to Video
Generate cinematic videos with audio from text prompts or reference images using Gemini Omni 1.1 Flash, supporting aspect ratio, resolution, and keyframe interpolation controls. Ideal for text-to-video storytelling, animating product shots or illustrations, and iterative conversational video editing.
简介
This ComfyUI tutorial workflow turns a written prompt (and optionally a reference image) into a short, cinematic video using Google’s Gemini Omni 1.1 Flash via the GeminiVideoOmniV2 node. The node handles the API call to Gemini, then returns a generated clip and, when enabled, an accompanying audio track. You get direct control over aspect ratio and resolution so your outputs are ready for social, product pages, or widescreen edits.
你需要提供
- 正在读取工作流
在 ComfyUI 中运行。 此工作流无法在本页面运行。你可以在 Comfy Cloud 中打开(已预先加载所需内容),或下载后在自己的 ComfyUI 中使用。
在 Cloud 中试用常见问答
Open the GeminiVideoOmniV2 node and look for API/key configuration, or set the environment variable as documented by the custom node (then restart ComfyUI). If the node cannot find a key, the request will fail.
Yes. Connect a reference image to GeminiVideoOmniV2’s image/reference input. The model will use it to inform composition and style. Keep your prompt consistent with the image content for better visual continuity.
Use the aspect ratio and resolution settings in GeminiVideoOmniV2. Common choices are 16:9 for YouTube, 9:16 for vertical reels, and 1:1 for feeds. Match SaveVideo’s FPS to the generator’s FPS to preserve timing.
Increase keyframe interpolation in GeminiVideoOmniV2 to smooth transitions and stabilize subjects. Also keep prompts precise and avoid large prompt changes between iterations. Lowering resolution can reduce artifacts on slower hardware or networks.