This ComfyUI workflow, titled 'Image to Script to Kling Video Generation,' is designed to transform a static image into a dynamic video using advanced AI models. The process begins with uploading an image, which the system analyzes to create a descriptive script. This script serves as the foundation for generating a video using the Kling 3.0 Omni model. The workflow leverages several nodes, including the GeminiNanoBanana2 for script generation and the KlingOmniProImageToVideoNode for video creation. By utilizing these nodes, the workflow efficiently converts visual elements into a narrative and then into a moving picture, providing a seamless transition from image to video.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run "Image to Script to Kling Video Generation" (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
// This workflow, exported in API format (see note below)
const wf = await client.workflows.fromFile("template_sirolim_image_script_video_api.json");
const asset = client.assets.fromFile("input.png");
wf.setInput("16", "image", asset); // LoadImage
const job = await client.run(wf);
await job.getOutputs("7")[0].toFile("output.png"); // SaveVideoThe SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
