The 'Runway: First Last Frame to Video' workflow introduces a groundbreaking approach to video generation by seamlessly transitioning between two keyframes. Utilizing Runway's advanced precision, this workflow leverages the RunwayFirstLastFrameNode to create smooth, coherent video sequences from static images. This is a significant leap forward from traditional frame-by-frame animation techniques, which often require labor-intensive manual adjustments and can result in jarring transitions. By automating the interpolation process, this workflow not only saves time but also enhances the visual fluidity of the resulting videos.
What sets this technique apart is its integration with Runway's powerful API, allowing users to harness sophisticated video generation capabilities directly within ComfyUI. This integration ensures that the workflow can be executed in a secure network environment, providing a robust and reliable solution for video creators. The ability to generate high-quality video content from just two frames opens up new possibilities for creative storytelling and content production, making it an invaluable tool for filmmakers, animators, and digital artists.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run this workflow (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
const wf = await client.workflows.fromFile("workflow_api.json");
const job = await client.run(wf);
await job.getOutputs("<output-node-id>")[0].toFile("output.png");The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
