The LTX-2 Depth to Video workflow in ComfyUI is designed to transform depth maps into high-quality videos, incorporating synchronized audio-video generation. This workflow leverages the LTX-2 model, renowned for its precise depth control and spatial awareness, to create visually compelling video content. The workflow begins with nodes like 'LoadImage' and 'LoadVideo' to import the necessary media files. The 'GetVideoComponents' node is crucial as it extracts essential components from the video, which are then processed through nodes like 'ImageScaleBy' and 'ResizeImageMaskNode' to ensure the correct dimensions and aspect ratios. The 'SaveVideo' node finalizes the process by compiling the processed frames into a video file. This workflow is particularly useful for creators looking to integrate depth-based visual effects into their video projects, offering efficient performance and high-quality output.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run "LTX-2 Depth to Video" (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
// This workflow, exported in API format (see note below)
const wf = await client.workflows.fromFile("video_ltx2_depth_to_video_api.json");
const asset = client.assets.fromFile("input.png");
wf.setInput("160", "image", asset); // LoadImage
const job = await client.run(wf);
await job.getOutputs("175")[0].toFile("output.png"); // SaveVideoThe SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
