Depth Motion Capture with Seedance 2.0
Feed a reference video through depth extraction to strip away everything but structure — pure spatial motion, no pixels, no color, no identity. That depth sequence becomes the skeleton. Hand the skeleton to Seedance 2.0 as your motion reference, then drop in a reference image to define the look. The depth map dictates how things move; the image dictates what they are. Camera moves, body motion, and scene geometry carry over intact while the visual identity is fully swapped. Dial in duration, resolution, and aspect ratio to match your target format. Route the original audio straight through to the final output so the new footage stays locked to the source timing.
About
Seedance 2.0 Depth Dancer turns any source clip into a motion “skeleton” by extracting a depth map sequence, then rebuilds the visuals from a single reference image. In this workflow, VHS_LoadVideo ingests your reference video (and audio), the custom Seedance 2.0 node (4871bd59-7f4e-475a-a872-bf5457365402) converts each frame to depth to capture camera moves, body motion, and scene geometry, and then synthesizes new frames guided by a look you define with LoadImage. Finally, SaveVideo assembles the generated frames and can pass through the original soundtrack to keep everything in sync.
What you provide
- Reading the workflow
Runs in ComfyUI. This workflow can't run on this page. Open it in Comfy Cloud with everything loaded, or download it for your own ComfyUI.
Try in CloudQuestions & answers
Pose transfer uses 2D keypoints; this workflow uses per-frame depth maps. Depth preserves camera motion and scene geometry (parallax, relative distances), so movement feels more 3D and faithful to the original shot.
By design, no. The depth pass removes pixel identity and color, and the Seedance 2.0 synthesis rebuilds visuals from the reference image. If you need the original background, composite later in your editor using the new render and the source plate.
Depth quality drops with motion blur or low light. Use cleaner source footage (higher shutter speed, more light), keep aspect ratio consistent between source and output, and avoid aggressive cropping. Matching FPS between VHS_LoadVideo and SaveVideo also helps stability.
Keep the frame range and FPS consistent from VHS_LoadVideo through SaveVideo, and connect VHS_LoadVideo’s audio output to SaveVideo’s audio input. This preserves the original timing and soundtrack in the final render.