Depth Motion Capture with Seedance 2.0
Feed a reference video through depth extraction to strip away everything but structure — pure spatial motion, no pixels, no color, no identity. That depth sequence becomes the skeleton. Hand the skeleton to Seedance 2.0 as your motion reference, then drop in a reference image to define the look. The depth map dictates how things move; the image dictates what they are. Camera moves, body motion, and scene geometry carry over intact while the visual identity is fully swapped. Dial in duration, resolution, and aspect ratio to match your target format. Route the original audio straight through to the final output so the new footage stays locked to the source timing.
概要
Seedance 2.0 Depth Dancer turns any source clip into a motion “skeleton” by extracting a depth map sequence, then rebuilds the visuals from a single reference image. In this workflow, VHS_LoadVideo ingests your reference video (and audio), the custom Seedance 2.0 node (4871bd59-7f4e-475a-a872-bf5457365402) converts each frame to depth to capture camera moves, body motion, and scene geometry, and then synthesizes new frames guided by a look you define with LoadImage. Finally, SaveVideo assembles the generated frames and can pass through the original soundtrack to keep everything in sync.
入力するもの
- ワークフローを読み込み中
ComfyUI で実行できます。 このワークフローはこのページでは実行できません。すべてが読み込まれた状態でComfy Cloudで開くか、ご自身のComfyUI用にダウンロードしてください。
Cloudで試すよくある質問
Pose transfer uses 2D keypoints; this workflow uses per-frame depth maps. Depth preserves camera motion and scene geometry (parallax, relative distances), so movement feels more 3D and faithful to the original shot.
By design, no. The depth pass removes pixel identity and color, and the Seedance 2.0 synthesis rebuilds visuals from the reference image. If you need the original background, composite later in your editor using the new render and the source plate.
Depth quality drops with motion blur or low light. Use cleaner source footage (higher shutter speed, more light), keep aspect ratio consistent between source and output, and avoid aggressive cropping. Matching FPS between VHS_LoadVideo and SaveVideo also helps stability.
Keep the frame range and FPS consistent from VHS_LoadVideo through SaveVideo, and connect VHS_LoadVideo’s audio output to SaveVideo’s audio input. This preserves the original timing and soundtrack in the final render.