LTX-2: Áudio para Vídeo
Faça upload de um arquivo de áudio e de um quadro de imagem inicial. Gere um vídeo sincronizado com o áudio usando o modelo LTX-2.
Sobre
O fluxo LTX-2: Áudio para Vídeo foi projetado para transformar um arquivo de áudio e uma imagem inicial em um vídeo sincronizado. O processo utiliza o modelo LTX-2, conhecido por interpretar sinais de áudio e traduzi-los em conteúdo visual dinâmico. O fluxo começa com os nós 'LoadImage' e 'LoadAudio', permitindo ao usuário inserir a imagem e o áudio que servirão de base para a geração do vídeo. Essas entradas são processadas por uma série de nós customizados, incluindo 'comfyui-kjnodes', essenciais para manter a sincronização entre áudio e visual.
Tecnicamente, o fluxo utiliza um nó exclusivo identificado pelo ID '3458504c-2bd1-4267-8722-6f2478115b42', que desempenha papel fundamental no alinhamento do ritmo e tempo do áudio com as transições visuais. O nó 'SaveVideo' é o passo final, convertendo os dados processados em um arquivo de vídeo. Este fluxo é especialmente útil para criadores que desejam produzir vídeos envolventes a partir de faixas de áudio, como videoclipes ou peças de arte audiovisual. Por ser experimental, os resultados podem variar, oferecendo uma oportunidade única de exploração criativa.
O que você fornece
- Lendo o fluxo de trabalho
É executado no ComfyUI. Este fluxo de trabalho não pode ser executado nesta página. Abra-o no Comfy Cloud com tudo carregado ou baixe-o para usar no seu próprio ComfyUI.
Experimentar no CloudAinda não há exemplos de resultados para este fluxo de trabalho.
Dentro do workflow
Uma prévia somente leitura do gráfico de nós. Abra-o no Comfy Cloud ou faça o download para editar os nós.
Loading the graph
Open full-size workflow previewArquivos neste workflow
- Autor
- ComfyUI
Requer nós personalizados
- Lendo o fluxo de trabalho
Use este fluxo de trabalho a partir do código
Gerado a partir do grafo e das entradas do fluxo de trabalho quando possível; caso contrário, são exibidos exemplos armazenados. Revise as credenciais e os endpoints antes de executar o código, pois isso pode gerar cobranças.
What you need
- Runs on
- Comfy Cloud
- Chave
- COMFY_API_KEY
Requer um plano pago do Cloud e créditos.
# Python 3.10+: pip install comfy-sdk==0.4.0
import os
from comfy_sdk import Comfy
api_key = os.environ.get("COMFY_API_KEY", "").strip()
if not api_key: raise RuntimeError("Set COMFY_API_KEY")
os.environ.setdefault("COMFY_BASE_URL", "https://cloud.comfy.org")
client = Comfy(api_key=api_key)
workflow = client.workflows.from_json({
"444": {
"class_type": "LoadImage",
"inputs": {
"image": "ltx2-a2v-input.png"
},
"_meta": {
"title": "Load Image"
}
},
"565": {
"class_type": "LoadAudio",
"inputs": {
"audio": "ltx2-a2v-input.mp3"
},
"_meta": {
"title": "Load Audio"
}
},
"982": {
"class_type": "SaveVideo",
"inputs": {
"filename_prefix": "video/ltx-2-a2v",
"format": "auto",
"format.codec": "auto",
"video": [
"994:995",
0
]
},
"_meta": {
"title": "Final Video"
}
},
"984": {
"class_type": "SaveVideo",
"inputs": {
"filename_prefix": "video/ltx-2-a2v",
"format": "auto",
"format.codec": "auto",
"video": [
"994:983",
0
]
},
"_meta": {
"title": "Preview Video"
}
},
"994:1001": {
"class_type": "PrimitiveFloat",
"inputs": {
"value": 24
},
"_meta": {
"title": "FPS"
}
},
"994:819": {
"class_type": "LTXVChunkFeedForward",
"inputs": {
"chunks": 4,
"dim_threshold": 4096,
"model": [
"994:952",
0
]
},
"_meta": {
"title": "LTXV Chunk FeedForward"
}
},
"994:820": {
"class_type": "LTX2_NAG",
"inputs": {
"inplace": True,
"model": [
"994:819",
0
],
"nag_alpha": 0.25,
"nag_cond_video": [
"994:922",
0
],
"nag_scale": 11,
"nag_tau": 2.5
},
"_meta": {
"title": "LTX2 NAG"
}
},
"994:821": {
"class_type": "LTXVPreprocess",
"inputs": {
"image": [
"994:923",
0
],
"img_compression": 25
},
"_meta": {
"title": "LTXV Preprocess"
}
},
"994:842": {
"class_type": "LTXVImgToVideoInplaceKJ",
"inputs": {
"latent": [
"994:855",
0
],
"num_images": "1",
"num_images.image_1": [
"994:821",
0
],
"num_images.index_1": 0,
"num_images.strength_1": 1,
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "LTXVImgToVideoInplaceKJ"
}
},
"994:855": {
"class_type": "EmptyLTXVLatentVideo",
"inputs": {
"batch_size": 1,
"height": [
"994:923",
2
],
"length": 241,
"width": [
"994:923",
1
]
},
"_meta": {
"title": "Empty LTXV Latent Video"
}
},
"994:857": {
"class_type": "FloatConstant",
"inputs": {
"value": 10.25
},
"_meta": {
"title": "window_size_seconds"
}
},
"994:890": {
"class_type": "AudioSeparation",
"inputs": {
"audio": [
"994:892",
0
],
"chunk_fade_shape": "linear",
"chunk_length": 10,
"chunk_overlap": 0.1
},
"_meta": {
"title": "AudioSeparation"
}
},
"994:892": {
"class_type": "AudioCrop",
"inputs": {
"audio": [
"565",
0
],
"end_time": "2:05",
"start_time": "1:05"
},
"_meta": {
"title": "AudioCrop"
}
},
"994:895": {
"class_type": "VAELoaderKJ",
"inputs": {
"device": "main_device",
"vae_name": "LTX2_audio_vae_bf16.safetensors",
"weight_dtype": "bf16"
},
"_meta": {
"title": "VAELoader KJ"
}
},
"994:904": {
"class_type": "VAELoaderKJ",
"inputs": {
"device": "main_device",
"vae_name": "LTX2_video_vae_bf16.safetensors",
"weight_dtype": "bf16"
},
"_meta": {
"title": "VAELoader KJ"
}
},
"994:921": {
"class_type": "CLIPTextEncode",
"inputs": {
"clip": [
"994:951",
0
],
"text": "the man is singing passionately"
},
"_meta": {
"title": "CLIP Text Encode (Prompt)"
}
},
"994:922": {
"class_type": "CLIPTextEncode",
"inputs": {
"clip": [
"994:951",
0
],
"text": "still image with no motion, subtitles, text, scene change"
},
"_meta": {
"title": "CLIP Text Encode (Prompt)"
}
},
"994:923": {
"class_type": "ImageResizeKJv2",
"inputs": {
"crop_position": "center",
"device": "cpu",
"divisible_by": 2,
"height": 720,
"image": [
"444",
0
],
"keep_proportion": "crop",
"pad_color": "0, 0, 0",
"upscale_method": "lanczos",
"width": 720
},
"_meta": {
"title": "Resize Image v2"
}
},
"994:927": {
"class_type": "LTXVConditioning",
"inputs": {
"frame_rate": [
"994:1001",
0
],
"negative": [
"994:950",
0
],
"positive": [
"994:921",
0
]
},
"_meta": {
"title": "LTXVConditioning"
}
},
"994:933": {
"class_type": "LTX2SamplingPreviewOverride",
"inputs": {
"model": [
"994:820",
0
],
"preview_rate": 8
},
"_meta": {
"title": "LTX2 Sampling Preview Override"
}
},
"994:950": {
"class_type": "ConditioningZeroOut",
"inputs": {
"conditioning": [
"994:921",
0
]
},
"_meta": {
"title": "Conditioning Zero Out"
}
},
"994:951": {
"class_type": "DualCLIPLoader",
"inputs": {
"clip_name1": "gemma_3_12B_it_fp8_scaled.safetensors",
"clip_name2": "ltx-2-19b-embeddings_connector_distill_bf16.safetensors",
"device": "default",
"type": "ltxv"
},
"_meta": {
"title": "Load CLIP (Dual)"
}
},
"994:952": {
"class_type": "UNETLoader",
"inputs": {
"unet_name": "ltx-2-19b-distilled_transformer_only_bf16.safetensors",
"weight_dtype": "default"
},
"_meta": {
"title": "Load Diffusion Model"
}
},
"994:969:823": {
"class_type": "RandomNoise",
"inputs": {
"noise_seed": 42
},
"_meta": {
"title": "RandomNoise"
}
},
"994:969:824": {
"class_type": "LTXVAudioVAEEncode",
"inputs": {
"audio": [
"994:969:862",
0
],
"audio_vae": [
"994:895",
0
]
},
"_meta": {
"title": "LTXV Audio VAE Encode"
}
},
"994:969:827": {
"class_type": "SamplerCustomAdvanced",
"inputs": {
"guider": [
"994:969:830",
0
],
"latent_image": [
"994:969:829",
0
],
"noise": [
"994:969:823",
0
],
"sampler": [
"994:969:953",
0
],
"sigmas": [
"994:969:954",
0
]
},
"_meta": {
"title": "SamplerCustomAdvanced"
}
},
"994:969:829": {
"class_type": "LTXVConcatAVLatent",
"inputs": {
"audio_latent": [
"994:969:859",
1
],
"video_latent": [
"994:969:896",
2
]
},
"_meta": {
"title": "Concat AV Latent"
}
},
"994:969:830": {
"class_type": "CFGGuider",
"inputs": {
"cfg": 1,
"model": [
"994:933",
0
],
"negative": [
"994:969:896",
1
],
"positive": [
"994:969:896",
0
]
},
"_meta": {
"title": "CFG Guider"
}
},
"994:969:831": {
"class_type": "LTXVSeparateAVLatent",
"inputs": {
"av_latent": [
"994:969:827",
0
]
},
"_meta": {
"title": "Separate AV Latent"
}
},
"994:969:832": {
"class_type": "LTXVCropGuides",
"inputs": {
"latent": [
"994:969:831",
0
],
"negative": [
"994:969:896",
1
],
"positive": [
"994:969:896",
0
]
},
"_meta": {
"title": "LTXVCropGuides"
}
},
"994:969:843": {
"class_type": "GetImageRangeFromBatch",
"inputs": {
"images": [
"994:978:826",
0
],
"num_frames": 25,
"start_index": -1
},
"_meta": {
"title": "Get Image or Mask Range From Batch"
}
},
"994:969:859": {
"class_type": "LTXVAudioVideoMask",
"inputs": {
"audio_end_time": [
"994:857",
0
],
"audio_latent": [
"994:969:824",
0
],
"audio_start_time": [
"994:857",
0
],
"existing_mask_mode": "add",
"max_length": "pad",
"video_end_time": [
"994:857",
0
],
"video_fps": [
"994:1001",
0
],
"video_latent": [
"994:969:900",
0
],
"video_start_time": 1
},
"_meta": {
"title": "LTXVAudioVideoMask"
}
},
"994:969:862": {
"class_type": "TrimAudioDuration",
"inputs": {
"audio": [
"994:890",
3
],
"duration": [
"994:857",
0
],
"start_index": 9
},
"_meta": {
"title": "Trim Audio Duration"
}
},
"994:969:896": {
"class_type": "LTXVAddGuideMulti",
"inputs": {
"latent": [
"994:969:859",
0
],
"negative": [
"994:927",
1
],
"num_guides": "2",
"num_guides.frame_idx_1": 0,
"num_guides.frame_idx_2": -1,
"num_guides.image_1": [
"994:923",
0
],
"num_guides.image_2": [
"994:923",
0
],
"num_guides.strength_1": 1,
"num_guides.strength_2": 0.5,
"positive": [
"994:927",
0
],
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "LTXVAddGuideMulti"
}
},
"994:969:900": {
"class_type": "VAEEncode",
"inputs": {
"pixels": [
"994:969:843",
0
],
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "VAE Encode"
}
},
"994:969:901": {
"class_type": "VAEDecodeTiled",
"inputs": {
"overlap": 64,
"samples": [
"994:969:832",
2
],
"temporal_overlap": 16,
"temporal_size": 256,
"tile_size": 1024,
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "VAE Decode (Tiled)"
}
},
"994:969:953": {
"class_type": "KSamplerSelect",
"inputs": {
"sampler_name": "lcm"
},
"_meta": {
"title": "KSamplerSelect"
}
},
"994:969:954": {
"class_type": "LTXVScheduler",
"inputs": {
"base_shift": 0.95,
"latent": [
"994:842",
0
],
"max_shift": 2.05,
"steps": 8,
"stretch": True,
"terminal": 0.1
},
"_meta": {
"title": "LTXVScheduler"
}
},
"994:969:987": {
"class_type": "ImageBatchExtendWithOverlap",
"inputs": {
"new_images": [
"994:969:901",
0
],
"overlap": 25,
"overlap_mode": "filmic_crossfade",
"overlap_side": "source",
"source_images": [
"994:978:826",
0
]
},
"_meta": {
"title": "Image Batch Extend With Overlap"
}
},
"994:978:817": {
"class_type": "SetLatentNoiseMask",
"inputs": {
"mask": [
"994:978:818",
0
],
"samples": [
"994:978:907",
0
]
},
"_meta": {
"title": "Set Latent Noise Mask"
}
},
"994:978:818": {
"class_type": "SolidMask",
"inputs": {
"height": 512,
"value": 0,
"width": 512
},
"_meta": {
"title": "Create Solid Mask"
}
},
"994:978:822": {
"class_type": "LTXVConcatAVLatent",
"inputs": {
"audio_latent": [
"994:978:817",
0
],
"video_latent": [
"994:842",
0
]
},
"_meta": {
"title": "Concat AV Latent"
}
},
"994:978:825": {
"class_type": "LTXVSeparateAVLatent",
"inputs": {
"av_latent": [
"994:978:883",
0
]
},
"_meta": {
"title": "Separate AV Latent"
}
},
"994:978:826": {
"class_type": "VAEDecodeTiled",
"inputs": {
"overlap": 64,
"samples": [
"994:978:825",
0
],
"temporal_overlap": 16,
"temporal_size": 128,
"tile_size": 1024,
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "VAE Decode (Tiled)"
}
},
"994:978:828": {
"class_type": "CFGGuider",
"inputs": {
"cfg": 1,
"model": [
"994:933",
0
],
"negative": [
"994:927",
1
],
"positive": [
"994:927",
0
]
},
"_meta": {
"title": "CFG Guider"
}
},
"994:978:863": {
"class_type": "RandomNoise",
"inputs": {
"noise_seed": 44
},
"_meta": {
"title": "RandomNoise"
}
},
"994:978:883": {
"class_type": "SamplerCustomAdvanced",
"inputs": {
"guider": [
"994:978:828",
0
],
"latent_image": [
"994:978:822",
0
],
"noise": [
"994:978:863",
0
],
"sampler": [
"994:978:944",
0
],
"sigmas": [
"994:978:939",
0
]
},
"_meta": {
"title": "SamplerCustomAdvanced"
}
},
"994:978:907": {
"class_type": "LTXVAudioVAEEncode",
"inputs": {
"audio": [
"994:978:991",
0
],
"audio_vae": [
"994:895",
0
]
},
"_meta": {
"title": "LTXV Audio VAE Encode"
}
},
"994:978:939": {
"class_type": "LTXVScheduler",
"inputs": {
"base_shift": 0.95,
"latent": [
"994:842",
0
],
"max_shift": 2.05,
"steps": 8,
"stretch": True,
"terminal": 0.1
},
"_meta": {
"title": "LTXVScheduler"
}
},
"994:978:944": {
"class_type": "KSamplerSelect",
"inputs": {
"sampler_name": "lcm"
},
"_meta": {
"title": "KSamplerSelect"
}
},
"994:978:991": {
"class_type": "TrimAudioDuration",
"inputs": {
"audio": [
"994:890",
3
],
"duration": [
"994:857",
0
],
"start_index": 0
},
"_meta": {
"title": "Trim Audio Duration"
}
},
"994:983": {
"class_type": "CreateVideo",
"inputs": {
"audio": [
"994:892",
0
],
"bit_depth": "auto",
"codec": "none",
"color_space": "sRGB",
"fps": [
"994:1001",
0
],
"images": [
"994:978:826",
0
]
},
"_meta": {
"title": "Create Video"
}
},
"994:988:823": {
"class_type": "RandomNoise",
"inputs": {
"noise_seed": 42
},
"_meta": {
"title": "RandomNoise"
}
},
"994:988:824": {
"class_type": "LTXVAudioVAEEncode",
"inputs": {
"audio": [
"994:988:862",
0
],
"audio_vae": [
"994:895",
0
]
},
"_meta": {
"title": "LTXV Audio VAE Encode"
}
},
"994:988:827": {
"class_type": "SamplerCustomAdvanced",
"inputs": {
"guider": [
"994:988:830",
0
],
"latent_image": [
"994:988:829",
0
],
"noise": [
"994:988:823",
0
],
"sampler": [
"994:988:953",
0
],
"sigmas": [
"994:988:954",
0
]
},
"_meta": {
"title": "SamplerCustomAdvanced"
}
},
"994:988:829": {
"class_type": "LTXVConcatAVLatent",
"inputs": {
"audio_latent": [
"994:988:859",
1
],
"video_latent": [
"994:988:896",
2
]
},
"_meta": {
"title": "Concat AV Latent"
}
},
"994:988:830": {
"class_type": "CFGGuider",
"inputs": {
"cfg": 1,
"model": [
"994:933",
0
],
"negative": [
"994:988:896",
1
],
"positive": [
"994:988:896",
0
]
},
"_meta": {
"title": "CFG Guider"
}
},
"994:988:831": {
"class_type": "LTXVSeparateAVLatent",
"inputs": {
"av_latent": [
"994:988:827",
0
]
},
"_meta": {
"title": "Separate AV Latent"
}
},
"994:988:832": {
"class_type": "LTXVCropGuides",
"inputs": {
"latent": [
"994:988:831",
0
],
"negative": [
"994:988:896",
1
],
"positive": [
"994:988:896",
0
]
},
"_meta": {
"title": "LTXVCropGuides"
}
},
"994:988:843": {
"class_type": "GetImageRangeFromBatch",
"inputs": {
"images": [
"994:969:987",
2
],
"num_frames": 25,
"start_index": -1
},
"_meta": {
"title": "Get Image or Mask Range From Batch"
}
},
"994:988:859": {
"class_type": "LTXVAudioVideoMask",
"inputs": {
"audio_end_time": [
"994:857",
0
],
"audio_latent": [
"994:988:824",
0
],
"audio_start_time": [
"994:857",
0
],
"existing_mask_mode": "add",
"max_length": "pad",
"video_end_time": [
"994:857",
0
],
"video_fps": [
"994:1001",
0
],
"video_latent": [
"994:988:900",
0
],
"video_start_time": 1
},
"_meta": {
"title": "LTXVAudioVideoMask"
}
},
"994:988:862": {
"class_type": "TrimAudioDuration",
"inputs": {
"audio": [
"994:890",
3
],
"duration": [
"994:857",
0
],
"start_index": 18
},
"_meta": {
"title": "Trim Audio Duration"
}
},
"994:988:896": {
"class_type": "LTXVAddGuideMulti",
"inputs": {
"latent": [
"994:988:859",
0
],
"negative": [
"994:927",
1
],
"num_guides": "2",
"num_guides.frame_idx_1": 0,
"num_guides.frame_idx_2": -1,
"num_guides.image_1": [
"994:923",
0
],
"num_guides.image_2": [
"994:923",
0
],
"num_guides.strength_1": 1,
"num_guides.strength_2": 0.5,
"positive": [
"994:927",
0
],
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "LTXVAddGuideMulti"
}
},
"994:988:900": {
"class_type": "VAEEncode",
"inputs": {
"pixels": [
"994:988:843",
0
],
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "VAE Encode"
}
},
"994:988:901": {
"class_type": "VAEDecodeTiled",
"inputs": {
"overlap": 64,
"samples": [
"994:988:832",
2
],
"temporal_overlap": 16,
"temporal_size": 256,
"tile_size": 1024,
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "VAE Decode (Tiled)"
}
},
"994:988:953": {
"class_type": "KSamplerSelect",
"inputs": {
"sampler_name": "lcm"
},
"_meta": {
"title": "KSamplerSelect"
}
},
"994:988:954": {
"class_type": "LTXVScheduler",
"inputs": {
"base_shift": 0.95,
"latent": [
"994:842",
0
],
"max_shift": 2.05,
"steps": 8,
"stretch": True,
"terminal": 0.1
},
"_meta": {
"title": "LTXVScheduler"
}
},
"994:988:987": {
"class_type": "ImageBatchExtendWithOverlap",
"inputs": {
"new_images": [
"994:988:901",
0
],
"overlap": 25,
"overlap_mode": "filmic_crossfade",
"overlap_side": "source",
"source_images": [
"994:969:987",
2
]
},
"_meta": {
"title": "Image Batch Extend With Overlap"
}
},
"994:989:823": {
"class_type": "RandomNoise",
"inputs": {
"noise_seed": 42
},
"_meta": {
"title": "RandomNoise"
}
},
"994:989:824": {
"class_type": "LTXVAudioVAEEncode",
"inputs": {
"audio": [
"994:989:862",
0
],
"audio_vae": [
"994:895",
0
]
},
"_meta": {
"title": "LTXV Audio VAE Encode"
}
},
"994:989:827": {
"class_type": "SamplerCustomAdvanced",
"inputs": {
"guider": [
"994:989:830",
0
],
"latent_image": [
"994:989:829",
0
],
"noise": [
"994:989:823",
0
],
"sampler": [
"994:989:953",
0
],
"sigmas": [
"994:989:954",
0
]
},
"_meta": {
"title": "SamplerCustomAdvanced"
}
},
"994:989:829": {
"class_type": "LTXVConcatAVLatent",
"inputs": {
"audio_latent": [
"994:989:859",
1
],
"video_latent": [
"994:989:896",
2
]
},
"_meta": {
"title": "Concat AV Latent"
}
},
"994:989:830": {
"class_type": "CFGGuider",
"inputs": {
"cfg": 1,
"model": [
"994:933",
0
],
"negative": [
"994:989:896",
1
],
"positive": [
"994:989:896",
0
]
},
"_meta": {
"title": "CFG Guider"
}
},
"994:989:831": {
"class_type": "LTXVSeparateAVLatent",
"inputs": {
"av_latent": [
"994:989:827",
0
]
},
"_meta": {
"title": "Separate AV Latent"
}
},
"994:989:832": {
"class_type": "LTXVCropGuides",
"inputs": {
"latent": [
"994:989:831",
0
],
"negative": [
"994:989:896",
1
],
"positive": [
"994:989:896",
0
]
},
"_meta": {
"title": "LTXVCropGuides"
}
},
"994:989:843": {
"class_type": "GetImageRangeFromBatch",
"inputs": {
"images": [
"994:988:987",
2
],
"num_frames": 25,
"start_index": -1
},
"_meta": {
"title": "Get Image or Mask Range From Batch"
}
},
"994:989:859": {
"class_type": "LTXVAudioVideoMask",
"inputs": {
"audio_end_time": [
"994:857",
0
],
"audio_latent": [
"994:989:824",
0
],
"audio_start_time": [
"994:857",
0
],
"existing_mask_mode": "add",
"max_length": "pad",
"video_end_time": [
"994:857",
0
],
"video_fps": [
"994:1001",
0
],
"video_latent": [
"994:989:900",
0
],
"video_start_time": 1
},
"_meta": {
"title": "LTXVAudioVideoMask"
}
},
"994:989:862": {
"class_type": "TrimAudioDuration",
"inputs": {
"audio": [
"994:890",
3
],
"duration": [
"994:857",
0
],
"start_index": 27
},
"_meta": {
"title": "Trim Audio Duration"
}
},
"994:989:896": {
"class_type": "LTXVAddGuideMulti",
"inputs": {
"latent": [
"994:989:859",
0
],
"negative": [
"994:927",
1
],
"num_guides": "2",
"num_guides.frame_idx_1": 0,
"num_guides.frame_idx_2": -1,
"num_guides.image_1": [
"994:923",
0
],
"num_guides.image_2": [
"994:923",
0
],
"num_guides.strength_1": 1,
"num_guides.strength_2": 0.5,
"positive": [
"994:927",
0
],
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "LTXVAddGuideMulti"
}
},
"994:989:900": {
"class_type": "VAEEncode",
"inputs": {
"pixels": [
"994:989:843",
0
],
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "VAE Encode"
}
},
"994:989:901": {
"class_type": "VAEDecodeTiled",
"inputs": {
"overlap": 64,
"samples": [
"994:989:832",
2
],
"temporal_overlap": 16,
"temporal_size": 256,
"tile_size": 1024,
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "VAE Decode (Tiled)"
}
},
"994:989:953": {
"class_type": "KSamplerSelect",
"inputs": {
"sampler_name": "lcm"
},
"_meta": {
"title": "KSamplerSelect"
}
},
"994:989:954": {
"class_type": "LTXVScheduler",
"inputs": {
"base_shift": 0.95,
"latent": [
"994:842",
0
],
"max_shift": 2.05,
"steps": 8,
"stretch": True,
"terminal": 0.1
},
"_meta": {
"title": "LTXVScheduler"
}
},
"994:989:987": {
"class_type": "ImageBatchExtendWithOverlap",
"inputs": {
"new_images": [
"994:989:901",
0
],
"overlap": 25,
"overlap_mode": "filmic_crossfade",
"overlap_side": "source",
"source_images": [
"994:988:987",
2
]
},
"_meta": {
"title": "Image Batch Extend With Overlap"
}
},
"994:990:823": {
"class_type": "RandomNoise",
"inputs": {
"noise_seed": 42
},
"_meta": {
"title": "RandomNoise"
}
},
"994:990:824": {
"class_type": "LTXVAudioVAEEncode",
"inputs": {
"audio": [
"994:990:862",
0
],
"audio_vae": [
"994:895",
0
]
},
"_meta": {
"title": "LTXV Audio VAE Encode"
}
},
"994:990:827": {
"class_type": "SamplerCustomAdvanced",
"inputs": {
"guider": [
"994:990:830",
0
],
"latent_image": [
"994:990:829",
0
],
"noise": [
"994:990:823",
0
],
"sampler": [
"994:990:953",
0
],
"sigmas": [
"994:990:954",
0
]
},
"_meta": {
"title": "SamplerCustomAdvanced"
}
},
"994:990:829": {
"class_type": "LTXVConcatAVLatent",
"inputs": {
"audio_latent": [
"994:990:859",
1
],
"video_latent": [
"994:990:896",
2
]
},
"_meta": {
"title": "Concat AV Latent"
}
},
"994:990:830": {
"class_type": "CFGGuider",
"inputs": {
"cfg": 1,
"model": [
"994:933",
0
],
"negative": [
"994:990:896",
1
],
"positive": [
"994:990:896",
0
]
},
"_meta": {
"title": "CFG Guider"
}
},
"994:990:831": {
"class_type": "LTXVSeparateAVLatent",
"inputs": {
"av_latent": [
"994:990:827",
0
]
},
"_meta": {
"title": "Separate AV Latent"
}
},
"994:990:832": {
"class_type": "LTXVCropGuides",
"inputs": {
"latent": [
"994:990:831",
0
],
"negative": [
"994:990:896",
1
],
"positive": [
"994:990:896",
0
]
},
"_meta": {
"title": "LTXVCropGuides"
}
},
"994:990:843": {
"class_type": "GetImageRangeFromBatch",
"inputs": {
"images": [
"994:989:987",
2
],
"num_frames": 25,
"start_index": -1
},
"_meta": {
"title": "Get Image or Mask Range From Batch"
}
},
"994:990:859": {
"class_type": "LTXVAudioVideoMask",
"inputs": {
"audio_end_time": [
"994:857",
0
],
"audio_latent": [
"994:990:824",
0
],
"audio_start_time": [
"994:857",
0
],
"existing_mask_mode": "add",
"max_length": "pad",
"video_end_time": [
"994:857",
0
],
"video_fps": [
"994:1001",
0
],
"video_latent": [
"994:990:900",
0
],
"video_start_time": 1
},
"_meta": {
"title": "LTXVAudioVideoMask"
}
},
"994:990:862": {
"class_type": "TrimAudioDuration",
"inputs": {
"audio": [
"994:890",
3
],
"duration": [
"994:857",
0
],
"start_index": 36
},
"_meta": {
"title": "Trim Audio Duration"
}
},
"994:990:896": {
"class_type": "LTXVAddGuideMulti",
"inputs": {
"latent": [
"994:990:859",
0
],
"negative": [
"994:927",
1
],
"num_guides": "2",
"num_guides.frame_idx_1": 0,
"num_guides.frame_idx_2": -1,
"num_guides.image_1": [
"994:923",
0
],
"num_guides.image_2": [
"994:923",
0
],
"num_guides.strength_1": 1,
"num_guides.strength_2": 0.5,
"positive": [
"994:927",
0
],
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "LTXVAddGuideMulti"
}
},
"994:990:900": {
"class_type": "VAEEncode",
"inputs": {
"pixels": [
"994:990:843",
0
],
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "VAE Encode"
}
},
"994:990:901": {
"class_type": "VAEDecodeTiled",
"inputs": {
"overlap": 64,
"samples": [
"994:990:832",
2
],
"temporal_overlap": 16,
"temporal_size": 256,
"tile_size": 1024,
"vae": [
"994:904",
0
]
},
"_meta": {
"title": "VAE Decode (Tiled)"
}
},
"994:990:953": {
"class_type": "KSamplerSelect",
"inputs": {
"sampler_name": "lcm"
},
"_meta": {
"title": "KSamplerSelect"
}
},
"994:990:954": {
"class_type": "LTXVScheduler",
"inputs": {
"base_shift": 0.95,
"latent": [
"994:842",
0
],
"max_shift": 2.05,
"steps": 8,
"stretch": True,
"terminal": 0.1
},
"_meta": {
"title": "LTXVScheduler"
}
},
"994:990:987": {
"class_type": "ImageBatchExtendWithOverlap",
"inputs": {
"new_images": [
"994:990:901",
0
],
"overlap": 25,
"overlap_mode": "filmic_crossfade",
"overlap_side": "source",
"source_images": [
"994:989:987",
2
]
},
"_meta": {
"title": "Image Batch Extend With Overlap"
}
},
"994:995": {
"class_type": "CreateVideo",
"inputs": {
"audio": [
"994:892",
0
],
"bit_depth": "auto",
"codec": "none",
"color_space": "sRGB",
"fps": [
"994:1001",
0
],
"images": [
"994:990:987",
2
]
},
"_meta": {
"title": "Create Video"
}
}
})
# run() also passes api_key to the partner nodes in this workflow.
job = client.run(workflow, api_key=api_key)Perguntas e respostas
Se o vídeo estiver preto, pare a execução imediatamente e reduza a resolução das entradas. Isso pode resolver o problema.
O fluxo suporta formatos comuns como MP3 e WAV. Certifique-se de que o arquivo de áudio está em formato compatível antes de enviar.
O modelo LTX-2 é experimental e mais indicado para projetos criativos onde a variabilidade é aceitável. Não é recomendado para aplicações comerciais ou de precisão.
Garanta que o áudio esteja claro e bem definido. Ajuste as configurações dos 'comfyui-kjnodes' para refinar a sincronização.