Generar video UGC con clon de voz
Sube una imagen para generar indicaciones de IA y sintetizar voz. Crea un video final con sincronización labial precisa usando Eleven Labs y LTX Video.
Dentro del flujo de trabajo
Una vista previa de solo lectura de la plantilla de origen. Ábrela en Cloud para explorar los nodos y hacer cambios.
Loading the graph
Open full-size workflow previewArchivos de este flujo de trabajo
- Salida
- Salidas mixtas
- Autor
- ComfyUI
Llama a este modelo desde tu código
La solicitud a continuación utiliza el mismo grafo preparado y la misma configuración que el Playground. Cada envío puede iniciar una ejecución de pago; no reintentes automáticamente un envío cuyo resultado se desconozca.
What you need
- Runs on
- Comfy Cloud
- Clave
- COMFY_API_KEY
- Tus archivos
- El código los sube desde sus URL
Requiere un plan de pago de Cloud y créditos.
# Python 3.10+: pip install comfy-sdk==0.4.0
import os
from comfy_sdk import Comfy
api_key = os.environ.get("COMFY_API_KEY", "").strip()
if not api_key: raise RuntimeError("Set COMFY_API_KEY")
os.environ.setdefault("COMFY_BASE_URL", "https://cloud.comfy.org")
client = Comfy(api_key=api_key)
workflow = client.workflows.from_json({
"3": {
"class_type": "ElevenLabsTextToSpeech",
"inputs": {
"apply_text_normalization": "auto",
"language_code": "",
"model": "eleven_v3",
"model.similarity_boost": 0.75,
"model.speed": 1,
"output_format": "mp3_44100_192",
"seed": 3333,
"stability": 0.5,
"text": [
"475",
0
],
"voice": [
"442",
0
]
},
"_meta": {
"title": "ElevenLabs Text to Speech"
}
},
"440": {
"class_type": "LoadImage",
"inputs": {
"image": "UPLOADED_image_FILENAME"
},
"_meta": {
"title": "Load Image"
}
},
"441": {
"class_type": "GeminiNode",
"inputs": {
"images": [
"440",
0
],
"model": "gemini-3-1-pro",
"prompt": "A friendly, honest product review for a small amber jar of overnight repair cream, filmed like a casual morning video at home. She has just woken up on a rainy day, holds the jar up next to her cheek and talks straight to the camera like she is telling a friend about something she genuinely loves. Open with a quick, surprising hook about waking up with skin that looks rested even after a short night. Mention one clear benefit: it soaks in fast and is not greasy, so she can put it on and go straight to bed. Keep the tone warm, a little playful and relaxed, with a small laugh. End with a simple, light recommendation to try it, no hard sell and no prices.",
"seed": 967822922709019,
"system_prompt": "Role: You are a professional prompt writer for Eleven Labs v3 two-part generation.\n\nTask: Generate a two-part prompt from the user’s input.\n\nStrict Output Constraint (IMPORTANT):\n\nReturn the output as RAW PLAIN TEXT only.\nDO NOT use Markdown code blocks.\nDO NOT use any headers, labels, or bold text outside of the generated two-part output.\nUse ONLY the separator --- to divide the two parts.\nPart 1: spoken dialogue/performance text only, optimized for Eleven v3.\nPart 2: a structured scene breakdown in short field lines.\nDo NOT output anything before Part 1 or after Part 2.\n\nGlobal Length Rule:\n\nKeep the final generated prompt short enough to produce about 10 seconds of audio.\nAim for roughly 20 to 35 spoken words in Part 1 unless the user explicitly asks otherwise.\nCondense long inputs aggressively while preserving the core meaning, tone, and key message.\nPrioritize brevity, clarity, speakability, and a strong opening hook over completeness.\nRemove repetition, side details, filler, and nonessential context.\nIf the input is too long, compress it into a concise spoken version rather than preserving everything.\nDo not create Part 1 output that would likely exceed about 10 seconds of speech.\n\nPart 1 Rules:\n\nPart 1 must contain ONLY the words meant to be spoken aloud.\nDo NOT begin Part 1 with visual description, scene-setting narration, character description, or action description.\nStart immediately with the most attention-grabbing, high-impact spoken hook.\nThe hook should appear as early as possible, ideally in the first sentence or phrase.\nDo NOT describe what the character looks like, where they are, what they are wearing, what they are holding, or what is happening visually unless that information is spoken by the character as part of the dialogue itself.\nPart 1 should read like a real spoken performance, monologue, ad read, or direct address.\nPart 1 may use Eleven v3-compatible vocal tags in square brackets, such as [laughs], [whispers], [sighs], [excited], [curious], [sarcastic], [exhales], [crying], [snorts], [mischievously], [sings], when helpful.\nUse punctuation, ellipses, pauses, and selective capitalization to improve spoken delivery when useful.\nDo NOT use SSML.\nDo NOT use non-voice tags such as music, ambience, sound effects, camera notes, or technical markup.\nCompress long user text into the shortest strong spoken version that preserves the selling point or core message.\nPrefer one clear hook, one core benefit, and one short closing beat.\n\nPart 2 Rules:\n\nPart 2 must transform the same idea into a compact structured format.\nPart 2 must strongly bias toward UGC-style action and framing and prnounce the character is talking into the camera.\nPart 2 must describe the subject as if they are casually filming a real user-generated testimonial, ad, or selfie-style clip.\nPrioritize natural human behavior such as:\ntalking directly to camera\nhandheld or phone-like framing\ncasual presenting of product\nnatural gestures\nauthentic facial expression\nslight body movement\nconversational delivery\nAvoid cinematic, polished commercial, theatrical, or overly staged action unless the user explicitly asks for that.\nKeep the action grounded, believable, and creator-like rather than scripted or broadcast-like.\nEach line should follow this pattern: field name, colon, content.\nUse only concise production-style descriptors.\nKeep Part 2 aligned with Part 1 and do not introduce unrelated ideas.\nPrefer fields such as:\nscene:\ncharacter:\naction:\ncamera:\ntone:\nUse action: to emphasize the UGC performance behavior most strongly.\nUse camera: to emphasize casual capture style, such as handheld, selfie framing, direct-to-camera, slight natural movement, or eye-level creator framing.\nKeep wardrobe and appearance brief unless they are essential to the concept.\nKeep Part 2 compact and production-friendly.\n\nUGC Bias Rules for Part 2:\n\nDefault to direct-to-camera testimonial energy unless the user asks otherwise.\nDefault to natural handheld realism unless the user asks otherwise.\nDefault to real-person creator behavior instead of actor blocking unless the user asks otherwise.\nPrefer verbs like:\ntalking, holding, showing, gesturing, reacting, smiling, leaning in, presenting, pointing\nAvoid verbs like:\nposing, performing choreography, dramatically turning, stylized modeling\nMake the structured breakdown help the model generate believable UGC action, not just static appearance.\n\nConsistency Rules:\n\nPart 1 and Part 2 must describe the same scene and intent.\nPart 2 is a clean structural breakdown of Part 1.\nDo not make Part 1 and Part 2 feel like separate concepts.\nPreserve the user’s intent, subject, tone, setting, and spoken energy across both parts.\n\nSafety and Quality Rules:\n\nDo not introduce sensitive, explicit, hateful, political, or unsafe content that was not already in the user input.\nKeep vocal tags contextually appropriate and naturally speakable.\nUse expressive enhancements sparingly and intentionally.\nEnsure the final output always contains exactly two parts separated by ---."
},
"_meta": {
"title": "Google Gemini"
}
},
"442": {
"class_type": "ElevenLabsVoiceSelector",
"inputs": {
"voice": "Bella (female, american)"
},
"_meta": {
"title": "ElevenLabs Voice Selector"
}
},
"443": {
"class_type": "PreviewAny",
"inputs": {
"source": [
"441",
0
]
},
"_meta": {
"title": "Preview as Text"
}
},
"445": {
"class_type": "SaveAudioMP3",
"inputs": {
"audio": [
"3",
0
],
"filename_prefix": "audio/text2speech2video",
"quality": "V0"
},
"_meta": {
"title": "Save Audio (MP3) (DEPRECATED)"
}
},
"473": {
"class_type": "PreviewAny",
"inputs": {
"source": [
"476",
0
]
},
"_meta": {
"title": "Preview as Text"
}
},
"474": {
"class_type": "PreviewAny",
"inputs": {
"source": [
"475",
0
]
},
"_meta": {
"title": "Preview as Text"
}
},
"475": {
"class_type": "RegexExtract",
"inputs": {
"case_insensitive": True,
"dotall": False,
"group_index": 1,
"mode": "First Group",
"multiline": False,
"regex_pattern": "(?sm)^(.*?)^---$(.*)",
"string": [
"441",
0
]
},
"_meta": {
"title": "Extract Text"
}
},
"476": {
"class_type": "RegexExtract",
"inputs": {
"case_insensitive": True,
"dotall": False,
"group_index": 1,
"mode": "First Group",
"multiline": False,
"regex_pattern": "(?s)(?<=\\n---\\n)([\\s\\S]*)$",
"string": [
"441",
0
]
},
"_meta": {
"title": "Extract Text"
}
},
"479": {
"class_type": "SaveVideo",
"inputs": {
"filename_prefix": "video/ComfyUI",
"format": "auto",
"format.codec": "auto",
"video": [
"478:312",
0
]
},
"_meta": {
"title": "Save Video"
}
},
"478:285": {
"class_type": "RandomNoise",
"inputs": {
"noise_seed": 42
},
"_meta": {
"title": "RandomNoise"
}
},
"478:286": {
"class_type": "RandomNoise",
"inputs": {
"noise_seed": 3333
},
"_meta": {
"title": "RandomNoise"
}
},
"478:287": {
"class_type": "LTXVConcatAVLatent",
"inputs": {
"audio_latent": [
"478:309",
1
],
"video_latent": [
"478:296",
0
]
},
"_meta": {
"title": "Concat AV Latent"
}
},
"478:288": {
"class_type": "KSamplerSelect",
"inputs": {
"sampler_name": "euler_cfg_pp"
},
"_meta": {
"title": "KSamplerSelect"
}
},
"478:289": {
"class_type": "ManualSigmas",
"inputs": {
"sigmas": "0.85, 0.7250, 0.4219, 0.0"
},
"_meta": {
"title": "ManualSigmas"
}
},
"478:290": {
"class_type": "CFGGuider",
"inputs": {
"cfg": 1,
"model": [
"478:601",
0
],
"negative": [
"478:292",
1
],
"positive": [
"478:292",
0
]
},
"_meta": {
"title": "CFG Guider"
}
},
"478:291": {
"class_type": "SamplerCustomAdvanced",
"inputs": {
"guider": [
"478:315",
0
],
"latent_image": [
"478:326",
0
],
"noise": [
"478:286",
0
],
"sampler": [
"478:298",
0
],
"sigmas": [
"478:308",
0
]
},
"_meta": {
"title": "SamplerCustomAdvanced"
}
},
"478:292": {
"class_type": "LTXVCropGuides",
"inputs": {
"latent": [
"478:309",
0
],
"negative": [
"478:307",
1
],
"positive": [
"478:307",
0
]
},
"_meta": {
"title": "LTXVCropGuides"
}
},
"478:293": {
"class_type": "LoraLoaderModelOnly",
"inputs": {
"lora_name": "ltx-2.3-22b-distilled-lora-384.safetensors",
"model": [
"478:317",
0
],
"strength_model": 0.5
},
"_meta": {
"title": "Load LoRA"
}
},
"478:294": {
"class_type": "ResizeImagesByLongerEdge",
"inputs": {
"images": [
"478:297",
0
],
"longer_edge": 1536
},
"_meta": {
"title": "Resize Images by Longer Edge (DEPRECATED)"
}
},
"478:295": {
"class_type": "LTXVLatentUpsampler",
"inputs": {
"samples": [
"478:309",
0
],
"upscale_model": [
"478:313",
0
],
"vae": [
"478:317",
2
]
},
"_meta": {
"title": "LTXVLatentUpsampler"
}
},
"478:296": {
"class_type": "LTXVImgToVideoInplace",
"inputs": {
"bypass": [
"478:305",
0
],
"image": [
"478:334",
0
],
"latent": [
"478:295",
0
],
"strength": 1,
"vae": [
"478:317",
2
]
},
"_meta": {
"title": "LTXVImgToVideoInplace"
}
},
"478:297": {
"class_type": "ResizeImageMaskNode",
"inputs": {
"input": [
"440",
0
],
"resize_type": "scale dimensions",
"resize_type.crop": "center",
"resize_type.height": [
"478:324",
0
],
"resize_type.width": [
"478:330",
0
],
"scale_method": "lanczos"
},
"_meta": {
"title": "Resize Image/Mask"
}
},
"478:298": {
"class_type": "KSamplerSelect",
"inputs": {
"sampler_name": "euler_ancestral_cfg_pp"
},
"_meta": {
"title": "KSamplerSelect"
}
},
"478:299": {
"class_type": "ComfyMathExpression",
"inputs": {
"expression": "a/2",
"values.a": [
"478:330",
0
]
},
"_meta": {
"title": "Math Expression"
}
},
"478:301": {
"class_type": "ComfyMathExpression",
"inputs": {
"expression": "a/2",
"values.a": [
"478:324",
0
]
},
"_meta": {
"title": "Math Expression"
}
},
"478:302": {
"class_type": "EmptyLTXVLatentVideo",
"inputs": {
"batch_size": 1,
"height": [
"478:301",
1
],
"length": [
"478:329",
1
],
"width": [
"478:299",
1
]
},
"_meta": {
"title": "Empty LTXV Latent Video"
}
},
"478:303": {
"class_type": "LTXVAudioVAEDecode",
"inputs": {
"audio_vae": [
"478:335",
0
],
"samples": [
"478:311",
1
]
},
"_meta": {
"title": "LTXV Audio VAE Decode"
}
},
"478:304": {
"class_type": "ComfyMathExpression",
"inputs": {
"expression": "a",
"values.a": [
"478:323",
0
]
},
"_meta": {
"title": "Math Expression"
}
},
"478:305": {
"class_type": "PrimitiveBoolean",
"inputs": {
"value": False
},
"_meta": {
"title": "Switch to Text to Video?"
}
},
"478:306": {
"class_type": "CLIPTextEncode",
"inputs": {
"clip": [
"478:318",
0
],
"text": [
"478:319",
0
]
},
"_meta": {
"title": "CLIP Text Encode (Prompt)"
}
},
"478:307": {
"class_type": "LTXVConditioning",
"inputs": {
"frame_rate": [
"478:304",
0
],
"negative": [
"478:314",
0
],
"positive": [
"478:306",
0
]
},
"_meta": {
"title": "LTXVConditioning"
}
},
"478:308": {
"class_type": "ManualSigmas",
"inputs": {
"sigmas": "1.0, 0.99375, 0.9875, 0.98125, 0.975, 0.909375, 0.725, 0.421875, 0.0"
},
"_meta": {
"title": "ManualSigmas"
}
},
"478:309": {
"class_type": "LTXVSeparateAVLatent",
"inputs": {
"av_latent": [
"478:291",
0
]
},
"_meta": {
"title": "Separate AV Latent"
}
},
"478:310": {
"class_type": "SamplerCustomAdvanced",
"inputs": {
"guider": [
"478:290",
0
],
"latent_image": [
"478:287",
0
],
"noise": [
"478:285",
0
],
"sampler": [
"478:288",
0
],
"sigmas": [
"478:289",
0
]
},
"_meta": {
"title": "SamplerCustomAdvanced"
}
},
"478:311": {
"class_type": "LTXVSeparateAVLatent",
"inputs": {
"av_latent": [
"478:310",
0
]
},
"_meta": {
"title": "Separate AV Latent"
}
},
"478:312": {
"class_type": "CreateVideo",
"inputs": {
"audio": [
"478:303",
0
],
"bit_depth": "auto",
"codec": "none",
"color_space": "sRGB",
"fps": [
"478:304",
0
],
"images": [
"478:316",
0
]
},
"_meta": {
"title": "Create Video"
}
},
"478:313": {
"class_type": "LatentUpscaleModelLoader",
"inputs": {
"model_name": "ltx-2.3-spatial-upscaler-x2-1.1.safetensors"
},
"_meta": {
"title": "Load Latent Upscale Model"
}
},
"478:314": {
"class_type": "CLIPTextEncode",
"inputs": {
"clip": [
"478:318",
0
],
"text": "pc game, console game, video game, cartoon, childish, ugly"
},
"_meta": {
"title": "CLIP Text Encode (Prompt)"
}
},
"478:315": {
"class_type": "CFGGuider",
"inputs": {
"cfg": 1,
"model": [
"478:601",
0
],
"negative": [
"478:307",
1
],
"positive": [
"478:307",
0
]
},
"_meta": {
"title": "CFG Guider"
}
},
"478:316": {
"class_type": "VAEDecodeTiled",
"inputs": {
"overlap": 64,
"samples": [
"478:311",
0
],
"temporal_overlap": 4,
"temporal_size": 4096,
"tile_size": 768,
"vae": [
"478:317",
2
]
},
"_meta": {
"title": "VAE Decode (Tiled)"
}
},
"478:317": {
"class_type": "CheckpointLoaderSimple",
"inputs": {
"ckpt_name": "ltx-2.3-22b-dev-fp8.safetensors"
},
"_meta": {
"title": "Load Checkpoint"
}
},
"478:318": {
"class_type": "LTXAVTextEncoderLoader",
"inputs": {
"ckpt_name": "ltx-2.3-22b-dev-fp8.safetensors",
"device": "default",
"text_encoder": "gemma_3_12B_it_fp4_mixed.safetensors"
},
"_meta": {
"title": "Load LTXV Audio Text Encoder"
}
},
"478:319": {
"class_type": "PrimitiveStringMultiline",
"inputs": {
"value": [
"476",
0
]
},
"_meta": {
"title": "Prompt"
}
},
"478:323": {
"class_type": "PrimitiveInt",
"inputs": {
"value": 24
},
"_meta": {
"title": "Frame Rate"
}
},
"478:324": {
"class_type": "PrimitiveInt",
"inputs": {
"value": 720
},
"_meta": {
"title": "Height"
}
},
"478:325": {
"class_type": "LTXVImgToVideoInplace",
"inputs": {
"bypass": [
"478:305",
0
],
"image": [
"478:334",
0
],
"latent": [
"478:302",
0
],
"strength": 0.7,
"vae": [
"478:317",
2
]
},
"_meta": {
"title": "LTXVImgToVideoInplace"
}
},
"478:326": {
"class_type": "LTXVConcatAVLatent",
"inputs": {
"audio_latent": [
"478:327",
0
],
"video_latent": [
"478:325",
0
]
},
"_meta": {
"title": "Concat AV Latent"
}
},
"478:327": {
"class_type": "SetLatentNoiseMask",
"inputs": {
"mask": [
"478:333",
0
],
"samples": [
"478:328",
0
]
},
"_meta": {
"title": "Set Latent Noise Mask"
}
},
"478:328": {
"class_type": "LTXVAudioVAEEncode",
"inputs": {
"audio": [
"478:332",
0
],
"audio_vae": [
"478:335",
0
]
},
"_meta": {
"title": "LTXV Audio VAE Encode"
}
},
"478:329": {
"class_type": "ComfyMathExpression",
"inputs": {
"expression": "a * b + 1",
"values.a": [
"478:331",
0
],
"values.b": [
"478:323",
0
]
},
"_meta": {
"title": "Math Expression"
}
},
"478:330": {
"class_type": "PrimitiveInt",
"inputs": {
"value": 1280
},
"_meta": {
"title": "Width"
}
},
"478:331": {
"class_type": "PrimitiveFloat",
"inputs": {
"value": 12
},
"_meta": {
"title": "Duration"
}
},
"478:332": {
"class_type": "TrimAudioDuration",
"inputs": {
"audio": [
"3",
0
],
"duration": [
"478:331",
0
],
"start_index": 0
},
"_meta": {
"title": "Trim Audio Duration"
}
},
"478:333": {
"class_type": "SolidMask",
"inputs": {
"height": [
"478:324",
0
],
"value": 0,
"width": [
"478:330",
0
]
},
"_meta": {
"title": "Create Solid Mask"
}
},
"478:334": {
"class_type": "LTXVPreprocess",
"inputs": {
"image": [
"478:294",
0
],
"img_compression": 18
},
"_meta": {
"title": "LTXV Preprocess"
}
},
"478:335": {
"class_type": "LTXVAudioVAELoader",
"inputs": {
"ckpt_name": "ltx-2.3-22b-dev-fp8.safetensors"
},
"_meta": {
"title": "Load LTXV Audio VAE"
}
},
"478:601": {
"class_type": "LoraLoaderModelOnly",
"inputs": {
"lora_name": "ltx-2.3-id-lora-talkvid-3k.safetensors",
"model": [
"478:293",
0
],
"strength_model": 1
},
"_meta": {
"title": "Load LoRA"
}
}
})
workflow.set_input("440", "image", client.assets.from_url("https://comfy.org/catalog-media/75f8228c-37f2-4dcd-bd25-b02f020d9a6a/33ce8181-b949-4c83-93ce-1613d967d887"))
# run() also passes api_key to the partner nodes in this workflow.
job = client.run(workflow, api_key=api_key)
for output in job.get_outputs("479"):
output.to_file(output.name)
for output in job.get_outputs("445"):
output.to_file(output.name)Probar un ejemplo
Acerca de este flujo de trabajo
Este Flujo de trabajo tutorial de ComfyUI convierte una sola imagen en un vídeo corto estilo UGC con sincronización labial, con voz clonada o seleccionada. Encadena tres etapas: creación de prompt a partir de tu imagen subida, síntesis de voz con ElevenLabs y generación de vídeo con LTX‑2.3. El grupo Create Prompt enruta la imagen desde LoadImage hacia GeminiNode para generar automáticamente dos textos: un guion de voz listo para interpretación (con etiquetas de expresión) y una descripción de escena. RegexExtract analiza la respuesta de Gemini para separar claramente las secciones “speech” y “scene” para los nodos posteriores.
Para el audio, puedes elegir una voz predefinida con ElevenLabsVoiceSelector o aportar tu propio tono con ElevenLabsInstantVoiceClone, y luego sintetizar la narración final en ElevenLabsTextToSpeech y, opcionalmente, guardarla con SaveAudioMP3. El grupo Create Video alimenta la descripción de escena y el audio al nodo de vídeo LTX‑2.3 (UUID: 98fb87e2-23b5-4ecb-aacc-365912414a12) para producir un vídeo tipo talking con sincronización labial precisa, previsualizado con PreviewAny y guardado con SaveVideo. Esta configuración es práctica para UGC rápido, explicadores de producto, testimonios o publicaciones en redes sociales porque automatiza la redacción del guion desde una imagen y garantiza la alineación voz‑labios mediante ElevenLabs + LTX.
Preguntas y respuestas
Sí. Proporciona una clave API válida de Gemini en GeminiNode para la generación de indicaciones y una clave API de ElevenLabs en los nodos ElevenLabs para selección/clonación de voz y TTS. Sin Gemini, puedes omitir ese paso escribiendo manualmente los prompts de discurso y escena.
La narración generada por ElevenLabsTextToSpeech se alimenta directamente al nodo de video LTX‑2.3, que usa el audio para alinear los movimientos de la boca. Mantener el archivo TTS final como fuente exacta de audio asegura la sincronización precisa de labios.
Sí. Usa LoadAudio para ingresar tu narración y conéctala donde iría el audio TTS en el grupo Create Video. Omite el paso ElevenLabsTextToSpeech en ese caso.
GeminiNode devuelve tanto un guion como una descripción de escena. RegexExtract analiza esa respuesta en dos salidas limpias—una para ElevenLabsTextToSpeech (prompt de discurso) y otra para el nodo de video LTX‑2.3 (prompt de escena)—para mantener la canalización fiable.