The ACE-Step 1.5 AI Lyric Song Generation workflow is a sophisticated tool designed to transform a simple music style input and optional lyrics into a complete song with AI-generated lyrics and audio. This workflow leverages the ACE-Step and Google Gemini models to synthesize both text and audio, providing a seamless experience from concept to creation. At its core, the workflow uses nodes like SaveAudioMP3 for outputting the final audio file, and GeminiNode for processing the AI-generated content. The RegexExtract node is instrumental in parsing and refining input data, ensuring that the AI's output is coherent and aligned with the user's intent. This workflow is particularly useful for musicians, content creators, and anyone interested in exploring AI's potential in music production.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run "ACE-Step 1.5 AI Lyric Song Generation" (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
// This workflow, exported in API format (see note below)
const wf = await client.workflows.fromFile("audio_ace_step_1_5_split_llm_api.json");
const job = await client.run(wf);
await job.getOutputs("1")[0].toFile("output.png"); // SaveAudioMP3The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
