The 'Text to Song' workflow introduces a groundbreaking approach to generating music from text prompts using the ACE-Step v1 model. This innovative technique leverages advanced AI capabilities to transform written words into harmonious melodies, providing a seamless bridge between linguistic input and auditory output. What sets this method apart is its ability to interpret both 'tags' and 'lyrics' to craft songs that are not only lyrically coherent but also rhythmically and stylistically aligned with the specified genre. By utilizing the ACE-Step v1 model, this workflow marks a significant leap from traditional text-to-audio conversions, offering a more nuanced and expressive musical generation process.
This advancement is particularly significant as it expands the creative possibilities for artists, musicians, and content creators. Unlike previous models, ACE-Step v1 allows for a more detailed and customizable song creation process, where users can specify the type of music and rhythm through 'tags', alongside the lyrical content. This dual-input system enhances the model's ability to produce complex and genre-specific compositions, making it a versatile tool for generating everything from pop hits to classical pieces. Furthermore, the integration of multi-language support, albeit currently limited to English character conversion, hints at the model's potential for global applicability, paving the way for future developments in multilingual music generation.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
Run it from TypeScript or Python with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
// Install (beta)
npm i @comfyorg/sdk
// Run this workflow (TypeScript)
import { Comfy } from "@comfyorg/sdk";
const client = new Comfy({ apiKey: "comfyui-..." });
const wf = await client.workflows.fromFile("workflow_api.json");
const job = await client.run(wf);
await job.getOutputs("<output-node-id>")[0].toFile("output.png");The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API).
Comfy Cloud API access requires a plan with an API key.
FAQ
