When to use it
Sound like one company
One cloned voice across every call, every notification and every recording,
instead of a different stock voice per surface.
Sound like a person
Clone a founder, a presenter, a support lead — with their consent — and the
product speaks in a voice customers already know.
Speak another language as yourself
A cloned voice carries into live interpretation.
Just need a voice?
The built-in library covers most cases and needs no upload.
The invariant
The TTS model with no speaker conditioning samples a new random voice on everygenerate() call. In a batch job you’d notice a strange
timbre; in a realtime session you get a caller whose agent changes voice between
sentences.
So:
- Cloned voices store the audio you uploaded.
- Built-in voices are designed once through the voice-design vocabulary, and the generated clip is frozen as their reference.
- Never send
prompt_keywithoutref_audio_url— the serving backends only read the cache key inside that branch. - For realtime, write the voice to
session.audio.output.voice. Nothing else is read.
Clone a voice
Three to ten seconds of clean speech is enough. Longer is not better; clean is better. One speaker, no music, no overlap — see Voice cloning best practices for what that means in a recording booth and why it matters so much. Cloning is amultipart/form-data upload, which the generated JSON client
can’t express — create_voice is in the SDK but takes no arguments, so post the
form directly:
status that
moves to ready once the reference clip is transcribed and encoded. Poll
client.get_voice(voice_id) or just watch the library.
Built-in voices
Built-in voices are global rows shared across organizations, seeded per environment:Design a voice
Rather than cloning, describe one. The accepted vocabulary comes from the backend:Preview
Preview synthesizes one fixed sentence with the voice and streams back mp3 — there is no text to choose, which is what makes two voices comparable. It isn’t in the SDK yet (the SDK decodes JSON, and this returns audio):voice set to the voice id.
Going further
Voice cloning best practices
What makes a clip good, and the two failure modes that look like a bad model.