Repository: localaiLicense: mit
Chatterbox (audio.cpp, Q8_0) - multilingual zero-shot voice cloning, served by the audio-cpp backend. A reference clip is REQUIRED. This build advertises only the cloning and voice-conversion tasks, not plain TTS, so every request must set the TTS voice field to the path of a WAV file on the server; a voice that is not a file on disk is treated as a named preset and the request is refused with a message saying so. The voice-conversion half is reached through /audio/transform rather than /v1/audio/speech: post the speech to convert as `audio` and the target speaker's clip as `reference`. That is why this entry declares audio_transform alongside tts. With both this and a source-separation model installed, /audio/transform has two candidates, so name the model explicitly rather than relying on the default pick. Q8_0 rather than 16-bit because upstream's tested-status table records the same result for both (Pass, ASR match with drift) and this build is half the size.
Links
Tags
Repository: localaiLicense: gpl-3.0
Seed-VC (audio.cpp, Q8_0) - singing voice conversion, served by the audio-cpp backend through /audio/transform. Post the performance to convert as `audio` and the target singer's clip as `reference`. This entry pins task:svc, and the pin is what makes it a singing model rather than a speech one. Seed-VC advertises both svc and ordinary voice conversion, and nothing in a request says "this input is singing", so auto-routing always picks voice conversion; the pin is the only way to reach the singing path. Drop the option from the model config to get plain voice conversion from the same weights. Q8_0 because the 16-bit and Q8_0 builds carry the same tested status upstream (drift) and this one is half the size. Note the GPL-3.0 licence, which is stricter than most of the gallery.
Links
Tags
Repository: localaiLicense: other
Vevo2 (audio.cpp, Q8_0) - speech to speech, served by the audio-cpp backend through /audio/transform. Post the source speech as `audio`, the target speaker's clip as `reference`, and the words being spoken as `params[text]`. The text is not optional and not a hint. Vevo2's speech-to-speech route is a text and prosody route: it reads the line it is resynthesising and refuses the run without one. /audio/transform has no text field on the wire, so the params map carries it and the backend lifts it into the engine's text input; `params[target_text]` is the same thing under the name Vevo2's own option table uses. Add `params[language]` when the line is not English. This entry pins task:s2s. Vevo2 also advertises plain voice conversion, which needs no text and which auto-routing picks first, so without the pin the text would be carried and then ignored. Drop the option to get voice conversion from the same weights. Q8_0 because it is the only build that fits alongside the rest of the gallery; upstream records the original and 16-bit builds as the cleaner ones, so expect drift on some routes.
Links
Tags