Local Voice Cloning for Chinese Video Workflows

Information compiled: 2026-06-11 Target scenario: a Chinese speech-configuration Skill embedded in a video workflow, with selectable voices and support for local voice cloning.

Key Conclusions

Prioritize these categories:

• Local-machine first: Qwen3-TTS, Chatterbox, Kokoro as a fallback, and GPT-SoVITS as a voice-production workbench.

• Strong Chinese capabilities but better suited to a server or cloud GPU: CosyVoice, VoxCPM, and IndexTTS2.

• Use cautiously for commercial video: F5-TTS, Spark-TTS, ChatTTS, Fish Speech, and Coqui XTTS-v2; verify each model's license individually.

• None of these projects currently appears to offer a mature Codex/Agent Skill. They mainly provide Python APIs, WebUIs, CLIs, Gradio demos, FastAPI/gRPC services, or OpenAI-compatible servers, so we would need to build the Skill layer ourselves.

Public Libraries That Support Voice Cloning

Public library	Voice-cloning capability	Chinese support	Licensing/commercial-use risk	Local Mac fit	Suitable for a video-workflow Skill?	Link
Qwen3-TTS	Supports voice cloning and voice design	Strong	Official project uses Apache-2.0; still verify each specific model	Excellent for Apple Silicon; community MLX implementations already exist	Strongly recommended as the first candidate	GitHub
CosyVoice / CosyVoice2	Zero-shot voice cloning, cross-lingual cloning, and preset voices	Very strong, including Chinese and dialects	Apache-2.0	Official support favors Linux/NVIDIA; setup on a local Mac is cumbersome	Strongly recommended, but better as a server backend	GitHub
Chatterbox Multilingual	Zero-shot voice cloning with audio prompts	Supports Chinese	MIT	Includes Mac examples and MPS support; well suited to local experiments	Recommended and easy to package quickly	GitHub
GPT-SoVITS	Five-second zero-shot, one-minute few-shot, and voice fine-tuning	Mature Chinese ecosystem	MIT	Supports Apple Silicon, though the workflow is relatively heavy	Recommended as a cloned-voice production workbench	GitHub
IndexTTS2	Zero-shot voice cloning with duration and emotion control	Strong	Licensing and commercial use require additional confirmation	CUDA/GPU oriented and unfriendly to a MacBook Air	Suitable for lip-sync/duration control in video, but not recommended as the primary local solution	GitHub
OpenVoice V2	Instant tone-color cloning, focused on timbre transfer	Supported	MIT; relatively commercial-friendly	Lightweight and worth trying locally	Suitable as a timbre-conversion module, usually paired with a base TTS system	GitHub
F5-TTS	Zero-shot/few-shot style cloning	Supported	Code is MIT, but many commonly used pretrained models are noncommercial	Can run locally but needs practical tuning	Fine for research/personal testing; use cautiously for commercial video	GitHub
Fish Speech	Rapid voice cloning from 10-30 seconds of audio	Strong	Fish Audio Research License; commercial use requires caution	The model is heavy and unsuitable for sustained use on an M4 Air	High quality, but not a first choice for a lightweight local Skill	GitHub
VoxCPM / VoxCPM2	Reference-audio cloning and controllable speech generation	Supports Chinese and multiple languages	Apache-2.0	Official support favors CUDA/GPU	A candidate for a server backend	GitHub
Zonos	Voice cloning from 10-30 seconds of audio	Multilingual; Chinese requires testing	Apache-2.0	Can be tested, but Chinese stability needs validation	A candidate, not a first-tier choice for Chinese video workflows	GitHub
Coqui XTTS-v2	Voice cloning from about six seconds of audio	Supports Chinese	Coqui is no longer maintained; verify the model license carefully	Can run locally, but carries maintenance risk	A longstanding option, but not recommended as a major bet for a new project	Hugging Face
Spark-TTS	Zero-shot voice cloning	Supports Chinese	CC BY-NC-SA; clear noncommercial risk	The model is not lightweight	Suitable only for research/personal experiments	Hugging Face
StyleTTS2	Zero-shot speaker adaptation	English-oriented; weak Chinese	Verify each item	Research-oriented	Unsuitable as the main backend for a Chinese-video Skill	GitHub
MaskGCT / Amphion	Zero-shot TTS/voice-cloning research frameworks	Supported, but research-oriented	Verify each item	High engineering cost to package	Suitable for research, not for a production Skill out of the box	GitHub
MegaTTS3	Zero-shot voice cloning	Supported	Review openness and usage restrictions carefully	Not a first choice for local use	Worth watching, but maturity and licensing need further validation	GitHub
Confucius4-TTS	Zero-shot voice transfer	Supports 14 languages, including Chinese	Verify each item	Official support favors CUDA; a new project whose maturity remains to be seen	A watch-list item, not recommended as the primary solution today	GitHub
ChatTTS	Voice/speaker controls, but not a standard local cloning workflow	Strong Chinese	AGPL code and CC BY-NC model	Can run locally, but production constraints are substantial	Not recommended as the main video-production Skill	GitHub

Recommendations for an M4 MacBook Air with 16 GB RAM

Recommended

1. Qwen3-TTS + MLX / mlx-audio

2. Chatterbox Multilingual

3. GPT-SoVITS

4. Kokoro

Not Recommended as the Primary Solution on This Machine

• CosyVoice / VoxCPM / IndexTTS2: Strong Chinese capabilities and output, but more oriented toward CUDA/GPU or server environments; neither local deployment nor sustained batch inference is ideal on an M4 Air.

• F5-TTS / Spark-TTS / ChatTTS / Fish Speech: Capable, but licensing, model weight, or production constraints are more troublesome.

• StyleTTS2 / MaskGCT / Amphion / MegaTTS3 / Confucius4-TTS: More research-oriented or still emerging, so they are not yet suitable as a stable primary backend for a video workflow.

Is There Already a Mature Skill We Can Use Directly?

None of these public libraries currently appears to offer a mature Codex/Agent Skill. Their existing interfaces are mainly:

• Python API

• WebUI / Gradio Demo

• CLI examples

• Docker / FastAPI / gRPC services

• OpenAI-compatible servers or similar interfaces

Therefore, integrating one into a video workflow requires a separately packaged Skill. A recommended minimum structure is:

Module	Purpose
voices/registry.json	Manage preset and cloned voices
scripts/list_voices.py	List available voices
scripts/clone_voice.py	Import reference audio and register a locally cloned voice
scripts/tts.py	Convert one text input to speech
scripts/render_batch.py	Generate speech in batches for video storyboards/subtitles

Recommended Path

The most reliable short-term path is:

1. Use Qwen3-TTS + MLX as the primary local engine.

2. Use Chatterbox as a backup for cloning.

3. Use GPT-SoVITS to produce high-quality cloned-voice assets.

4. Keep Kokoro for rapid drafts and fallback output.

5. If stronger Chinese dialect, emotion, or duration control is later required, deploy CosyVoice / IndexTTS2 on a cloud GPU or dedicated server.