{"name":"VoxCPM: Tokenizer-Free TTS for Multilingual Speech, Voice Design, and Cloning","description":"VoxCPM2 is a groundbreaking tokenizer-free Text-to-Speech system, offering highly natural and expressive synthesis across 30 languages. It enables creative voice design from natural language descriptions and provides advanced controllable voice cloning capabilities. With its 2B parameter model, VoxCPM2 delivers 48kHz studio-quality audio, making it a powerful tool for diverse speech generation needs.","github":"https://github.com/OpenBMB/VoxCPM","url":"https://osrepos.com/repo/openbmb-voxcpm","source":"osrepos.com","sourceDescription":"This repository profile is provided by osrepos.com, an open source repository discovery platform.","repositoryProfile":"https://osrepos.com/repo/openbmb-voxcpm","generatedFor":"open source discovery and AI-assisted research","markdown":"https://osrepos.com/repo/openbmb-voxcpm.md","json":"https://osrepos.com/repo/openbmb-voxcpm.json","topics":["audio","deeplearning","multilingual","python","speech-synthesis","text-to-speech","voice-cloning","voice-design"],"keywords":["audio","deeplearning","multilingual","python","speech-synthesis","text-to-speech","voice-cloning","voice-design"],"stars":null,"summary":"VoxCPM2 is a groundbreaking tokenizer-free Text-to-Speech system, offering highly natural and expressive synthesis across 30 languages. It enables creative voice design from natural language descriptions and provides advanced controllable voice cloning capabilities. With its 2B parameter model, VoxCPM2 delivers 48kHz studio-quality audio, making it a powerful tool for diverse speech generation needs.","content":"## Introduction\n\nVoxCPM2 is a cutting-edge, tokenizer-free Text-to-Speech (TTS) system developed by OpenBMB. It directly generates continuous speech representations using an end-to-end diffusion autoregressive architecture, bypassing discrete tokenization for highly natural and expressive synthesis. The latest major release, VoxCPM2, is a 2B parameter model trained on over 2 million hours of multilingual speech data, now supporting 30 languages. It introduces innovative features like Voice Design, Controllable Voice Cloning, and delivers 48kHz studio-quality audio output. Built on a MiniCPM-4 backbone, VoxCPM2 is fully open-source and commercial-ready under the Apache-2.0 license.\n\n## Installation\n\nGetting started with VoxCPM is straightforward. Ensure you have Python ? 3.10 (<3.13), PyTorch ? 2.5.0, and CUDA ? 12.0 installed.\n\nbash\npip install voxcpm\n\n\nFor more detailed installation instructions, refer to the [official documentation](https://voxcpm.readthedocs.io/en/latest/quickstart.html).\n\n## Examples\n\nVoxCPM provides a flexible Python API for various speech synthesis tasks.\n\n### Text-to-Speech\n\nGenerate speech from text with ease:\n\npython\nfrom voxcpm import VoxCPM\nimport soundfile as sf\n\nmodel = VoxCPM.from_pretrained(\"openbmb/VoxCPM2\", load_denoiser=False)\n\nwav = model.generate(\n    text=\"VoxCPM2 is a powerful multilingual speech synthesis system.\",\n    cfg_value=2.0,\n    inference_timesteps=10,\n)\nsf.write(\"demo.wav\", wav, model.tts_model.sample_rate)\nprint(\"saved: demo.wav\")\n\n\n### Voice Design\n\nCreate a brand-new voice from a natural-language description, no reference audio needed. Simply put the description in parentheses at the start of your text:\n\npython\nwav = model.generate(\n    text=\"(A young woman, gentle and sweet voice)Hello, welcome to VoxCPM2!\",\n    cfg_value=2.0,\n    inference_timesteps=10,\n)\nsf.write(\"voice_design.wav\", wav, model.tts_model.sample_rate)\n\n\n### Controllable Voice Cloning\n\nClone any voice from a short reference clip, with optional style guidance to steer emotion, pace, and expression while preserving the original timbre:\n\npython\nwav = model.generate(\n    text=\"(slightly faster, cheerful tone)This is a cloned voice with style control.\",\n    reference_wav_path=\"path/to/voice.wav\",\n    cfg_value=2.0,\n    inference_timesteps=10,\n)\nsf.write(\"controllable_clone.wav\", wav, model.tts_model.sample_rate)\n\n\n## Why Use VoxCPM?\n\nVoxCPM2 stands out with several key advantages for speech generation:\n\n*   **30-Language Multilingual Support:** Synthesize text in any of the 30 supported languages without needing language tags.\n*   **Creative Voice Design:** Generate unique voices purely from natural-language descriptions, eliminating the need for reference audio.\n*   **Controllable Voice Cloning:** Clone voices from short clips and fine-tune style, emotion, and pace while maintaining the original timbre.\n*   **48kHz High-Quality Audio:** Output studio-quality audio directly, with built-in super-resolution.\n*   **Real-Time Streaming:** Achieve low Real-Time Factor (RTF) for efficient, high-throughput serving, especially with Nano-vLLM or vLLM-Omni.\n*   **Fully Open-Source & Commercial-Ready:** Released under the Apache-2.0 license, making it free for commercial use.\n\n## Links\n\nExplore VoxCPM further through these official resources:\n\n*   [GitHub Repository](https://github.com/OpenBMB/VoxCPM)\n*   [Live Playground Demo](https://huggingface.co/spaces/OpenBMB/VoxCPM-Demo)\n*   [Official Documentation](https://voxcpm.readthedocs.io/en/latest/)\n*   [VoxCPM2 Model on Hugging Face](https://huggingface.co/openbmb/VoxCPM2)","metrics":{"detailViews":6,"githubClicks":19},"dates":{"published":null,"modified":"2026-06-01T20:18:26.000Z"}}