Skip to content
aicoolies logo
VibeVoice logo

VibeVoice

Microsoft's open-source frontier voice AI for long-form multi-speaker audio

VibeVoice is Microsoft's open-source voice AI family with both TTS and speech recognition models. The TTS model generates up to 90 minutes of expressive multi-speaker audio with 4 distinct voices. VibeVoice-ASR transcribes 60-minute recordings in a single pass with speaker identification and timestamps. Built on continuous speech tokenizers at 7.5 Hz and next-token diffusion, it compresses audio 80x more efficiently than Encodec while preserving fidelity.

About VibeVoice

VibeVoice represents a significant architectural innovation in speech synthesis. Traditional TTS systems struggle with long-form audio due to high token rates that create computational bottlenecks, and they typically handle only one or two speakers with limited emotional range. VibeVoice solves these challenges through continuous speech tokenizers operating at an ultra-low frame rate of approximately 7.5 Hz, compressing audio representation dramatically while maintaining acoustic fidelity. The system uses a Large Language Model based on Qwen 2.5 to understand textual context and dialogue flow, combined with a diffusion head that generates high-fidelity acoustic details. The result is natural conversational audio with proper turn-taking, emotional nuance, and consistent speaker identity across long sequences.

The family includes three main components. VibeVoice-1.5B is the flagship TTS model accepted as an Oral at ICLR 2026, generating up to 90 minutes of multi-speaker conversational audio. VibeVoice-Realtime-0.5B is a lightweight variant for streaming TTS with approximately 200ms latency, designed for real-time services and LLM voice output. VibeVoice-ASR handles speech-to-text for 60-minute recordings, producing structured transcriptions with speaker identification, timestamps, and customized hotword support. The ASR component was integrated into Hugging Face Transformers in March 2026. All models support English and Chinese natively, with experimental multilingual capabilities in nine additional languages including German, French, Japanese, and Korean.

Released under MIT license with built-in safety measures including audible AI-generated disclaimers and imperceptible watermarks for provenance verification, VibeVoice is available through GitHub documentation and Hugging Face model cards. Microsoft positions the project for research and development, and the current repository notes that the TTS code was removed for responsible-use reasons even though public model cards remain available. With about 49K GitHub stars, VibeVoice is especially relevant for developers evaluating voice agents, podcast generation, and voice-enabled AI applications.

Pricing & Platform Specs

Pricing Summary

100% free and open-source under the MIT license ($0 software licensing fee, Microsoft Research). VibeVoice provides unified zero-shot voice cloning, real-time streaming TTS, and long-form multi-speaker dialogue synthesis (up to 90 minutes) using next-token diffusion and 7.5 Hz speech tokenizers. Supports PyTorch and ONNX Runtime deployment across local GPUs and CPUs with zero software or subscription costs; users pay only for their underlying compute hardware.

full pricing breakdown →

Supported Platforms

Python/PyTorch, Hugging Face model cards, Colab/Transformers demos; GPU recommended

Explore categories, tags & use cases

Categories

Google's pretrained foundation model for zero-shot time-series forecasting

TimesFM is a pretrained time-series foundation model from Google Research that performs zero-shot forecasting on diverse datasets without task-specific training. It handles univariate and multivariate time series across domains including finance, logistics, energy, and infrastructure monitoring with accuracy competitive against traditional statistical methods like ARIMA and Prophet.

Open Source

First commercially viable 1-bit LLMs that are 14x smaller and 8x faster

PrismML Bonsai delivers the first commercially viable 1-bit large language models with 8B, 4B, and 1.7B parameter variants. The 8B model runs in just 1GB of RAM versus 16GB for standard FP16 models, achieving 44 tokens per second on iPhone. Backed by $16.25M from Khosla Ventures and released under Apache 2.0, Bonsai makes capable LLMs practical for edge devices and resource-constrained environments.

paid

Production-grade reinforcement learning framework for LLM training

verl is an open-source reinforcement learning framework designed specifically for training and aligning large language models. Built for production use with support for distributed training across multiple GPUs and nodes, it implements RLHF, DPO, and other alignment algorithms that make LLMs follow instructions, avoid harmful outputs, and generate higher quality responses. Over 580 contributors and 20,000 GitHub stars signal strong adoption.

Open Source

State-of-the-art open-source text-to-speech with emotion control

Chatterbox is an open-source text-to-speech model by Resemble AI that delivers state-of-the-art voice synthesis with fine-grained emotion and style control. The model supports zero-shot voice cloning from short audio samples, produces natural-sounding speech across multiple speaking styles, and runs locally without cloud dependencies. With over 24,000 GitHub stars, it has become the leading open-source alternative to commercial TTS services for developers building voice-enabled AI applications.

Open Source

Kubernetes-native distributed LLM inference stack

llm-d is an open-source Kubernetes-native stack for distributed LLM inference with cache-aware routing and disaggregated serving. It separates prefill and decode stages across different GPU pools for optimal resource utilization, routes requests to nodes with warm KV caches, and integrates with vLLM as the serving engine. Apache-2.0 licensed with 2,900+ GitHub stars.

Open Source

Side-by-Side Comparisons

VibeVoice logo
VibeVoice
vs
Resemble AI logo
Chatterbox

VibeVoice vs Chatterbox: Open-Source Text-to-Speech Models Compared

VibeVoice and Chatterbox are both open-source text-to-speech models, but they target very different use cases. VibeVoice from Microsoft generates 90-minute multi-speaker conversations for podcast-style audio, while Chatterbox focuses on single-speaker voice cloning with emotional control. Understanding their strengths helps developers choose the right TTS model for their application.

VibeVoiceChatterbox

Community experience

Sources & verification

Sources checked
Content verified

Verification dates are editorial checks. Routine CMS saves and automatic updatedAt timestamps do not advance them.

FAQ

What is VibeVoice?

VibeVoice is Microsoft's open-source voice AI family with both TTS and speech recognition models. The TTS model generates up to 90 minutes of expressive multi-speaker audio with 4 distinct voices. VibeVoice-ASR transcribes 60-minute recordings in a single pass with speaker identification and timestamps. Built on continuous speech tokenizers at 7.5 Hz and next-token diffusion, it compresses audio 80x more efficiently than Encodec while preserving fidelity.

Is VibeVoice free?

Yes — VibeVoice is open source and free to use. 100% free and open-source under the MIT license ($0 software licensing fee, Microsoft Research). VibeVoice provides unified zero-shot voice cloning, real-time streaming TTS, and long-form multi-speaker dialogue synthesis (up to 90 minutes) using next-token diffusion and 7.5 Hz speech tokenizers. Supports PyTorch and ONNX Runtime deployment across local GPUs and CPUs with zero software or subscription costs; users pay only for their underlying compute hardware.

Is VibeVoice open source?

Yes — VibeVoice is open source.

Is VibeVoice still maintained?

Yes — VibeVoice is active. Its listing was last verified on September 6, 2026.

What are the best VibeVoice alternatives?

The first editor-selected VibeVoice alternatives are TimesFM, PrismML Bonsai, verl, and more.

How does VibeVoice score in our review?

The published editorial review lists VibeVoice at 87/100 overall across speed, privacy, and developer experience. Check the review's evidence status and test metadata for its verification level.