Voice agent frameworksChecked September 16, 2026

Open-source alternatives to ElevenLabs Agents

The open-source alternatives to ElevenLabs Agents are Pipecat, LiveKit Agents and TEN Framework. ElevenLabs sells the agent platform and the voices together; the open-source split is a framework that connects any speech-to-text, language and text-to-speech model, including ElevenLabs' own voices if you keep them. Pipecat (BSD-2-Clause) lists the most providers and includes local options like Whisper, Kokoro and Piper. LiveKit Agents (Apache-2.0) runs the whole stack on your servers. TEN is source available under Agora's conditions. A team switches when it wants to swap any model in the pipeline without changing platform.

ElevenLabs Agents, in the vendor's own words: "conversational agents that feel human" which you "configure, deploy and monitor" across voice, chat and email, by its own description. elevenlabs.io.

ProjectOpennessLicenceRuns asPlatformsSelf-hostHosted optionLast releaseStars
PipecatOSIBSD-2-Clausepip, CLIPython 3.11 or later server; client SDKs for JavaScript, React, React Native, Swift, Kotlin, C++ and ESP32YesYesSep 12, 202615,594
LiveKit AgentsOSIApache-2.0pip (Python), npm (the separate AgentsJS repository)Python server; client SDKs for browsers, Swift, Android, Flutter, React Native, Rust, Node.js, Unity, ESP32 and C++YesYesSep 15, 202614,230
TEN FrameworkSource availableSee LICENSEDocker Compose, GitHub CodespacesDocker; Python, Go and Node.js inside; an ESP32-S3 board exampleYesNoJul 31, 202611,130

Licence, release and star figures read from GitHub on September 16, 2026. Openness labels: The code, and the weights where the project is a model, carry a licence on the OSI approved list. The code is public, and the licence limits what you may do with it. Read the LICENSE file before commercial use. The model weights can be downloaded and run. The training data or code is closed, or the weights carry a restriction the code does not.

A Python framework under BSD-2-Clause, maintained by Daily, for real-time voice and multimodal agents, with the widest provider list on this site and telephony serialisers for Twilio, Telnyx, Plivo, Vonage, Exotel and Genesys.

pip, CLI · Python 3.11 or later server; client SDKs for JavaScript, React, React Native, Swift, Kotlin, C++ and ESP32 · Runs on your own machines · Hosted version available from the maintainers

An Apache-2.0 framework for real-time voice agents that connects any speech, language and voice provider, with semantic turn detection, native MCP tool support, a test framework, and an open-source media and SIP stack it can run on entirely.

pip (Python), npm (the separate AgentsJS repository) · Python server; client SDKs for browsers, Swift, Android, Flutter, React Native, Rust, Node.js, Unity, ESP32 and C++ · Runs on your own machines · Hosted version available from the maintainers

TEN Framework

Source available

A real-time conversational AI framework from Agora with a visual designer, a SIP extension and turn detection, released under Apache-2.0 plus conditions that forbid competing deployments, which makes it source available rather than open source.

Docker Compose, GitHub Codespaces · Docker; Python, Go and Node.js inside; an ESP32-S3 board example · Runs on your own machines

Where ElevenLabs Agents is still the better choice

  • You want the agent, the voices and the monitoring in one configured product, with no framework to learn.
  • You want chat and email handled by the same agent. The three frameworks here are built around real-time voice; text channels are yours to add.
  • You want to keep ElevenLabs' voices without operating anything. Pipecat and LiveKit Agents can both call ElevenLabs for speech, but then you are operating a framework to reach the same voices.
  • You need many languages out of the box from one vendor's claim. Language coverage in the open frameworks is whatever the models you plug in support.

Questions people ask

What is the best open-source alternative to ElevenLabs Agents?

Pipecat (BSD-2-Clause) if you want the widest provider list, including ElevenLabs itself for voices and local models like Whisper, Ollama, Kokoro and Piper. LiveKit Agents (Apache-2.0) if you want the media server, the SIP service and the framework all open source on your own machines, with semantic turn detection. Both are Python; LiveKit also has a Node.js version.

Can I still use ElevenLabs voices inside an open-source agent?

Yes. Pipecat lists ElevenLabs among its text-to-speech providers, and TEN's quick start requires an ElevenLabs key for speech. LiveKit Agents describes a mix-and-match ecosystem of speech, language and voice providers. The framework is open; the voice can stay with the vendor you prefer.

Which one runs fully on my own servers?

LiveKit Agents states that the entire stack, including the LiveKit media server, can run on your own servers. Pipecat runs locally and offers eight transports, one of which is a local transport. TEN's documented quick start depends on Agora's real-time service; its README describes self-hosting the TEN backend but not replacing that service.

Do they support tools and MCP servers?

LiveKit Agents has native MCP support, described as integrating tools from MCP servers in one line. Pipecat lists function calling across its language model providers and a skills package for Claude Code. TEN describes extensions rather than MCP in its README.

Which speech models work locally?

Pipecat lists Whisper and Moonshine for speech to text, Ollama for the language model, and Kokoro, Piper and XTTS for text to speech, all of which run on your hardware. LiveKit Agents does not enumerate local models in its README. TEN's quick start uses hosted providers.

Sources

  1. ElevenLabs Agents page, the vendor's own description, read September 16, 2026
  2. Pipecat README (pipecat-ai/pipecat), read September 16, 2026
  3. LiveKit Agents README (livekit/agents), read September 16, 2026
  4. TEN Framework LICENSE, read September 16, 2026

Running one of these inside your own environment, with your own data and your own security rules, is the kind of work Reveneau does. Read how a forward deployed engagement works.