ElevenLabs logo

Agent Orchestration

ElevenLabs

Deploy lifelike conversational voice agents on AgentDuet phone calls and WhatsApp using the ElevenLabs Python SDK.

Conversational AIElevenAgentsVoice synthesisTool callingWebSocket
Documentation
Where it fits

ElevenLabs in your voice stack.

  1. TelephonyPhone networkInbound call
  2. AgentDuetCall + audioAnswer, stream
  3. Speech-to-speechElevenLabsUnderstands, triggers tools, speaks
  4. ToolsActionsCRM, calendar, APIs
Overview

What it contributes to the stack.

ElevenLabs Conversational AI enables developers to deploy lifelike, low-latency conversational agents with customizable voices, knowledge bases, and tools.

With AgentDuet, phone calls and WhatsApp voice channels connect directly to ElevenLabs agents through a custom AsyncAudioInterface. AgentDuet delivers 16 kHz Linear PCM audio and clears playback on barge-in in sub-1ms.

For setup, credentials, and API details, use the Documentation link above.

Capabilities

The technical characteristics that matter when deciding whether this provider belongs in your application.

Full-duplex conversation

Streams caller audio to ElevenLabs and plays back synthesized voice concurrently.

Atomic barge-in

Clears AgentDuet pending playback buffer instantaneously when the caller interrupts.

Client-side tool calling

Executes custom Python functions during the live call using ElevenLabs ClientTools.

Dynamic variables and personalization

Passes caller metadata and dynamic context into the ElevenLabs agent session initiation.

Common use cases

Practical scenarios where the provider's role is clear and the surrounding systems remain under application control.

Automated phone support

Provide natural, lifelike voice assistance for incoming customer inquiries.

Appointment scheduling

Check calendar availability via client tools and confirm bookings over the phone.

Interactive voice response modernization

Replace rigid DTMF trees with conversational voice agents that understand natural speech.

Related integrations

Compare nearby choices.

These providers occupy a similar role in the stack. Compare their strengths, operating model, and surrounding services.

Pipecat

Official Python transport adapter (pipecat-agentduet) linking AgentDuet phone and WhatsApp calls into modular Pipecat pipelines with STT, LLM, TTS, and zero webhook hosting.

Voice frameworkPipecatPipelinesVADInterruption handlingZero-webhook
Explore integration

LangGraph

LangGraph for durable agent workflows: graphs, checkpoints, and policy-gated tools around live phone sessions.

Agent frameworkStatefulWorkflowsDurableGraph orchestration
Explore integration

Google ADK

Google's Agent Development Kit for live agent sessions with tools, specialists, and call-scoped state.

Agent frameworkGoogleMulti-agentToolsLive sessions
Explore integration
Browse every integration

Build a voice agent.

AgentDuet handles the phone and messaging boundary. Your model runs the conversation.

Explore the SDK