ElevenLabs

FluffBuzz uses ElevenLabs for text-to-speech, batch speech-to-text with Scribe v2, and Voice Call streaming STT with Scribe v2 Realtime.

Capability	FluffBuzz surface	Default
Text-to-speech	`messages.tts` / `talk`	`eleven_multilingual_v2`
Batch speech-to-text	`tools.media.audio`	`scribe_v2`
Streaming speech-to-text	Voice Call `streaming.provider: "elevenlabs"`	`scribe_v2_realtime`

Authentication

Set ELEVENLABS_API_KEY in the environment. XI_API_KEY is also accepted for compatibility with existing ElevenLabs tooling.

export ELEVENLABS_API_KEY="..."

Text-to-speech

{
  messages: {
    tts: {
      providers: {
        elevenlabs: {
          apiKey: "${ELEVENLABS_API_KEY}",
          voiceId: "pMsXgVXv3BLzUgSXRplE",
          modelId: "eleven_multilingual_v2",
        },
      },
    },
  },
}

Speech-to-text

Use Scribe v2 for inbound audio attachments and short recorded voice segments:

{
  tools: {
    media: {
      audio: {
        enabled: true,
        models: [{ provider: "elevenlabs", model: "scribe_v2" }],
      },
    },
  },
}

FluffBuzz sends multipart audio to ElevenLabs /v1/speech-to-text with model_id: "scribe_v2". Language hints map to language_code when present.

Voice Call streaming STT

The bundled elevenlabs plugin registers Scribe v2 Realtime for Voice Call streaming transcription.

Setting	Config path	Default
API key	`plugins.entries.voice-call.config.streaming.providers.elevenlabs.apiKey`	Falls back to `ELEVENLABS_API_KEY` / `XI_API_KEY`
Model	`...elevenlabs.modelId`	`scribe_v2_realtime`
Audio format	`...elevenlabs.audioFormat`	`ulaw_8000`
Sample rate	`...elevenlabs.sampleRate`	`8000`
Commit strategy	`...elevenlabs.commitStrategy`	`vad`
Language	`...elevenlabs.languageCode`	(unset)

{
  plugins: {
    entries: {
      "voice-call": {
        config: {
          streaming: {
            enabled: true,
            provider: "elevenlabs",
            providers: {
              elevenlabs: {
                apiKey: "${ELEVENLABS_API_KEY}",
                audioFormat: "ulaw_8000",
                commitStrategy: "vad",
                languageCode: "en",
              },
            },
          },
        },
      },
    },
  },
}

Voice Call receives Twilio media as 8 kHz G.711 u-law. The ElevenLabs realtime provider defaults to ulaw_8000, so telephony frames can be forwarded without transcoding.

Overview

Concepts and configuration

Providers

Authentication

Text-to-speech

Speech-to-text

Voice Call streaming STT

​Authentication

​Text-to-speech

​Speech-to-text

​Voice Call streaming STT

Authentication

Text-to-speech

Speech-to-text

Voice Call streaming STT