OpenAI provider
OpenAI providers cover Realtime (unified voice), Chat (pipeline LLM), and TTS (pipeline speech synthesis). OpenAI does not appear as a modular STT stage — use Azure or Inworld STT in pipeline mode, or OpenAI Realtime for unified speech.
Modes
| Flow mode | Provider types | Primary use |
|---|---|---|
| Realtime | openai_realtime | Single connection for STT + LLM + TTS |
| Pipeline | openai_chat, openai_tts | Text LLM and/or speech output with separate STT upstream |
Realtime (openai_realtime)
| Field | Required | Description |
|---|---|---|
| Model | No | gpt-realtime-* family (defaults to platform catalogue) |
| API key | Yes | Team variable, e.g. {{team.openaiDefaultKey}} |
| Voice | No | OpenAI voice id (alloy, shimmer, …) |
| Speed | No | Playback speed multiplier |
| Custom URL | No | Advanced → override WebSocket/API base (default: OpenAI production) |
| Transcription / VAD / noise reduction | No | Advanced → realtime input tuning |
Transcription model and VAD settings apply to the realtime session's inbound audio, not to a separate STT provider.
Chat / LLM (openai_chat)
| Field | Required | Description |
|---|---|---|
| Model | No | gpt-* chat models |
| API key | Yes | Team OpenAI key variable |
| Base URL | No | Advanced → custom API host (default https://api.openai.com/v1) |
| Temperature, max tokens, penalties, tool choice | No | Advanced LLM |
TTS (openai_tts)
| Field | Required | Description |
|---|---|---|
| Model | No | tts-* models |
| Voice | No | OpenAI TTS voice |
| API key | Yes | Team OpenAI key variable |
| Speed, instructions | No | Advanced TTS |
The schema supports baseUrl for OpenAI TTS; if you need a non-default host, set it in the source view under providers.tts.baseUrl.
Pipeline TTS participates in the modular speech playback queue. Realtime audio is streamed by the vendor connection instead.
Custom endpoints
See Custom STT/TTS endpoints — Realtime Custom URL and Chat Base URL accept hostnames and IPs for private gateways or compatible OpenAI-style APIs.
See also
- Providers overview
- Azure — common pipeline partner for STT
- Custom endpoints