AI Gateway now supports streaming transcription
AI Gateway now supports streaming transcription, enabling real-time audio processing for applications like live captioning and voice agents.
AI Gateway now supports . Previously, transcription required a complete audio file and returned the full transcript in a single response. Now you can stream audio in as it's captured and get transcript updates back as the model produces them, keeping latency low for uses like live captioning and voice input.streaming transcription Streaming transcription is in beta and available through the 's function with any streaming-capable transcription model.AI SDKstreamTranscribe The example below streams raw PCM audio to and prints each transcript delta as it arrives. The result stream also carries partial and final transcripts:openai/gpt-realtime-whisper The same code works across providers: swap the model string to use or any other .
xai/grok-sttstreaming-capable transcription model Streaming transcription also makes it easy to add a voice mode to an agent. Stream the user's speech to a transcription model and pass the live text to your agent. The agent itself does not change: it still receives text, so this works with any text-based agent. For agents that speak back, pair it with speech generation, or use realtime voice for full two-way conversation. For more information on streaming…