-
1
Grok Voice 3.0
SpaceXSI
Revolutionize voice interactions with real-time speech capabilities.
Grok Voice 3.0 represents a sophisticated speech-to-speech model accessible through the Grok Voice Agent API, tailored for developers focused on building real-time voice applications. This innovative model handles both audio and text inputs, generating spoken audio or text outputs via a WebSocket connection and supporting functionalities like conversational turn-taking, interruptions, and execution of various functions. Developers can seamlessly connect this model to custom functions and a range of server-side tools, which might encompass web searches, X searches, collections, or external MCP servers. The API is specifically designed for interactive voice agents, aiming to improve customer support and service call interactions, while also being utilized for voice communication in Tesla vehicles and Grok Bot. Billing is structured on a consumption basis, charging for audio per minute and treating text input events as separate charges. Furthermore, the API documentation offers detailed setup guidance and examples for using Python and JavaScript, thereby facilitating straightforward integration of the capabilities into developers' applications. This extensive array of features not only enhances the user experience but also enables developers to craft more interactive and effective voice communication systems, ultimately leading to increased customer satisfaction.
-
2
Grok Voice Think Fast 2.0 is xAI’s flagship voice model for creating real-time AI assistants, phone agents, and interactive voice applications. The model is designed to stream both audio and text bidirectionally over WebSocket for low-friction conversational experiences. Developers can use it to build systems that listen, respond, reason, and adapt during live voice interactions. Grok Voice Think Fast 2.0 supports configurable system instructions so teams can shape behavior, persona, policies, and task handling. It also allows developers to choose high reasoning effort or no reasoning effort depending on latency, cost, and complexity requirements. The model supports built-in voices, custom voices, playback speed controls, automatic server-side voice activity detection, silence duration settings, idle re-engagement, and session resumption after temporary disconnects. It accepts PCM, G.711 μ-law, G.711 A-law, and Opus audio through JSON frames or raw binary frames. Configurable PCM sample rates let teams support use cases ranging from telephone-quality voice calls to 48 kHz audio workflows. Grok Voice Think Fast 2.0 supports more than 20 languages with native-quality accents, automatic language detection, natural responses in the speaker’s language, and seamless code-switching. Developers can provide language hints and up to 100 key terms to improve recognition of regional speech, names, products, codes, addresses, and specialized terminology. By combining real-time audio streaming, configurable reasoning, voice controls, multilingual support, transcription tuning, and pronunciation replacement, Grok Voice Think Fast 2.0 gives developers a flexible foundation for advanced voice AI products.
-
3
Grok Voice Think Fast 1.0 is xAI’s flagship voice agent model, designed to deliver high-performance conversational AI for complex, real-world applications. It is built to handle multi-step workflows across customer support, sales, and enterprise operations with speed and precision. The model combines fast response times with advanced reasoning capabilities, allowing it to process and resolve user requests in real time without added latency. It is particularly effective in handling ambiguous inputs, interruptions, and diverse accents, making it suitable for challenging environments like telephony and live customer interactions. Grok Voice can accurately capture and validate structured data such as names, addresses, and account details, even when spoken quickly or with corrections. It supports more than 25 languages, enabling seamless global communication. The model integrates with multiple tools, allowing it to execute complex workflows involving data retrieval, updates, and decision-making. It has been benchmarked as a top-performing voice agent in real-world conditions, including noisy environments and multi-turn conversations. Its ability to reason through edge cases improves accuracy and reduces the likelihood of incorrect responses. The model is already being used in production scenarios such as Starlink’s customer support and sales operations. It can autonomously resolve a high percentage of customer inquiries and assist with transactions in real time. Its efficiency and scalability make it ideal for high-volume enterprise use. Overall, Grok Voice Think Fast 1.0 represents a major advancement in voice AI, enabling businesses to deliver intelligent, responsive, and reliable voice interactions at scale.