Top Ai2 OLMoE Alternatives

Inkling is an open-weights multimodal AI model from Thinking Machines built to support customization, agentic workflows, coding, reasoning, vision, audio, and enterprise AI use cases. The model is a Mixture-of-Experts transformer with 975 billion total parameters, 41 billion active parameters, 256 routed experts per MoE layer, and six routed experts active per token. It supports context windows up to 1 million tokens and was pretrained on 45 trillion tokens across text, images, audio, and video. Inkling is designed as a broad foundation model rather than a narrowly optimized benchmark model, giving it balanced capabilities across reasoning, coding, factuality, instruction following, vision, audio, tool use, and safety. Its controllable thinking effort lets developers adjust how much computation and generated reasoning the model uses, helping teams balance quality, latency, and cost for different production needs. The model can run agentic coding tasks, use tools, create web apps, generate polished multi-page artifacts, reason over long contexts, and work through iterative refinement loops. For multimodal tasks, Inkling can process images, answer questions about visual content, transcribe and reason over audio, follow spoken instructions, and combine visual reasoning with code-based tools such as Python. Thinking Machines trained Inkling for calibration, instruction following, factual reliability, refusal behavior, and safety across multiple modalities, including evaluations for dangerous capabilities and human-AI threat vectors. Inkling is available on Tinker for fine-tuning, with 64K and 256K context options, an Inkling Playground for testing, cookbook recipes, and support for multimodal post-training workflows. Its full weights are available on Hugging Face, and deployment support is available through APIs and infrastructure partners such as TogetherAI, Fireworks, Modal, Databricks, Baseten, SGLang, vLLM, llama.cpp, and transformers.

GLM-5.2 is a powerful AI foundation model created to help developers and organizations handle advanced reasoning, coding, automation, and agent-based workflows. It is designed for complex system engineering tasks where an AI model needs to understand goals, follow multi-step instructions, and support technical execution. The model can be used for software development, code analysis, documentation support, research assistance, workflow automation, and intelligent application development. GLM-5.2 is especially valuable for long-context tasks because it can work with large amounts of information across extended prompts, files, or conversations. This makes it useful for reviewing large codebases, summarizing technical materials, generating structured outputs, and supporting detailed problem-solving. Its mixture-of-experts architecture helps deliver strong performance while using active model resources more efficiently. Development teams can use GLM-5.2 to improve productivity by reducing repetitive work and accelerating technical decision-making. Businesses can also use it to power AI assistants, internal automation tools, research platforms, and customer-facing intelligent systems. The model’s focus on agentic capabilities allows it to support workflows that require planning, reasoning, and task completion rather than basic response generation. GLM-5.2 can help organizations build smarter products while giving technical teams a more capable AI partner for demanding projects. It is a strong option for companies that want scalable AI support across engineering, research, automation, and digital transformation initiatives.

Qwen3.6 is a next-generation large language model developed by Alibaba, designed to deliver advanced reasoning, coding, and multimodal capabilities. It builds on the Qwen3.5 series with a strong emphasis on stability, efficiency, and real-world usability. The model supports multimodal inputs, enabling it to process text, images, and video for more complex analysis and decision-making. One of its key strengths is agentic AI, allowing it to perform multi-step tasks and operate more autonomously in workflows. Qwen3.6 is particularly optimized for coding, capable of handling complex engineering tasks at a repository level rather than just individual functions. It uses a mixture-of-experts architecture, with billions of parameters but only a subset activated during each inference, improving efficiency. The model is available in both open-weight and proprietary versions, giving developers flexibility in deployment and customization. It can be integrated into enterprise systems, APIs, and cloud environments for production use. Qwen3.6 also offers strong multimodal reasoning, enabling it to analyze documents, visuals, and structured data together. It is designed to support a wide range of applications, from software development to data analysis and automation. The model includes enhancements in performance, scalability, and usability compared to earlier versions. It reflects a broader shift toward agent-based AI systems that can execute tasks rather than just provide responses. Overall, Qwen3.6 represents a powerful and versatile AI model for modern enterprise and developer use cases.

DeepSeek-V4-Pro is a next-generation Mixture-of-Experts language model designed to deliver high performance across reasoning, coding, and long-context AI tasks. It features a massive architecture with 1.6 trillion total parameters and 49 billion activated parameters, enabling efficient computation while maintaining strong capabilities. The model supports an industry-leading context window of up to one million tokens, allowing it to process extremely large datasets, documents, and workflows. Its hybrid attention mechanism combines advanced techniques to optimize long-context efficiency and reduce computational requirements. DeepSeek-V4-Pro is trained on over 32 trillion tokens, enhancing its knowledge base and reasoning abilities. It incorporates advanced optimization methods to improve training stability and convergence. The model supports multiple reasoning modes, including fast responses and deep analytical thinking for complex problem solving. It performs strongly across benchmarks in coding, mathematics, and knowledge-based tasks. The architecture is designed for agentic workflows, enabling it to handle multi-step tasks and tool-based interactions. As an open-source model, it offers flexibility for customization and deployment across various environments. It also supports efficient memory usage and reduced inference costs compared to previous versions. The model’s capabilities make it suitable for both research and enterprise applications. Overall, DeepSeek-V4-Pro represents a significant advancement in scalable, high-performance AI with long-context intelligence.

K2 Horizon consists of a collection of six open models, namely the 375B-A23B, 36B-A4B, 32B, 7B, 3.7B, and 0.9B, each meticulously designed to excel in specific areas such as reasoning, mathematics, coding, agentic tasks, and overall functional capabilities. These models are built upon a cohesive architecture that incorporates a shared vocabulary, training methodologies, interfaces, evaluation frameworks, and deployment tools, which enable smooth transitions between different model sizes and effective management of varying workloads. Leading the lineup, the 375B-A23B model excels in complex reasoning, software development, research endeavors, and long-term agentic operations, whereas the 32B and 36B-A4B models emphasize strong local deployment capabilities. The 36B-A4B model is distinguished by its cutting-edge Mixture-of-Value Attention mechanism, which fuses sparse attention with Mixture-of-Experts layers, enabling it to utilize around 4 billion parameters per token, thereby closely rivaling the performance of the denser 32B model. This innovative architecture not only enhances versatility but also optimizes resource utilization across a diverse array of applications, making K2 Horizon a formidable presence in the field of model technology. Additionally, the collective strengths of these models allow for a comprehensive approach to tackling various challenges within their respective domains.

The MAI-1 Preview represents the first instance of Microsoft AI's foundation model, which has been meticulously crafted in-house and employs a mixture-of-experts architecture for improved efficiency. This model has been rigorously trained using approximately 15,000 NVIDIA H100 GPUs, enabling it to effectively understand user commands and generate pertinent text answers to frequently asked questions, serving as a prototype for the future capabilities of Copilot. Currently available for public evaluation on LMArena, the MAI-1 Preview offers an early insight into the platform’s trajectory, with intentions to roll out specific text-based applications in Copilot in the coming weeks to gather user feedback and refine its functionality. Microsoft underscores its dedication to weaving together its proprietary models, partnerships, and innovations from the open-source community to enhance user experiences through millions of unique interactions daily. By adopting this forward-thinking strategy, Microsoft showcases its commitment to the continuous improvement of its AI solutions and responsiveness to user needs. This proactive approach indicates that Microsoft is not only focused on current technologies but is also actively shaping the future landscape of AI development.

NVIDIA's Nemotron 3 is a suite of open large language models engineered to facilitate sophisticated reasoning, conversational AI, and autonomous AI agents. This lineup features three unique models, each designed to handle different scales of AI tasks while maintaining exceptional efficiency and accuracy. With a focus on "agentic AI," these models possess the capability to perform complex multi-step reasoning, collaborate seamlessly with tools, and integrate into multi-agent systems that serve various applications in automation, research, and enterprise environments. The foundational architecture employs a hybrid mixture-of-experts (MoE) strategy combined with transformer techniques, which allows for the activation of only selected parameter subsets tailored to individual tasks, thus optimizing performance and reducing computational costs. Tailored for excellence in reasoning, dialogue, and strategic planning, the Nemotron 3 models are fine-tuned for high throughput, making them ideal for widespread deployment in a range of applications. Furthermore, their cutting-edge architecture provides enhanced adaptability and scalability, ensuring they can effectively address the ever-changing landscape of contemporary AI challenges. This versatility positions Nemotron 3 as a crucial asset for organizations seeking to leverage advanced AI capabilities across diverse industries.

Hy4 preview is an innovative open-source Mixture-of-Experts model designed for numerous practical productivity applications, such as software development, office tasks, game creation, and scientific research. With an astounding 770 billion parameters and 49 billion activated per token, it features a remarkable 1 million-token context window, enabling it to adeptly handle extensive codebases, large sets of documents, and intricate multi-step operations. The model's architecture incorporates 78 layers that utilize Gated DeepSeek Sparse Attention and IndexCache for efficient sparse index reuse across layers, while identity Hyper-Connections are implemented to improve information flow within the model. Furthermore, a specialized Multi-Token Prediction layer supports speculative decoding, significantly boosting its performance. Hy4 preview is engineered to understand, strategize, troubleshoot, and verify complex engineering initiatives, all while delivering substantial advancements in the quality of front-end visuals and interaction design, ultimately serving as an essential tool for experts in a wide range of fields. This versatility makes it an outstanding choice for professionals seeking to enhance their productivity and efficiency in various projects.

Qwen3.8-2.4T-A95B emerges as the largest open model in the Qwen3.8 series, presenting advanced Qwen-Max-class capabilities in a format that is accessible to the public. Built on the robust foundation of Qwen3.5, this model offers marked improvements in performance across various domains, including coding, professional applications, research, and complex, extended agentic tasks, underscoring its ability to reliably execute intricate, multi-step workflows to completion. With its innovative mixture-of-experts architecture, it features a remarkable total of 2.4 trillion parameters, of which 95 billion are activated, utilizing 512 experts and allowing for simultaneous engagement of 10 routed experts alongside one shared expert. The model supports a native context length of 262,144 tokens, extendable to about 1.01 million tokens, thereby enabling considerable adaptability for diverse applications. Additionally, enhancements in agent execution, such as superior autonomous planning and improved responsiveness to environmental cues, enhance its overall efficiency. Its extensive compatibility with popular agent frameworks and development tools further aids in smooth integration into current systems, making it an appealing option for both developers and researchers. This versatility is particularly beneficial for those seeking to leverage advanced AI capabilities in their projects.

Qwen2 is a comprehensive array of advanced language models developed by the Qwen team at Alibaba Cloud. This collection includes various models that range from base to instruction-tuned versions, with parameters from 0.5 billion up to an impressive 72 billion, demonstrating both dense configurations and a Mixture-of-Experts architecture. The Qwen2 lineup is designed to surpass many earlier open-weight models, including its predecessor Qwen1.5, while also competing effectively against proprietary models across several benchmarks in domains such as language understanding, text generation, multilingual capabilities, programming, mathematics, and logical reasoning. Additionally, this cutting-edge series is set to significantly influence the artificial intelligence landscape, providing enhanced functionalities that cater to a wide array of applications. As such, the Qwen2 models not only represent a leap in technological advancement but also pave the way for future innovations in the field.

Sarvam-30B is a cutting-edge open-source language model designed as a robust platform for real-time conversational AI and intricate reasoning tasks, highlighting its effectiveness in multilingual environments and practical applications. With its impressive 30 billion parameters, the model leverages a Mixture-of-Experts (MoE) approach that activates only a fraction of its parameters for each interaction, enabling high efficiency and minimal latency, making it ideal for use in resource-constrained settings such as local devices and edge computing systems. It stands out in a variety of conversational scenarios, programming challenges, and logical reasoning tasks, delivering remarkable performance in more than 20 Indian languages, which highlights its versatility for multilingual use and voice recognition systems. Its dual-tier architecture positions it as a rapid and easily deployable "conversational workhorse," employing MoE strategies to reduce computational demands while maintaining top-notch performance. This innovative model not only improves the overall user experience but also expands its accessibility across a wide range of linguistic contexts, making it a valuable tool for developers and businesses aiming to engage diverse audiences effectively. Additionally, Sarvam-30B's design allows for continuous improvement and adaptation, ensuring that it remains relevant in the ever-evolving landscape of AI technology.

Kimi K2 showcases a groundbreaking series of open-source large language models that employ a mixture-of-experts (MoE) architecture, featuring an impressive total of 1 trillion parameters, with 32 billion parameters activated specifically for enhanced task performance. With the Muon optimizer at its core, this model has been trained on an extensive dataset exceeding 15.5 trillion tokens, and its capabilities are further amplified by MuonClip’s attention-logit clamping mechanism, enabling outstanding performance in advanced knowledge comprehension, logical reasoning, mathematics, programming, and various agentic tasks. Moonshot AI offers two unique configurations: Kimi-K2-Base, which is tailored for research-level fine-tuning, and Kimi-K2-Instruct, designed for immediate use in chat and tool interactions, thus allowing for both customized development and the smooth integration of agentic functionalities. Comparative evaluations reveal that Kimi K2 outperforms many leading open-source models and competes strongly against top proprietary systems, particularly in coding tasks and complex analysis. Additionally, it features an impressive context length of 128 K tokens, compatibility with tool-calling APIs, and support for widely used inference engines, making it a flexible solution for a range of applications. The innovative architecture and features of Kimi K2 not only position it as a notable achievement in artificial intelligence language processing but also as a transformative tool that could redefine the landscape of how language models are utilized in various domains. This advancement indicates a promising future for AI applications, suggesting that Kimi K2 may lead the way in setting new standards for performance and versatility in the industry.

Mistral 3 marks the latest development in the realm of open-weight AI models created by Mistral AI, featuring a wide array of options ranging from small, edge-optimized variants to a prominent large-scale multimodal model. Among this selection are three streamlined “Ministral 3” models, equipped with 3 billion, 8 billion, and 14 billion parameters, specifically designed for use on resource-constrained devices like laptops, drones, and various edge devices. In addition, the powerful “Mistral Large 3” serves as a sparse mixture-of-experts model, featuring an impressive total of 675 billion parameters, with 41 billion actively utilized. These models are adept at managing multimodal and multilingual tasks, excelling in areas such as text analysis and image understanding, and have demonstrated remarkable capabilities in responding to general inquiries, handling multilingual conversations, and processing multimodal inputs. Moreover, both the base and instruction-tuned variants are offered under the Apache 2.0 license, which promotes significant customization and integration into a range of enterprise and open-source projects. This approach not only enhances flexibility in usage but also sparks innovation and fosters collaboration among developers and organizations, ultimately driving advancements in AI technology.

Mistral Small 4 is a powerful open-source AI model introduced by Mistral AI to deliver advanced reasoning, multimodal understanding, and coding capabilities in a single system. The model represents the latest evolution in the Mistral Small family and consolidates multiple specialized AI technologies into one unified architecture. It integrates the reasoning capabilities of Magistral, the multimodal functionality of Pixtral, and the coding intelligence of Devstral. This design allows the model to handle tasks ranging from conversational assistance and research analysis to software development and visual data processing. Mistral Small 4 supports both text and image inputs, enabling applications such as document parsing, visual analysis, and interactive AI systems. Its mixture-of-experts architecture includes 128 experts with a small subset activated per token, allowing efficient resource usage while maintaining strong performance. The model also introduces a configurable reasoning effort parameter that allows developers to control the balance between speed and analytical depth. A large 256k context window enables it to process lengthy conversations, documents, and complex reasoning workflows. Performance optimizations significantly reduce latency and increase throughput compared with previous versions of the model. The system is designed for deployment across various environments, including cloud infrastructure, enterprise systems, and research environments. Developers can access the model through platforms such as Hugging Face, Transformers, and optimized inference frameworks. Released under the Apache 2.0 open-source license, Mistral Small 4 allows organizations to customize, fine-tune, and deploy AI solutions tailored to their specific needs. By combining reasoning, multimodal processing, and coding intelligence in one model, Mistral Small 4 simplifies AI integration for modern applications.

Xiaomi MiMo-V2.5 is a powerful open-source AI model designed to deliver advanced agentic capabilities alongside native multimodal understanding. It can process and reason across text, images, and audio within a unified system, enabling more complex and realistic interactions. The model is built using a sparse Mixture-of-Experts architecture with hundreds of billions of parameters, allowing it to scale efficiently while maintaining strong performance. It supports an extended context window of up to one million tokens, making it suitable for long-horizon tasks and detailed workflows. MiMo-V2.5 incorporates dedicated visual and audio encoders that enhance its ability to interpret and analyze multimodal inputs. It is capable of performing a wide range of tasks, including coding, reasoning, document analysis, and multimedia understanding. The model demonstrates strong benchmark performance across coding, reasoning, and multimodal evaluation tests. It is optimized for token efficiency, reducing computational cost while maintaining high-quality outputs. MiMo-V2.5 is designed to integrate with development tools and frameworks for real-world use cases. Xiaomi has released the model as open source, providing access to its weights, tokenizer, and architecture. This allows developers to customize and deploy the model for specific applications. Its ability to combine perception and reasoning makes it suitable for advanced AI workflows. By unifying multimodality and agentic intelligence, MiMo-V2.5 represents a significant advancement in open-source AI technology.

Xiaomi MiMo-V2.5-Pro is a cutting-edge open-source AI model built to handle complex reasoning, coding, and long-horizon tasks with high efficiency. It features a Mixture-of-Experts architecture with over one trillion total parameters and a large active parameter set for optimized performance. The model supports an extended context window of up to one million tokens, enabling it to process large amounts of information in a single workflow. It is designed for advanced agentic capabilities, allowing it to autonomously complete multi-step tasks over extended periods. MiMo-V2.5-Pro has demonstrated strong results in benchmarks related to software engineering, reasoning, and general AI performance. It is capable of building complete applications, optimizing engineering systems, and solving complex technical challenges. The model uses hybrid attention mechanisms to balance performance and efficiency across long contexts. It is also optimized for token efficiency, reducing resource usage while maintaining high-quality outputs. The model can integrate with development tools and frameworks to support real-world use cases. Xiaomi has open-sourced MiMo-V2.5-Pro, providing developers with access to its architecture, weights, and deployment tools. This allows organizations to customize and scale the model for their specific needs. Its ability to handle long workflows makes it suitable for tasks that require sustained reasoning and coordination. By combining scalability, efficiency, and advanced intelligence, MiMo-V2.5-Pro represents a significant advancement in open-source AI technology.

Sarvam-105B is recognized as the leading large language model in Sarvam's collection of open-source tools, crafted to deliver outstanding reasoning skills, multilingual understanding, and agent-driven functionality within a cohesive and scalable system. This Mixture-of-Experts (MoE) architecture features an astonishing 105 billion parameters, activating only a portion for each token processed, which ensures remarkable computational efficiency while handling complex tasks. It is specifically tailored for sophisticated reasoning, programming, mathematical problem-solving, and agentic functions, making it ideal for situations that require multi-step solutions and structured outputs instead of just basic dialogue. With an impressive capacity to process lengthy contexts of around 128K tokens, Sarvam-105B is adept at managing extensive texts, lengthy conversations, and intricate analytical tasks, maintaining coherence throughout these engagements. Furthermore, its versatile design allows for a wide array of applications, equipping users with powerful tools to address a multitude of intellectual challenges. This flexibility enhances its utility across various domains, further solidifying its status as a premier choice for advanced language model needs.

We are excited to introduce DBRX, a highly adaptable open LLM created by Databricks. This cutting-edge model sets a new standard for open LLMs by achieving remarkable performance across a wide range of established benchmarks. It offers both open-source developers and businesses the advanced features that were traditionally limited to proprietary model APIs; our assessments show that it surpasses GPT-3.5 and stands strong against Gemini 1.0 Pro. Furthermore, DBRX shines as a coding model, outperforming dedicated systems like CodeLLaMA-70B in various programming tasks, while also proving its capability as a general-purpose LLM. The exceptional quality of DBRX is further enhanced by notable improvements in training and inference efficiency. With its sophisticated fine-grained mixture-of-experts (MoE) architecture, DBRX pushes the efficiency of open models to unprecedented levels. In terms of inference speed, it can achieve performance that is twice as fast as LLaMA2-70B, and its total and active parameter counts are around 40% of those found in Grok-1, illustrating its compact structure without sacrificing performance. This unique blend of velocity and size positions DBRX as a transformative force in the realm of open AI models, promising to reshape expectations in the industry. As it continues to evolve, the potential applications for DBRX in various sectors are vast and exciting.

Command A+ stands out as Cohere's most sophisticated and swift language model thus far, designed as a powerful open-source resource for complex reasoning, engaging with various multimodal and multilingual tasks, and facilitating seamless private deployments. Its innovative sparse mixture-of-experts architecture features an impressive total of 218 billion parameters, with 25 billion actively in use, which optimizes high-performance workflows while reducing computational strain. By integrating capabilities from the entire Command series into one versatile solution, it adeptly handles text, images, reasoning, and tool usage, offering a vast 128K input context and a maximum output of 64K, all while supporting 48 different languages. The model has been carefully fine-tuned to boost reasoning skills, enhance agentic workflows, facilitate retrieval-augmented generation (RAG), and process complex multimodal documents, in addition to being compatible with vLLM and Transformers technology. In comparison to earlier models in the Command A series, this iteration significantly elevates enterprise performance across a wide range of fields, including multimodal understanding, data retrieval, extended tasks, advanced reasoning, programming, translation, and comprehensive document analysis. These advancements highlight the model's capacity to revolutionize how businesses tackle intricate language and data processing challenges, ultimately paving the way for more efficient solutions in various applications. As organizations increasingly rely on sophisticated AI tools, Command A+ represents a pivotal step forward in meeting those demands.

The Xiaomi MiMo API open platform acts as a developer-oriented interface that facilitates the integration and utilization of Xiaomi’s MiMo AI model family, which encompasses a variety of reasoning and language models such as MiMo-V2-Flash, thus enabling the development of applications and services through standardized APIs and cloud endpoints. This platform provides developers with the ability to seamlessly integrate AI-powered features like conversational agents, reasoning capabilities, code support, and enhanced search functionalities without needing to navigate the intricacies of managing model infrastructure. With RESTful API access that includes authentication, request signing, and structured responses, the platform allows software to submit user inquiries and obtain generated text or processed outcomes in a programmatic fashion. Additionally, it supports critical operations such as text generation, prompt management, and model inference, promoting smooth interactions with MiMo models. Moreover, the platform is equipped with extensive documentation and onboarding materials, helping teams to successfully integrate Xiaomi's latest open-source large language models that leverage cutting-edge Mixture-of-Experts (MoE) architectures to boost both performance and efficiency. By significantly reducing the entry barriers for developers aiming to exploit advanced AI functionalities, this open platform fosters innovation and creativity in various projects. Ultimately, it enables a broader range of developers to experiment with and implement AI-driven solutions in their work.

DeepSeek-V2 represents an advanced Mixture-of-Experts (MoE) language model created by DeepSeek-AI, recognized for its economical training and superior inference efficiency. This model features a staggering 236 billion parameters, engaging only 21 billion for each token, and can manage a context length stretching up to 128K tokens. It employs sophisticated architectures like Multi-head Latent Attention (MLA) to enhance inference by reducing the Key-Value (KV) cache and utilizes DeepSeekMoE for cost-effective training through sparse computations. When compared to its earlier version, DeepSeek 67B, this model exhibits substantial advancements, boasting a 42.5% decrease in training costs, a 93.3% reduction in KV cache size, and a remarkable 5.76-fold increase in generation speed. With training based on an extensive dataset of 8.1 trillion tokens, DeepSeek-V2 showcases outstanding proficiency in language understanding, programming, and reasoning tasks, thereby establishing itself as a premier open-source model in the current landscape. Its groundbreaking methodology not only enhances performance but also sets unprecedented standards in the realm of artificial intelligence, inspiring future innovations in the field.

GigaChat 3 Ultra is a breakthrough open-source LLM, offering 702 billion parameters built on an advanced MoE architecture that keeps computation efficient while delivering frontier-level performance. Its design activates only 36 billion parameters per step, combining high intelligence with practical deployment speeds, even for research and enterprise workloads. The model is trained entirely from scratch on a 14-trillion-token dataset spanning ten+ languages, expansive natural corpora, technical literature, competitive programming problems, academic datasets, and more than 5.5 trillion synthetic tokens engineered to enhance reasoning depth. This approach enables the model to achieve exceptional Russian-language capabilities, strong multilingual performance, and competitive global benchmark scores across math (GSM8K, MATH-500), programming (HumanEval+), and domain-specific evaluations. GigaChat 3 Ultra is optimized for compatibility with modern open-source tooling, enabling fine-tuning, inference, and integration using standard frameworks without complex custom builds. Advanced engineering techniques—including MTP, MLA, expert balancing, and large-scale distributed training—ensure stable learning at enormous scale while preserving fast inference. Beyond raw intelligence, the model includes upgraded alignment, improved conversational behavior, and a refined chat template using TypeScript-based function definitions for cleaner, more efficient interactions. It also features a built-in code interpreter, enhanced search subsystem with query reformulation, long-term user memory capabilities, and improved Russian-language stylistic accuracy down to punctuation and orthography. With leading performance on Russian benchmarks and strong showings across international tests, GigaChat 3 Ultra stands among the top five largest and most advanced open-source LLMs in the world. It represents a major engineering milestone for the open community.

The Mixtral 8x22B is our latest open model, setting a new standard in performance and efficiency within the realm of AI. By utilizing a sparse Mixture-of-Experts (SMoE) architecture, it activates only 39 billion parameters out of a total of 141 billion, leading to remarkable cost efficiency relative to its size. Moreover, it exhibits proficiency in several languages, such as English, French, Italian, German, and Spanish, alongside strong capabilities in mathematics and programming. Its native function calling feature, paired with the constrained output mode used on la Plateforme, greatly aids in application development and the large-scale modernization of technology infrastructures. The model boasts a context window of up to 64,000 tokens, allowing for precise information extraction from extensive documents. We are committed to designing models that optimize cost efficiency, thus providing exceptional performance-to-cost ratios compared to alternatives available in the market. As a continuation of our open model lineage, the Mixtral 8x22B's sparse activation patterns enhance its speed, making it faster than any similarly sized dense 70 billion model available. Additionally, its pioneering design and performance metrics make it an outstanding option for developers in search of high-performance AI solutions, further solidifying its position as a vital asset in the fast-evolving tech landscape.

Mistral Large 3 is a frontier-scale open AI model built on a sophisticated Mixture-of-Experts framework that unlocks 41B active parameters per step while maintaining a massive 675B total parameter capacity. This architecture lets the model deliver exceptional reasoning, multilingual mastery, and multimodal understanding at a fraction of the compute cost typically associated with models of this scale. Trained entirely from scratch on 3,000 NVIDIA H200 GPUs, it reaches competitive alignment performance with leading closed models, while achieving best-in-class results among permissively licensed alternatives. Mistral Large 3 includes base and instruction editions, supports images natively, and will soon introduce a reasoning-optimized version capable of even deeper thought chains. Its inference stack has been carefully co-designed with NVIDIA, enabling efficient low-precision execution, optimized MoE kernels, speculative decoding, and smooth long-context handling on Blackwell NVL72 systems and enterprise-grade clusters. Through collaborations with vLLM and Red Hat, developers gain an easy path to run Large 3 on single-node 8×A100 or 8×H100 environments with strong throughput and stability. The model is available across Mistral AI Studio, Amazon Bedrock, Azure Foundry, Hugging Face, Fireworks, OpenRouter, Modal, and more, ensuring turnkey access for development teams. Enterprises can go further with Mistral’s custom-training program, tailoring the model to proprietary data, regulatory workflows, or industry-specific tasks. From agentic applications to multilingual customer automation, creative workflows, edge deployment, and advanced tool-use systems, Mistral Large 3 adapts to a wide range of production scenarios. With this release, Mistral positions the 3-series as a complete family—spanning lightweight edge models to frontier-scale MoE intelligence—while remaining fully open, customizable, and performance-optimized across the stack.

Qwen3.8-Flash-Next is a pioneering open-weight multimodal Mixture-of-Experts architecture that offers an initial look at the design meant for its successor, Qwen4. This model has been expertly crafted to enhance various aspects such as attention mechanisms, residual pathways, embeddings, and optimization strategies, thereby increasing its overall functionality, enhancing computational efficiency, expanding its model capacity, and ensuring stability during training. Its unique hybrid structure combines Gated DeltaNet, which effectively condenses historical information, with Qwen Sparse Attention, facilitating the selection of meaningful context on a micro-block scale to reduce both attention and indexing expenses for lengthy sequences. The Gated Residual feature enhances the residual pathway by incorporating four streams, which helps in dynamically regulating the information flow across different layers. Moreover, the N-gram Embedding cleverly merges large-scale local-pattern memory with minimal computational overhead for each token, with the capability to transfer to host memory for added efficiency. The entire model is built around a main network comprising 125 billion parameters, supplemented by an additional 51 billion parameters specifically for N-gram embeddings, activating only 6 billion parameters for each token processed. This advanced framework underscores the continuous evolution in machine learning architectures, laying the groundwork for exciting future innovations, and it exemplifies the increasing sophistication and potential of multimodal models in various applications.

The Hy3 preview showcases Tencent Hy's latest and most sophisticated model within the Hy series, boasting an impressive 295 billion parameters arranged in a Mixture-of-Experts framework, with 21 billion parameters activated and a remarkable 3.8 billion allocated to the MTP layer, all while supporting a vast context window of up to 256,000 tokens. This innovative model marks a significant milestone as it utilizes Tencent Hy's newly enhanced infrastructure, which is specifically designed to improve its effectiveness in various practical applications such as complex reasoning, following directives, contextual learning, coding assignments, and overall inference skills. By blending swift and comprehensive cognitive processing, it can provide clear responses for basic questions while also allowing for detailed analysis of complex mathematical, programming, and logical problems. The model is engineered to demonstrate extensive capabilities in comprehending lengthy contexts, following instructions accurately, utilizing tools effectively, and executing agent workflows with precision, with evaluations performed not only against traditional benchmarks but also in realistic business and development scenarios. Additionally, its versatile design allows for effective adaptation across a wide array of situations, significantly expanding its potential for use in numerous applications, thus making it a vital tool in advancing the field.

Mistral AI has introduced two state-of-the-art models aimed at on-device computing and edge applications, collectively known as "les Ministraux": Ministral 3B and Ministral 8B. These advanced models set new benchmarks for knowledge, commonsense reasoning, function-calling, and efficiency in the sub-10B category. They offer remarkable flexibility for a variety of applications, from overseeing complex workflows to creating specialized task-oriented agents. With the capability to manage an impressive context length of up to 128k (currently supporting 32k on vLLM), Ministral 8B features a distinctive interleaved sliding-window attention mechanism that boosts both speed and memory efficiency during inference. Crafted for low-latency and compute-efficient applications, these models thrive in environments such as offline translation, internet-independent smart assistants, local data processing, and autonomous robotics. Additionally, when integrated with larger language models like Mistral Large, les Ministraux can serve as effective intermediaries, enhancing function-calling within detailed multi-step workflows. This synergy not only amplifies performance but also extends the potential of AI in edge computing, paving the way for innovative solutions in various fields. The introduction of these models marks a significant step forward in making advanced AI more accessible and efficient for real-world applications.

The Nemotron-3 Super stands out as a groundbreaking addition to NVIDIA's Nemotron 3 series of open models, designed specifically to support advanced agentic AI systems capable of reasoning, planning, and executing complex multi-step workflows in challenging settings. It incorporates a distinctive hybrid Mamba-Transformer Mixture-of-Experts architecture that combines the streamlined capabilities of Mamba layers with the contextual richness offered by transformer attention mechanisms, enabling it to effectively handle long sequences and complicated reasoning tasks with notable precision and efficiency. By activating only a selected subset of its parameters for each token, this design greatly improves computational efficiency while ensuring strong reasoning skills, making it particularly suitable for scalable inference in demanding situations. With an impressive configuration of around 120 billion parameters, of which approximately 12 billion are engaged during inference, the Nemotron-3 Super significantly enhances its capacity for managing multi-step reasoning and facilitating collaborative interactions among agents in broad contexts. This combination of features not only empowers it to address a wide array of challenges in the AI landscape but also positions it as a key player in the evolution of intelligent systems. Overall, the model exemplifies the potential for future innovations in AI technology.

Qwen3.5-Plus is a next-generation multimodal large language model built for scalable, enterprise-grade reasoning and agentic applications. It combines linear attention mechanisms with a sparse mixture-of-experts architecture to maximize inference efficiency while maintaining performance comparable to leading frontier models. The system supports text, image, and video inputs, generating high-quality text outputs suited for analysis, synthesis, and tool-augmented workflows. With a 1 million token context window and support for up to 64K output tokens, Qwen3.5-Plus enables deep, long-form reasoning across extensive documents and datasets. Its optional deep thinking mode allows for expanded chain-of-thought reasoning up to 80K tokens, making it ideal for complex analytical and multi-step problem-solving tasks. Developers can integrate structured outputs, function calling, prefix continuation, batch processing, and explicit caching to optimize both performance and cost efficiency. Built-in tool support through the Responses API includes web search, web extraction, image search, and code interpretation for dynamic multi-agent systems. High throughput limits and OpenAI-compatible API endpoints make deployment straightforward across global applications. With transparent token-based pricing and enterprise-level monitoring, Qwen3.5-Plus provides a powerful foundation for building intelligent assistants, multimodal analyzers, and scalable AI services.

DeepSeek R2 is the much-anticipated successor to the original DeepSeek R1, an AI reasoning model that garnered significant attention upon its launch in January 2025 by the Chinese startup DeepSeek. This latest iteration enhances the impressive groundwork laid by R1, which transformed the AI domain by delivering cost-effective capabilities that rival top-tier models such as OpenAI's o1. R2 is poised to deliver a notable enhancement in performance, promising rapid processing and reasoning skills that closely mimic human capabilities, especially in demanding fields like intricate coding and higher-level mathematics. By leveraging DeepSeek's advanced Mixture-of-Experts framework alongside refined training methodologies, R2 aims to exceed the benchmarks set by its predecessor while maintaining a low computational footprint. Furthermore, there is a strong expectation that this model will expand its reasoning prowess to include additional languages beyond English, potentially enhancing its applicability on a global scale. The excitement surrounding R2 underscores the continuous advancement of AI technology and its potential to impact a variety of sectors significantly, paving the way for innovations that could redefine how we interact with machines.