Nemotron 3 Nano Omni vs. Inkling

The NVIDIA Nemotron 3 Nano Omni is an innovative open foundation model that seamlessly combines multiple modes of perception and reasoning—such as text, images, audio, video, and documents—into one cohesive architecture. By removing the need for separate models dedicated to each modality, it significantly reduces inference delays, streamlines orchestration, and cuts costs while maintaining a unified cross-modal context. Designed specifically for agentic AI systems, this model acts as a perception and context sub-agent, enabling larger AI frameworks to recognize and interpret their environments in real-time through various formats, including screens, recordings, and both structured and unstructured data. Its advanced capabilities cater to complex multimodal reasoning tasks, which include document analysis, speech recognition, comprehensive audio-video assessments, and sophisticated computer workflows, thereby equipping agents to navigate intricate interfaces and varied environments effortlessly. With a hybrid architecture that is meticulously optimized for long context handling and high throughput, the Nemotron 3 Nano Omni excels at processing large inputs, including multi-page documents, rendering it an invaluable asset in AI development. Moreover, this model not only consolidates different modalities but also boosts the overall efficiency of intelligent systems, enabling them to effectively process and comprehend a wide array of data types, ultimately enhancing their operational capabilities. As the landscape of AI continues to evolve, such advancements are vital for fostering more intelligent interactions with technology.

Inkling is an open-weights multimodal AI model from Thinking Machines built to support customization, agentic workflows, coding, reasoning, vision, audio, and enterprise AI use cases. The model is a Mixture-of-Experts transformer with 975 billion total parameters, 41 billion active parameters, 256 routed experts per MoE layer, and six routed experts active per token. It supports context windows up to 1 million tokens and was pretrained on 45 trillion tokens across text, images, audio, and video. Inkling is designed as a broad foundation model rather than a narrowly optimized benchmark model, giving it balanced capabilities across reasoning, coding, factuality, instruction following, vision, audio, tool use, and safety. Its controllable thinking effort lets developers adjust how much computation and generated reasoning the model uses, helping teams balance quality, latency, and cost for different production needs. The model can run agentic coding tasks, use tools, create web apps, generate polished multi-page artifacts, reason over long contexts, and work through iterative refinement loops. For multimodal tasks, Inkling can process images, answer questions about visual content, transcribe and reason over audio, follow spoken instructions, and combine visual reasoning with code-based tools such as Python. Thinking Machines trained Inkling for calibration, instruction following, factual reliability, refusal behavior, and safety across multiple modalities, including evaluations for dangerous capabilities and human-AI threat vectors. Inkling is available on Tinker for fine-tuning, with 64K and 256K context options, an Inkling Playground for testing, cookbook recipes, and support for multimodal post-training workflows. Its full weights are available on Hugging Face, and deployment support is available through APIs and infrastructure partners such as TogetherAI, Fireworks, Modal, Databricks, Baseten, SGLang, vLLM, llama.cpp, and transformers.