SubQ 1.1 Small vs. Kimi K3

SubQ 1.1 Small is a long-context enterprise AI model developed by Subquadratic to address the limitations of traditional models that struggle with large artifacts. It is built for tasks where the full context matters, including analyzing entire codebases, reviewing lengthy contracts, comparing financial filings, and reasoning across document collections. The model uses Subquadratic Sparse Attention, which replaces dense attention with a learned sparse approach that scales more efficiently as context length grows. This allows SubQ 1.1 Small to process extremely large context windows while sharply reducing attention compute requirements. In benchmark testing, the model achieved near-perfect needle-in-a-haystack retrieval at 1M, 2M, 6M, and 12M tokens. It also scored 99.12% on the RULER 128K benchmark, demonstrating strength on tasks involving multi-hop reasoning, variable tracing, aggregation, and long-context understanding. Beyond retrieval, SubQ 1.1 Small maintains competitive performance in general knowledge, coding, and enterprise agent benchmarks such as GPQA Diamond, LiveCodeBench, and AutomationBench Finance. Its efficiency is a major advantage, requiring 64.5x less compute than dense attention and running 56x faster than FlashAttention-2 at 1M tokens on a single attention layer. The model was trained through staged context extension and continued pretraining on long-form artifacts such as books, documents, and repository-scale code. SubQ 1.1 Small is suited for financial analysis, legal work, software engineering, due diligence, long-horizon coding tasks, and enterprise workflows that depend on relationships spread across large bodies of information. It gives organizations a way to reason over complete artifacts more directly instead of relying only on retrieval pipelines, chunking strategies, and agentic scaffolding.

Kimi K3 is Moonshot AI’s most advanced model, designed for high-end reasoning, software engineering, multimodal understanding, knowledge work, and agentic AI applications. The model has 2.8 trillion parameters and is built on Kimi Delta Attention, a hybrid linear attention mechanism created for long-context performance. It also uses Attention Residuals and supports a native context window of up to 1 million tokens. This makes Kimi K3 suitable for tasks involving large codebases, long research materials, enterprise documentation, multi-file analysis, legal documents, technical manuals, and complex workflows. Kimi K3 always has thinking mode enabled, with reasoning effort configured through the reasoning_effort field and maximum effort currently supported as the default. Developers can use the model through an OpenAI-compatible API, making it easier to integrate with existing SDKs, clients, and application infrastructure. The model supports streaming responses with separate reasoning and final-answer deltas, allowing applications to display reasoning progress and final content differently. Kimi K3 also supports strict structured output with JSON Schema, partial mode for continuing from a prefix, custom tool calling, required tool use, and dynamic tool loading through system messages. Its vision capabilities support image and video inputs through base64 or uploaded files, enabling analysis of visual content alongside text. Automatic context caching helps workflows that reuse long prefixes, such as large knowledge bases or persistent system context, without requiring developers to manage cache IDs manually. By combining frontier-scale parameters, long-context processing, visual input, structured outputs, tool orchestration, and developer-friendly API compatibility, Kimi K3 gives teams a strong foundation for advanced AI agents, coding assistants, research systems, enterprise automation, and multimodal applications.