SubQ 1.1 Small vs. Jamba

SubQ 1.1 Small is a long-context enterprise AI model developed by Subquadratic to address the limitations of traditional models that struggle with large artifacts. It is built for tasks where the full context matters, including analyzing entire codebases, reviewing lengthy contracts, comparing financial filings, and reasoning across document collections. The model uses Subquadratic Sparse Attention, which replaces dense attention with a learned sparse approach that scales more efficiently as context length grows. This allows SubQ 1.1 Small to process extremely large context windows while sharply reducing attention compute requirements. In benchmark testing, the model achieved near-perfect needle-in-a-haystack retrieval at 1M, 2M, 6M, and 12M tokens. It also scored 99.12% on the RULER 128K benchmark, demonstrating strength on tasks involving multi-hop reasoning, variable tracing, aggregation, and long-context understanding. Beyond retrieval, SubQ 1.1 Small maintains competitive performance in general knowledge, coding, and enterprise agent benchmarks such as GPQA Diamond, LiveCodeBench, and AutomationBench Finance. Its efficiency is a major advantage, requiring 64.5x less compute than dense attention and running 56x faster than FlashAttention-2 at 1M tokens on a single attention layer. The model was trained through staged context extension and continued pretraining on long-form artifacts such as books, documents, and repository-scale code. SubQ 1.1 Small is suited for financial analysis, legal work, software engineering, due diligence, long-horizon coding tasks, and enterprise workflows that depend on relationships spread across large bodies of information. It gives organizations a way to reason over complete artifacts more directly instead of relying only on retrieval pipelines, chunking strategies, and agentic scaffolding.

Jamba has emerged as the leading long context model, specifically crafted for builders and tailored to meet enterprise requirements. It outperforms other prominent models of similar scale with its exceptional latency and features a groundbreaking 256k context window, the largest available. Utilizing the innovative Mamba-Transformer MoE architecture, Jamba prioritizes cost efficiency and operational effectiveness. Among its out-of-the-box features are function calls, JSON mode output, document objects, and citation mode, all aimed at improving the overall user experience. The Jamba 1.5 models excel in performance across their expansive context window and consistently achieve top-tier scores on various quality assessment metrics. Enterprises can take advantage of secure deployment options customized to their specific needs, which facilitates seamless integration with existing systems. Furthermore, Jamba is readily accessible via our robust SaaS platform, and deployment options also include collaboration with strategic partners, providing users with added flexibility. For organizations that require specialized solutions, we offer dedicated management and ongoing pre-training services, ensuring that each client can make the most of Jamba’s capabilities. This level of adaptability and support positions Jamba as a premier choice for enterprises in search of innovative and effective solutions for their needs. Additionally, Jamba's commitment to continuous improvement ensures that it remains at the forefront of technological advancements, further solidifying its reputation as a trusted partner for businesses.