SubQ 1.1 Small vs. LTM-1

SubQ 1.1 Small is a long-context enterprise AI model developed by Subquadratic to address the limitations of traditional models that struggle with large artifacts. It is built for tasks where the full context matters, including analyzing entire codebases, reviewing lengthy contracts, comparing financial filings, and reasoning across document collections. The model uses Subquadratic Sparse Attention, which replaces dense attention with a learned sparse approach that scales more efficiently as context length grows. This allows SubQ 1.1 Small to process extremely large context windows while sharply reducing attention compute requirements. In benchmark testing, the model achieved near-perfect needle-in-a-haystack retrieval at 1M, 2M, 6M, and 12M tokens. It also scored 99.12% on the RULER 128K benchmark, demonstrating strength on tasks involving multi-hop reasoning, variable tracing, aggregation, and long-context understanding. Beyond retrieval, SubQ 1.1 Small maintains competitive performance in general knowledge, coding, and enterprise agent benchmarks such as GPQA Diamond, LiveCodeBench, and AutomationBench Finance. Its efficiency is a major advantage, requiring 64.5x less compute than dense attention and running 56x faster than FlashAttention-2 at 1M tokens on a single attention layer. The model was trained through staged context extension and continued pretraining on long-form artifacts such as books, documents, and repository-scale code. SubQ 1.1 Small is suited for financial analysis, legal work, software engineering, due diligence, long-horizon coding tasks, and enterprise workflows that depend on relationships spread across large bodies of information. It gives organizations a way to reason over complete artifacts more directly instead of relying only on retrieval pipelines, chunking strategies, and agentic scaffolding.

Magic’s innovative LTM-1 technology enables context windows that are 50 times greater than the standard ones found in traditional transformer models. Consequently, Magic has created a Large Language Model (LLM) capable of efficiently handling extensive contextual information for generating recommendations. This breakthrough empowers our coding assistant to thoroughly examine and utilize your entire code repository. By drawing on a wealth of factual knowledge and its own previous interactions, larger context windows greatly improve the accuracy and cohesiveness of AI-generated responses. We are enthusiastic about the possibilities this research presents for enhancing user experiences in coding assistance tools, paving the way for smarter, more intuitive interactions. Ultimately, we believe these advancements will significantly transform how developers engage with their coding environments.