Mathstral vs. DeepSeek-V3.2-Speciale

This year marks the 2311th anniversary of Archimedes, and in his honor, we are thrilled to unveil our first Mathstral model, a dedicated 7B architecture crafted specifically for mathematical reasoning and scientific inquiry. With a context window of 32k, this model is made available under the Apache 2.0 license. Our goal in sharing Mathstral with the scientific community is to facilitate the tackling of complex mathematical problems that require sophisticated, multi-step logical reasoning. The introduction of Mathstral aligns with our broader initiative to bolster academic efforts, developed alongside Project Numina. Much like Isaac Newton's contributions during his lifetime, Mathstral builds upon the groundwork established by Mistral 7B, with a keen focus on STEM fields. It showcases exceptional reasoning abilities within its domain, achieving impressive results across numerous industry-standard benchmarks. Specifically, it registers a score of 56.6% on the MATH benchmark and 63.47% on the MMLU benchmark, highlighting the performance enhancements in comparison to its predecessor, Mistral 7B, and underscoring the strides made in mathematical modeling. In addition to advancing individual research, this initiative seeks to inspire greater innovation and foster collaboration within the mathematical community as a whole.

DeepSeek-V3.2-Speciale represents the pinnacle of DeepSeek’s open-source reasoning models, engineered to deliver elite performance on complex analytical tasks. It introduces DeepSeek Sparse Attention (DSA), a highly efficient long-context attention design that reduces the computational burden while maintaining deep comprehension and logical consistency. The model is trained with an expanded reinforcement learning framework capable of leveraging massive post-training compute, enabling performance not only comparable to GPT-5 but demonstrably surpassing it in internal tests. Its reasoning capabilities have been validated through gold-winning solutions across major global competitions, including IMO 2025 and IOI 2025, with official submissions released for transparency and peer assessment. DeepSeek-V3.2-Speciale is intentionally designed without tool-calling features, focusing every parameter on pure reasoning, multi-step logic, and structured problem solving. It introduces a reworked chat template featuring explicit thought-delimited sections and a structured message format optimized for agentic-style reasoning workflows. The repository includes Python-based utilities for encoding and parsing messages, illustrating how to format prompts correctly for the model. Supporting multiple tensor types (BF16, FP32, FP8_E4M3), it is built for both research experimentation and high-performance local deployment. Users are encouraged to use temperature = 1.0 and top_p = 0.95 for best results when running the model locally. With its open MIT license and transparent development process, DeepSeek-V3.2-Speciale stands as a breakthrough option for anyone requiring industry-leading reasoning capacity in an open LLM.