Qwen3.8-Flash-Next vs. Muse Spark 1.2

Qwen3.8-Flash-Next is a pioneering open-weight multimodal Mixture-of-Experts architecture that offers an initial look at the design meant for its successor, Qwen4. This model has been expertly crafted to enhance various aspects such as attention mechanisms, residual pathways, embeddings, and optimization strategies, thereby increasing its overall functionality, enhancing computational efficiency, expanding its model capacity, and ensuring stability during training. Its unique hybrid structure combines Gated DeltaNet, which effectively condenses historical information, with Qwen Sparse Attention, facilitating the selection of meaningful context on a micro-block scale to reduce both attention and indexing expenses for lengthy sequences. The Gated Residual feature enhances the residual pathway by incorporating four streams, which helps in dynamically regulating the information flow across different layers. Moreover, the N-gram Embedding cleverly merges large-scale local-pattern memory with minimal computational overhead for each token, with the capability to transfer to host memory for added efficiency. The entire model is built around a main network comprising 125 billion parameters, supplemented by an additional 51 billion parameters specifically for N-gram embeddings, activating only 6 billion parameters for each token processed. This advanced framework underscores the continuous evolution in machine learning architectures, laying the groundwork for exciting future innovations, and it exemplifies the increasing sophistication and potential of multimodal models in various applications.

Muse Spark 1.2 is a coding-focused AI model from Meta designed to support advanced software engineering tasks through Muse Code and the Meta Model API. The model builds on Muse Spark 1.1 with improvements in code generation, complex debugging, codebase understanding, and end-to-end developer workflows. Muse Spark 1.2 powers Muse Code, a terminal coding agent that can plan repository changes, write code, validate outputs, and work across large codebases. Muse Code uses persistent async background agents that stay active throughout a session to reduce redundant information gathering and support difficult multi-step work. The runtime uses a local event log where model calls, tool runs, approvals, and edits are appended, making sessions replay-exact and restart-safe. Muse Spark 1.2 was co-trained with Muse Code so the model can take advantage of its toolset, harness workflows, goals, compaction, and subagent architecture. Meta significantly scaled training compute on coding tasks and expanded training environment diversity to improve the model’s engineering capabilities. The model was also trained on long-horizon coding tasks, including whole-repository generation, large end-to-end projects, auto-research, and extended iterative work. Its training approach uses planning, goal conditioning, context compaction, rejection-sampled harness trajectories, and self-improvement data generated with Muse Spark 1.1. Meta also tested Muse Spark 1.2 on long-running GPU kernel optimization workflows where the model wrote, compiled, profiled, and improved Triton kernels over many tool calls. By combining coding-focused training, agentic runtime integration, persistent subagents, long-horizon reasoning, replay-safe execution, and API availability, Muse Spark 1.2 helps developers and AI agents complete complex software engineering work with less intervention.