Koa vs. Lumen Outpost

Salesforce Koa marks the company's first CRM reasoning model specifically designed for Agentforce, leveraging the power of NVIDIA Nemotron and drawing from an extensive 27 years of Salesforce CRM knowledge to adeptly handle complex, multi-step tasks in enterprise settings. This model is built upon nearly three decades of CRM application expertise and has been further refined through training on a specialized synthetic dataset that mirrors genuine business workflows, processes, and compliance requirements. The training scenarios are meticulously designed to emulate the reasoning, tool usage, and decision-making strategies that Agentforce agents utilize throughout the customer journey, including critical activities such as lead generation, opportunity qualification, and service case resolution across more than 14 distinct industries. Koa is purpose-built for precise CRM functionalities and is evaluated using the Salesforce CRM Bench, which includes authentic workflows like opportunity updates, case routing, and follow-up scheduling. Salesforce reports that Koa delivers an 11% improvement in accuracy for choosing the right actions and recalls customer context with a reliability that is 2.1 times superior to earlier models. This groundbreaking methodology not only boosts operational efficiency but also greatly enhances the overall customer experience, making it a vital tool for businesses aiming to optimize their customer interactions. By integrating advanced reasoning capabilities, Koa positions itself as a transformative solution in the realm of customer relationship management.

Lumen Outpost exemplifies the advanced coding model developed by Cosine, which has been meticulously assessed in comparison to its foundational model, Kimi K2.6, as well as other versions like GPT-5.5, GPT-5.4, and Gemini 3.1 Pro, with a particular emphasis on complex, long-term coding tasks across a range of 13 programming languages. This model is crafted not only to achieve high accuracy in coding but also to improve essential behavioral metrics that are crucial in engineering practices, including agent initiative, strategic foresight, scope management, consistency in actions, concise updates, and robust communication. Cosine's benchmarking revealed that the tailored post-training led to a significant enhancement in the performance of the base model, with Lumen Outpost outperforming Kimi K2.6 in various assessments such as Niche-Bench, Slop-Bench, and Vibe-Bench, as well as demonstrating greater cost-effectiveness in completing tasks successfully. In the Niche-Bench evaluation, which focuses on niche, legacy, and environmentally constrained programming languages, Lumen Outpost achieved a notable score of 53.9%, excelling or matching performance in nine of the thirteen languages tested, with particularly significant improvements observed in Fortran, ABAP, Java, and Rust. These outstanding results reflect a considerable advancement in the real-world applicability of coding models, highlighting the advantages of specialized training approaches and their impact on engineering efficiency. Such progress not only validates the effectiveness of these targeted training methodologies but also sets a new benchmark for future developments in coding technologies.