gpt-oss-120b vs. Llama 2

gpt-oss-120b is a reasoning model focused solely on text, boasting 120 billion parameters, and is released under the Apache 2.0 license while adhering to OpenAI’s usage policies; it has been developed with contributions from the open-source community and is compatible with the Responses API. This model excels at executing instructions and utilizes various tools, including web searches and Python code execution, which allows for a customizable level of reasoning effort and results in detailed chain-of-thought outputs that can seamlessly fit into different workflows. Although it is constructed to comply with OpenAI's safety policies, its open-weight nature poses a risk, as adept users might modify it to bypass these protections, thereby prompting developers and organizations to implement additional safety measures akin to those of managed models. Assessments reveal that gpt-oss-120b falls short of high performance in specialized fields such as biology, chemistry, or cybersecurity, even after attempts at adversarial fine-tuning. Moreover, its introduction does not represent a substantial advancement in biological capabilities, indicating a cautious stance regarding its use. Consequently, it is advisable for users to stay alert to the potential risks associated with its open-weight attributes, and to consider the implications of its deployment in sensitive environments. As awareness of these factors grows, the community's approach to managing such technologies will evolve and adapt.

We are excited to unveil the latest version of our open-source large language model, which includes model weights and initial code for the pretrained and fine-tuned Llama language models, ranging from 7 billion to 70 billion parameters. The Llama 2 pretrained models have been crafted using a remarkable 2 trillion tokens and boast double the context length compared to the first iteration, Llama 1. Additionally, the fine-tuned models have been refined through the insights gained from over 1 million human annotations. Llama 2 showcases outstanding performance compared to various other open-source language models across a wide array of external benchmarks, particularly excelling in reasoning, coding abilities, proficiency, and knowledge assessments. For its training, Llama 2 leveraged publicly available online data sources, while the fine-tuned variant, Llama-2-chat, integrates publicly accessible instruction datasets alongside the extensive human annotations mentioned earlier. Our project is backed by a robust coalition of global stakeholders who are passionate about our open approach to AI, including companies that have offered valuable early feedback and are eager to collaborate with us on Llama 2. The enthusiasm surrounding Llama 2 not only highlights its advancements but also marks a significant transformation in the collaborative development and application of AI technologies. This collective effort underscores the potential for innovation that can emerge when the community comes together to share resources and insights.