Ratings and Reviews 0 Ratings

Total
ease
features
design
support

This software has no reviews. Be the first to write a review.

Write a Review

Ratings and Reviews 0 Ratings

Total
ease
features
design
support

This software has no reviews. Be the first to write a review.

Write a Review

Alternatives to Consider

  • LM-Kit.NET Reviews & Ratings
    28 Ratings
    Company Website
  • Google AI Studio Reviews & Ratings
    12 Ratings
    Company Website
  • Gemini Enterprise Agent Platform Reviews & Ratings
    961 Ratings
    Company Website
  • Unimus Reviews & Ratings
    31 Ratings
    Company Website
  • RunPod Reviews & Ratings
    206 Ratings
    Company Website
  • 3Q Reviews & Ratings
    14 Ratings
    Company Website
  • Oxylabs Reviews & Ratings
    1,151 Ratings
    Company Website
  • Google Cloud BigQuery Reviews & Ratings
    2,018 Ratings
    Company Website
  • Datasite Diligence Virtual Data Room Reviews & Ratings
    635 Ratings
    Company Website
  • PackageX OCR Scanning Reviews & Ratings
    46 Ratings
    Company Website

What is GPT-NeoX?

This repository presents an implementation of model parallel autoregressive transformers that harness the power of GPUs through the DeepSpeed library. It acts as a documentation of EleutherAI's framework aimed at training large language models specifically for GPU environments. At this time, it expands upon NVIDIA's Megatron Language Model, integrating sophisticated techniques from DeepSpeed along with various innovative optimizations. Our objective is to establish a centralized resource for compiling methodologies essential for training large-scale autoregressive language models, which will ultimately stimulate faster research and development in the expansive domain of large-scale training. By making these resources available, we aspire to make a substantial impact on the advancement of language model research while encouraging collaboration among researchers in the field.

What is Dolly?

Dolly stands out as a cost-effective large language model, showcasing an impressive capability for following instructions akin to that of ChatGPT. The research conducted by the Alpaca team has shown that advanced models can be trained to significantly improve their adherence to high-quality instructions; however, our research suggests that even earlier open-source models can exhibit exceptional behavior when fine-tuned with a limited amount of instructional data. By making slight modifications to an existing open-source model containing 6 billion parameters from EleutherAI, Dolly has been enhanced to better follow instructions, demonstrating skills such as brainstorming and text generation that were previously lacking. This strategy not only emphasizes the untapped potential of older models but also invites exploration into new and innovative uses of established technologies. Furthermore, the success of Dolly encourages further investigation into how legacy models can be repurposed to meet contemporary needs effectively.

Media

Media

Integrations Supported

Alpaca
Automi
Forefront
Gopher
ZBrain

Integrations Supported

Alpaca
Automi
Forefront
Gopher
ZBrain

API Availability

Has API

API Availability

Has API

Pricing Information

Free
Free Trial Offered?
Free Version

Pricing Information

Free
Free Trial Offered?
Free Version

Supported Platforms

SaaS
Android
iPhone
iPad
Windows
Mac
On-Prem
Chromebook
Linux

Supported Platforms

SaaS
Android
iPhone
iPad
Windows
Mac
On-Prem
Chromebook
Linux

Customer Service / Support

Standard Support
24 Hour Support
Web-Based Support

Customer Service / Support

Standard Support
24 Hour Support
Web-Based Support

Training Options

Documentation Hub
Webinars
Online Training
On-Site Training

Training Options

Documentation Hub
Webinars
Online Training
On-Site Training

Company Facts

Organization Name

EleutherAI

Date Founded

2020

Company Website

github.com/EleutherAI/gpt-neox

Company Facts

Organization Name

Databricks

Date Founded

2013

Company Location

United States

Company Website

databricks.com

Categories and Features

Categories and Features

Popular Alternatives

GPT-J Reviews & Ratings

GPT-J

EleutherAI

Popular Alternatives

OPT Reviews & Ratings

OPT

Meta
mT5 Reviews & Ratings

mT5

Google
Pythia Reviews & Ratings

Pythia

EleutherAI
PaLM Reviews & Ratings

PaLM

Google
DeepSpeed Reviews & Ratings

DeepSpeed

Microsoft
GPT-J Reviews & Ratings

GPT-J

EleutherAI
Alpaca Reviews & Ratings

Alpaca

Stanford Center for Research on Foundation Models (CRFM)