What is DiffusionGemma?

DiffusionGemma is a groundbreaking open model that delves into the phenomenon of text diffusion, offering an exceptionally quick approach to text generation. Licensed under Apache 2.0, this model features a staggering 26 billion parameters and utilizes a Mixture of Experts (MoE) architecture, pushing the boundaries beyond the conventional sequential token generation found in autoregressive models. Rather than generating tokens one by one, it is capable of producing complete blocks of text simultaneously, yielding generation speeds that can be up to four times quicker on GPUs. With foundations rooted in the parameter efficiency of the Gemma 4 family and insights from Gemini Diffusion research, DiffusionGemma boasts a distinctive diffusion head that significantly accelerates the generation process. Its design targets researchers and developers focused on optimizing local workflows that demand speed, such as in-line editing, rapid iterations, and complex narrative structures. By shifting the decoding bottleneck from memory bandwidth to computational capacity, the model can generate over 1,000 tokens per second on a single NVIDIA H100 and more than 700 tokens per second when utilizing an NVIDIA GeForce RTX 5090. This advancement not only enhances efficiency in text generation but also opens up new possibilities for various applications in the realm of natural language processing, paving the way for innovative developments in the field. Ultimately, the capabilities of DiffusionGemma could lead to transformative changes in how we approach text generation tasks.

Pricing

Price Starts At:
Free
Free Version:
Free Version available.

Screenshots and Video

DiffusionGemma Screenshot 1

Company Facts

Company Name:
Google
Date Founded:
1998
Company Location:
United States
Company Website:
blog.google/innovation-and-ai/technology/developers-tools/diffusion-gemma-faster-text-generation/

Product Details

Deployment
Windows
Mac
Linux
On-Prem
Training Options
Documentation Hub
Video Library
Support
Web-Based Support

Product Details

Target Company Sizes
Individual
1-10
11-50
51-200
201-500
501-1000
1001-5000
5001-10000
10001+
Target Organization Types
Mid Size Business
Small Business
Enterprise
Freelance
Nonprofit
Government
Startup
Supported Languages
English

DiffusionGemma Categories and Features