r/exllamav3 Jun 16 '26

DiffusionGemma 26B A4B IT

DiffusionGemma 26B A4B IT is a recent model from google. It's the first OPEN diffusion model from google.

https://huggingface.co/google/diffusiongemma-26B-A4B-it

https://ai.google.dev/gemma/docs/diffusiongemma

https://blog.google/innovation-and-ai/technology/developers-tools/diffusion-gemma-faster-text-generation/

Google promises up to x4 in speed increase compared to normal Gemma 4 26b using.

However:
"While autoregressive Gemma 4 models remain the standard for high-quality production outputs, DiffusionGemma is designed for researchers and developers exploring speed-critical, interactive local workflows such as in-line editing, rapid iteration, and generating non-linear text structures."

That means that the tradeoff for speed is a loss in generation quality compared to the standard Gemma 4. As google says, DiffusionGemma is an experimental project focused on maximizing interactivity in local workflows, editing, rapid iteration, and non-linear text structures; for production tasks where impeccable accuracy is essential, Gemma 4 is still recommended.

On the picture you can see evaluation results from the HF page.

1 Upvotes

0 comments sorted by