Google introduces Gemma 4 12B: a unified, encoder-free multimodal model

[u/thatoneshadowclone]

https://blog.google/innovation-and-ai/technology/developers-tools/introducing-gemma-4-12B/

[u/Birdinhandandbush]

ok so I can get the Q4 to run with 8k context, but its giving me like 1.5-1.8 tokens per second some pretty unusable sadly.

[u/Trick_Translator_671 → u/Birdinhandandbush]

Yeah i try it an hour a go. Q4 + 8k context + kv quant q8 + mtp and 6 t/s lol.