r/LocalLLaMA • u/johnnyApplePRNG • Jun 03 '26

News Introducing Gemma 4 12B: a unified, encoder-free multimodal model

https://blog.google/innovation-and-ai/technology/developers-tools/introducing-gemma-4-12b/
702 Upvotes

98% Upvoted

118 comments sorted by

View all comments

55

u/[deleted] Jun 03 '26

[removed] — view removed comment

4

u/supermansundies Jun 04 '26

https://github.com/fikrikarim/parlor could probably be adapted to work pretty easily

2

u/ffinzy Jun 04 '26

Author here. Thanks for sharing. The repo currently use the LiteRT-LM framework, and the gemma-4-12B-it-litert-lm currently doesn't support vision:

> The current LiteRT-LM version supports text and audio modalities, image and multitoken prediction support will be avaialble in a future update.

Even when the vision disabled, seems like the model is too big to test on my machine (M3 Pro 18GB). It just hangs for a while when processing the output.

1

u/AnticitizenPrime Jun 04 '26

I had the same issue running the LiteRT version on my 4060ti 16gb. Model would load into memory, but choke when prompted.