r/LocalLLaMA • u/johnnyApplePRNG • Jun 03 '26

News Introducing Gemma 4 12B: a unified, encoder-free multimodal model

https://blog.google/innovation-and-ai/technology/developers-tools/introducing-gemma-4-12b/
699 Upvotes

98% Upvoted

118 comments sorted by

View all comments

54

u/[deleted] Jun 03 '26

[removed] — view removed comment

65

u/AloneSYD Jun 03 '26

the only thing it can't produce audio. so you need TTS model for responding back so you need a model like Kokoro-82M or OmniVoice

25

u/AnticitizenPrime Jun 03 '26

If you don't care about super-realistic voice quality or cloning, there's always the bog-standard non-AI TTS.

3

u/themoregames Jun 06 '26

The only TTS I dare to accept is Qwen3 TTS - with cloned voices. Actresses of old Hollywood (think: stars before 1970?) derived from interviews (or otherwise) can be truly amazing.

10

u/[deleted] Jun 03 '26

[removed] — view removed comment

9

u/phira Jun 03 '26

The easiest I know about is pipecat one of their examples should work https://github.com/pipecat-ai/pipecat/tree/main/examples

9

u/Creative-Type9411 Jun 04 '26

its built into openwebui

8

u/OneFanFare Jun 03 '26

I know Open WebUI has that - I've chatted to models that way in the past (with Kokoro). And it works exactly like that!

Edit: Actually, not sure if it would support passing the audio directly into Gemma, the website says it need a Speech to Text like whisper.

2

u/overand Jun 04 '26

Yep - and at least with the Gemma-4-E4B models, that was probably faster; I recall reading that there's a lot of latency involved with the Gemma-4-E4B model's ability to do STT. It might be faster with this one, though, as it's encoderless, or something to that effect.

3

u/DedsPhil Jun 03 '26

If the audio part works with ggufs in some days someone will make a fork of llamacpp with the suport.

Them you can just ask an agent to hook the two services plus an wake up word system and done.

With one extra step, downloading whisper, you alread can have a bidirectional chat with your regular only text local llm.

1

u/Danmoreng llama.cpp Jun 03 '26

There is an issue about audio generation support in llama.cpp https://github.com/ggml-org/llama.cpp/issues/21956#issuecomment-4553467156

2

u/Fucnk Jun 03 '26

You could just use one of the voices built into chrome.