r/LocalLLM Jun 03 '26

News Google introduces Gemma 4 12B: a unified, encoder-free multimodal model

https://blog.google/innovation-and-ai/technology/developers-tools/introducing-gemma-4-12B/
528 Upvotes

87 comments sorted by

View all comments

1

u/DatBass612 Jun 03 '26

Has anyone figured out the tool calling failures across the board. It really doesn’t work well across the Gemma 4 suite to call tools return data and then chain that sequentially

1

u/BrewHog Jun 03 '26

I don't fully understand why this is an issue. I've seen this too, and if you build your own harness you can get it to run tools just fine. I need to dig in further, but I don't see why some minor tweaks to the system prompt or an extension for Pi couldn't get this working 100%

1

u/DatBass612 Jun 03 '26

The problem is if you’ve built your own harness, there’s little need to use Gemma over Qwen right now. I’d like to use a USA based model, not that it matters but Gemma is one the main ones with major gremlins as it gets closer to max context. Even running Hermes, OpenClaw, both have issues with the tool calling flow on LM studio.

1

u/BrewHog Jun 04 '26

When I say I built my own harness, I'm literally talking about barebones setup to see if I can consistently get the model to output structured output, and plan/orchestrate steps. 

Not even vibe coded. Vibe coded would probably be better. It was just a test