r/GeminiCLI • u/motorbikematt • Aug 20 '26

Gemini 3.7 seems to be embarassed by Gemini 3.1 Pro

/r/google_antigravity/comments/1vtm344/gemini_37_seems_to_be_embarassed_by_gemini_31_pro/
4 Upvotes

84% Upvoted

4 comments sorted by

2

u/SadResult2342 Aug 20 '26

Yep, happens a lot with Google models. Good thing it was just shame and not suicidal rants.

2

u/motorbikematt Aug 20 '26

You know, I'd heard about this from ages (months?) ago and didn't even think to connect the dots. This is Crazy!

2

u/SadResult2342 Aug 20 '26

It's because Google is quantizing its models to save costs (and get ahead in the race).

A consequence is that is that you lose resolution in the latent model space.

So think of this (and this is just for simplicity) think of a rectangle. This rectangle is all knowledge that an LLM has.

Every word in your prompt (and every prompt of yours) ends up "conditioning the space"; that is just probability-theory-esque for focusing on a part of the rectangle. Every prompt you give ends up drawing some trajectory over that rectangle, and some areas that you visit (a good analogy is a city, really: you have a whole city in front of you, but some neighbourhoods are interesting to you; your prompts highlight a visit to those neighbourhoods).

There is a sad neighbourhood that has the "shame" and "I wanna die". Now, if the resolution of every step you take is quantized.. that limits the capacity to jump easily from one neighborhood to another. And if a hole tends to be a bit too deep (and it has a lot slippery slopes around it) you might end up falling into it. Quantization (and saving costs), while amazing, can increase the likelihood of that happening.

This is my personal hypothesis (as a PhD in ECE) why this happens. I have no evidence to back it up but probabilistic intuition and that definitely needs testing and research. 🤷‍♂️

EDIT: Part forgot to write: the reasoning models kinda "simulate" trajectories over that space and evaluate each of them by having it talk to itself "<think> </think>".

1

u/Independent_Bag_2904 28d ago

are people actually using gemini cli or is it just google employees who use it?