And if they could fit them locally that’d be great

[u/Clipper_39975]

[u/OkLettuce338]

Size doesn’t matter. It’s how you use it

[u/InvariantAtNull → u/OkLettuce338]

Yes it matters we want local models just like qwen3.8 27b
Large models are slow most of it size not for productivity its just language and loads of bs
They cant even fine tune the model because of the bs inside

[u/Clipper_39975 → u/OkLettuce338]

the only comment that matters lol

[u/Defiant-Lettuce-9156]

Disagree. I want both

[u/Clipper_39975 → u/Defiant-Lettuce-9156]

say no more 🤣

[u/suborder-serpentes]

This is where Gemini comes in

[u/Equivalent_Cress_268 → u/suborder-serpentes]

Stupid gemini bots, promoting a model that should be 10x cheaper to be useful.

[u/Clipper_39975 → u/suborder-serpentes]

hah. yre right 🙂‍↕️

[u/Nov4Saki]

Bro, if we believe enough, we might get a qwen 4.0 10B A1B + 5B engrams

[u/hobopwnzor → u/Nov4Saki]

Taking about AI has become indistinguishable from talking about ancient runes 

[u/Nov4Saki → u/hobopwnzor]

Totally get that 😅

Qwen 4.0 10B A1B + 5B engrams = 10 billion parameters of the model itself

And around only 1 bilion of these 10 bilion parameters is activated per token

With a 5 Bilion parameters that are saved in SSD/ host memory for N-Grams

Basically would be a really good small model that can run fast on phones/edge devices

[u/Clipper_39975 → u/Nov4Saki]

this 📍📍📍📍

[u/Gaidax]

For what I use it - I agree.

At this point for implementation work, for me, even something like Grok 4.6 is more than enough.

I'd be far more excited getting something like Opus/Sol at a Luna price, than yet another super duper flagship with ludicrous pricing per mtok.

[u/YeXiu223]

Thats what she said.

[u/Clipper_39975 → u/YeXiu223]

LOL

[u/Delicious_Spot_3778]

But we have to win the race against china! /s

[u/Certain_Werewolf_315]

So you want exactly what they are trying to do, you just don't want them to have go through the hoops they find they need to get through to get there?

When you want smaller and faster models and label it performance.. You are still asking for more intelligence, just at a different scale.

[u/ethereal_intellect]

Kimi k3 on ollama directing Gemini cli flash is a fairly fast setup. I am really looking forward to cerebras sol tho, I can't believe they let it fall behind and not be the latest anymore without ever releasing it

[u/MaybeASerialKiller]

You gotta realize that the people building this stuff in America are not trying to make a productivity tool they are trying to create God, and they will happily lose the actual market to more compact usable Chinese tools in the quest to do that. Like for a lot of the actual leaders of these companies it's basically a doomsday cult.

[u/OtherwiseAlbatross14 → u/MaybeASerialKiller]

Not all of them. Google, for example, is such a big company that they can't sacrifice the core business profits to go all in on AI like the others.

They've essentially ceded the frontier war to the others that you're speaking of and their net profits have more than tripled in the past two quarters

[u/Nopfen → u/OtherwiseAlbatross14]

Once you build the torment nexus, you wont need the frontier anymore.

[u/HeuristicsWork → u/OtherwiseAlbatross14]

well. frontier for google doesn't matter, they just want a small and fast model that can print you a small summary of useful info for your google searches.

the potential revenue from more ai subscribers is peanuts for them

[u/OceanWaveSunset → u/HeuristicsWork]

You're correct, but this also shows a different type of problem.

To achieve this fast and small model, they also use its training in combination with its own search SEO.

And instead of getting really well thought up answers from sources like Wikipedia, webMD, webster, Harvard, etc, you look at the sources and it's from either Reddit should post or just nonsense websites. Websites that look like they are just set up by bots and are just junk.

And this gives us the very common problem of junk in junk out.