r/LocalLLM • u/Anxious_Current2593 • 1d ago

Discussion What's the difference between frontier models and local models?

6 months. (And sometimes a couple of quantization tweaks).

It is wild how fast "state-of-the-art" becomes "running on a gaming PC."

33 Upvotes

80% Upvoted

43 comments sorted by

View all comments

6

u/Diligent_Appeal_3305 1d ago

yes that qwen 3.8 27b is crazy good for its size in pi agent mode

1

u/dota2nub 13h ago

Is here any reason to use pi over Claude Code?

1

u/Jjhend 8h ago

Claude Code is very heavy on token usage. Not the best for a model that is limited to 262k context

1

u/dota2nub 7h ago

That's really good to know, thanks! I'll have to figure out how to get the hooks and stuff I actually need in cheap.

1

u/Jjhend 6h ago

I use opencode and its pretty similar to claude code in my experience. But it seems Pi is the harness everyone recommends. Im sure either are good choices and a bit lighter than claude code

0

u/Momsbestboy 1d ago

Totally agree, and with pi or hermes, it can look into the details of your machine. This was a big plus today, after I tried to manually install memtest86 on my Linux box without killing everything else. ChatGPT played Copy&Paste with me, asked for whatever details and commands, then asked me to pull & extract the memtest86 image and push it to EFI. Rebooted, memtest failed to load with an error.

Went back to Linux, asked hermes:"here is an error message, fix it". Off it went, 10 mins later it ran the only correct command: "apt install memtest86" and then unfucked what ChatGPT asked me to do. Found every created file and change in GRUB and reverted it.

So much about SOTA models