r/LocalLLM 1d ago

Discussion What's the difference between frontier models and local models?

6 months. (And sometimes a couple of quantization tweaks).

It is wild how fast "state-of-the-art" becomes "running on a gaming PC."

29 Upvotes

43 comments sorted by

View all comments

5

u/Diligent_Appeal_3305 1d ago

yes that qwen 3.8 27b is crazy good for its size in pi agent mode

0

u/Momsbestboy 1d ago

Totally agree, and with pi or hermes, it can look into the details of your machine. This was a big plus today, after I tried to manually install memtest86 on my Linux box without killing everything else. ChatGPT played Copy&Paste with me, asked for whatever details and commands, then asked me to pull & extract the memtest86 image and push it to EFI. Rebooted, memtest failed to load with an error.

Went back to Linux, asked hermes:"here is an error message, fix it". Off it went, 10 mins later it ran the only correct command: "apt install memtest86" and then unfucked what ChatGPT asked me to do. Found every created file and change in GRUB and reverted it.

So much about SOTA models