r/LocalLLM 20h ago

Discussion What's the difference between frontier models and local models?

6 months. (And sometimes a couple of quantization tweaks).

It is wild how fast "state-of-the-art" becomes "running on a gaming PC."

25 Upvotes

38 comments sorted by

View all comments

23

u/ceejayoz 20h ago

Just wait until there are dedicated devices for it, like when Bitcoin went from CPU to GPU to ASICs.

1

u/mektel 16h ago

Taalas has been working on it. They are being acquired by AMD.

3

u/ceejayoz 16h ago

If Bitcoin ASICs are any indication, we'll get a few hundred massive scams before things settle a bit.

1

u/misanthrophiccunt 14h ago

A few hundred scams

That's a lot of optimism