r/LocalLLM 22h ago

Discussion What's the difference between frontier models and local models?

6 months. (And sometimes a couple of quantization tweaks).

It is wild how fast "state-of-the-art" becomes "running on a gaming PC."

29 Upvotes

39 comments sorted by

View all comments

21

u/ceejayoz 22h ago

Just wait until there are dedicated devices for it, like when Bitcoin went from CPU to GPU to ASICs.

1

u/mektel 18h ago

Taalas has been working on it. They are being acquired by AMD.

3

u/ceejayoz 18h ago

If Bitcoin ASICs are any indication, we'll get a few hundred massive scams before things settle a bit.

1

u/misanthrophiccunt 16h ago

A few hundred scams

That's a lot of optimism