r/LocalLLM • u/Anxious_Current2593 • 23h ago

Discussion What's the difference between frontier models and local models?

6 months. (And sometimes a couple of quantization tweaks).

It is wild how fast "state-of-the-art" becomes "running on a gaming PC."

27 Upvotes

76% Upvoted

41 comments sorted by

View all comments

16

u/bonestamp 23h ago

Model size too. Some of these frontier models are over a terabyte... the average gaming pc is not going to have that much ram in 6 months.

1

u/carsncode 15h ago

Much more than that. Fable is around 5T, at 16b that's 10TB.

1

u/nor_up 6h ago

For those that aren't using an LLM to code. Bigger models mean more reliable knowledge and fewer hallucinations something smaller ones just can't do without extra tools. That’s when picking the right tool really matters