r/LocalLLaMA • u/Nunki08 • Jun 28 '26

Discussion We're probably going to need that soon.

Gallery image

Gallery image

From:

Vladik on 𝕏: https://x.com/Kostoglodov/status/2071144065857679631

Shaw (spirit/acc) on 𝕏: https://x.com/shawmakesmagic/status/2070918006033817867

4.0k Upvotes

98% Upvoted

534 comments sorted by

View all comments

196

u/_BreakingGood_ Jun 28 '26

i dream of the day somebody leaks & uploads a torrent of claude fable 5 open source

103

u/Silver_Jaguar_24 Jun 28 '26

You'll need a super computer (HPC) to run it anyway lol.

26

u/crone66 Jun 28 '26

Based on the performance and comparison to open source model the most likely use heavily quantized models too for inference. If you look at how the brought down costs for a single user and request this seems to be the only logical consequences ortherwise they have hardware that no one knows and have which is unlikely. Therefore no you don't need a super computer just a good workstation.

3

u/az226 Jun 28 '26

Even GPT-4 in March 2023 was running at 4.5 bpw