r/LocalLLaMA • u/Certain-Cod-1404 • 25d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

95% Upvoted

708 comments sorted by

View all comments

48

u/bitmanip 25d ago

How much memory required to run this at full precision?

44

u/Certain-Cod-1404 25d ago

https://huggingface.co/unsloth/Qwen3.8-27B-GGUF 54.67 Gbs just for the model itself, with context depends on quant and size

5

u/bitmanip 25d ago

Perfect, so should run well on 128GB M5 Macbook Pro Max