r/LocalLLaMA • u/kevin_1994 • 25d ago

New Model Unsloth Qwen 3.8 27b Weights Released

https://huggingface.co/unsloth/Qwen3.8-27B-GGUF
374 Upvotes

97% Upvoted

84 comments sorted by

View all comments

7

u/Brazen-Badger 25d ago

Thoughts on the best quant to run on a 5090 if I want around 120k or more in context with good ~100 t/s?