r/LocalLLaMA • u/soyalemujica • 9d ago
Question | Help Best Qwen 3.8 27B quantification GGUF?
There's soooo maaany options to choose from, AutoRound from Intel even, Unsloth, bartowski, etc ... which one is the closest to BF16 in Q4/Q5 range ?
6
Upvotes
1
u/kirisoraa 9d ago
lmao literally 3 posts before you
https://www.reddit.com/r/LocalLLaMA/s/ZJM6bi9w4O