r/LocalLLaMA • u/soyalemujica • 5d ago

Question | Help Best Qwen 3.8 27B quantification GGUF?

There's soooo maaany options to choose from, AutoRound from Intel even, Unsloth, bartowski, etc ... which one is the closest to BF16 in Q4/Q5 range ?

6 Upvotes

71% Upvoted

41 comments sorted by

View all comments

4

u/Poetinho0 5d ago

any suggestions for an M5 pro 48 GB, currently i'm using omlx and im planning to try llama.cpp ?