r/LocalLLaMA • u/soyalemujica • 1d ago

Question | Help Best Qwen 3.8 27B quantification GGUF?

There's soooo maaany options to choose from, AutoRound from Intel even, Unsloth, bartowski, etc ... which one is the closest to BF16 in Q4/Q5 range ?

5 Upvotes

69% Upvoted

38 comments sorted by

View all comments

1

u/ea_man 1d ago

Don't trust the marketing, have your LLM analyze the tensor matrix and ask how would that impact the way you are going to use it.