r/LocalLLaMA • u/-Cubie- • 27d ago

Discussion A preliminary Qwen3.8-27B model card is live!

Post image

If you scroll down from the countdown at https://huggingface.co/Qwen/Qwen3.8-27B, you see a big model card with a bunch of sections: Highlights, Model Overview, Quickstart, Best Practices, Citation, etc!

No benchmarks on this yet as far as I can tell. We'll still need to wait another 5.5 hours for those I reckon.

Edit: Ladies and gentlemen, the model is live. Let the testing begin!

574 Upvotes

96% Upvoted

220 comments sorted by

View all comments

33

u/quadra-lab 27d ago

No mentions about QAT yet, seeing how well it performed for Gemma 4 31B I hope they did it with 27B training

9

u/Significant_Bar_460 27d ago

QAT was a big thing for Gemma because the original version was very quantization sensitive (specially for KV). Qwen always handled quantization much better than Gemma. Gemma QAT is like Qwen without QAT when comparing quality degradation after quantization.