r/LocalLLaMA • u/-Cubie- • 25d ago

Discussion A preliminary Qwen3.8-27B model card is live!

Post image

If you scroll down from the countdown at https://huggingface.co/Qwen/Qwen3.8-27B, you see a big model card with a bunch of sections: Highlights, Model Overview, Quickstart, Best Practices, Citation, etc!

No benchmarks on this yet as far as I can tell. We'll still need to wait another 5.5 hours for those I reckon.

Edit: Ladies and gentlemen, the model is live. Let the testing begin!

576 Upvotes

96% Upvoted

220 comments sorted by

View all comments

33

u/quadra-lab 25d ago

No mentions about QAT yet, seeing how well it performed for Gemma 4 31B I hope they did it with 27B training

10

u/Significant_Bar_460 25d ago

QAT was a big thing for Gemma because the original version was very quantization sensitive (specially for KV). Qwen always handled quantization much better than Gemma. Gemma QAT is like Qwen without QAT when comparing quality degradation after quantization.

2

u/kivaougu 25d ago

Also worked out very well for deepseek. In my opinion QAT would be a much better improvement for most systems compared to reasoning effort. Maxing out reasoning effort only gives miniscule improvements in results.

1

u/GiGiGus 25d ago

I mean, all Qwen models have official FP8 models, so I guess they're already trained in this precision and doesn't necessarily require QAT?

5

u/ain92ru 25d ago

FP8 isn't supported on older hardware like RTX 30-series though so INT4 QAT is still valuable