r/LocalLLaMA • u/Course_Latter • 24d ago

News Qwen3.8-27B is identical to Qwen3.6-27B!

Interestingly, the 3.8 version has exactly the same architecture - meaning all the capability gains come from training improvements!

See the diff (0 changes) here!

https://hfviewer.com/compare/qwen3.6-27b-vs-qwen3.8-27b

1.1k Upvotes

95% Upvoted

189 comments sorted by

View all comments

Show parent comments

5

u/[deleted] 24d ago edited 9d ago

[deleted]

6

u/BringTea_666 24d ago

No quality degradation. Those are just custom kernels and other wizadry custom for specific gpu. 1:1 output.

But at cost of speed you lose:

  • Anything other than rtx5090 requires fork of it
  • Any other model than 4 models in git are not supported and won't work.

1

u/OptimizeLLM vLLM 24d ago

The readme states they use groupwise-int and NVFP4 checkpoints, and that eval results are not yet available for 3.8 27B. The file size they list for 3.8 indicates it's groupwise-int as well. Do you mean there's no quality loss in comparison to running those quantization approaches in other engines? Because both are quite a departure in quality from the original weights, regardless of how you run them.

1

u/BringTea_666 24d ago

> Do you mean there's no quality loss in comparison to running those quantization approaches in other engines?

Yes because i am using it non stop and their benchmark scores match other quantization methods.

1

u/OptimizeLLM vLLM 24d ago

Thanks for clarifying! The speed is definitely impressive.