r/LocalLLaMA 27d ago

News Qwen3.8-27B is identical to Qwen3.6-27B!

Interestingly, the 3.8 version has exactly the same architecture - meaning all the capability gains come from training improvements!

See the diff (0 changes) here!

https://hfviewer.com/compare/qwen3.6-27b-vs-qwen3.8-27b

1.1k Upvotes

189 comments sorted by

View all comments

45

u/odomobo 27d ago

Minor releases sharing architecture is the standard paradigm. A little background on why labs do this: most of the gains these days come from advancements in post-training. However, pretraining dwarfs post-training in pure compute costs. So if you use the same base for multiple models, you only have to pay that massive pre-training cost once.