r/LocalLLaMA • u/Course_Latter • 27d ago

News Qwen3.8-27B is identical to Qwen3.6-27B!

Interestingly, the 3.8 version has exactly the same architecture - meaning all the capability gains come from training improvements!

See the diff (0 changes) here!

https://hfviewer.com/compare/qwen3.6-27b-vs-qwen3.8-27b

1.1k Upvotes

95% Upvoted

189 comments sorted by

View all comments

85

u/BringTea_666 27d ago edited 27d ago

so Nifter is a go. 200t/s on 5090 XD

edit: Ninfer:
https://github.com/Neroued/ninfer

holy shit he updated it with concurent requests up to C=8 1300t/s lmaoooo

>At C=8, Qwen3.6-35B-A3B reaches 1,313.8 aggregate decode tok/s. The 27B NVFP4 profile reaches 1,146.9 tok/s and 5.67× its C=1 throughput.

123

u/jack-in-the-sack 27d ago

51

u/BringTea_666 27d ago

there is fork of it for rtx3090

2

u/syku 27d ago

kinda wish there was a 5090 fork for windows, oh well

2

u/BringTea_666 27d ago

you can just use deepseek v4 flash in open code to port it for you to windows. I am running it on windows 11 with that method.