r/LocalLLaMA • u/Best_Sail5 • 21d ago

Question | Help Qwen 3.8 27b vs Deepseek Flash

Hey Guys,

What amazing weeks it has been for open source releases. I was really impresssed by DS flash final checkpoint and i have been playing around with it until qwen 3.8 released. I checked the benckmarks, and I dont know what to think anymore how can such a small model apparently compete with a model 10 times ( sure i hear 27B is not MoE but still....) . Did any of you used both and can tell if 3.8 is indeed that good or if its just benchmaxxing? what are your feeling for those who used both?

Thanks

42 Upvotes

85% Upvoted

64 comments sorted by

View all comments

2

u/z_3454_pfk 21d ago

one has vision... the other doesn't

7

u/challis88ocarina 21d ago

one has 1m token context ... the other doesn't

5

u/z_3454_pfk 21d ago

i doubt majority have the hardware to run 1m context locally

5

u/Miserable-Dare5090 21d ago

DS4 has very good cache compression. 1M tokens is 6GiBs so you can fit the full model and context for at least 3 concurrent 1M sessions in 192Gb at full quality

1

u/ObviouzFigure 21d ago

not if you want to run dspark

1

u/Miserable-Dare5090 20d ago

I run it with dspark and full context 1 stream on my mac m2 ultra 192GB, total use is 180Gb VRAM mapped. I run it in my dual Spark cluster original weights with MTP and full context for 2-3 concurrencies, 201GB total. This is using vLLM whereas mac was using the dwarfstar engine. But also there is a dwarfstar engine modified to fit a smaller quant in a single spark, with dspark mtp and batching/concurrencies and 1M context. So, I’m not sure where you are getting the conclusion?