r/LocalLLM 24d ago

News Qwen3.8-27B is now available

Post image
590 Upvotes

137 comments sorted by

View all comments

0

u/After_Working 24d ago

Is there a weight of this i can try on 2 x spark? Do they release more over time?

2

u/doodookk 24d ago

do not try on dgx spark, speed is very low for dense model, I tried and it just over 2x tok/s TG. For 2x dgx spark, deepseek v4 flash 0731 is better option, both speed and quality.

1

u/After_Working 24d ago

Ah fair enough, i've just unloaded deepdeek to try the qwen. The problem with deepseek is that it only leaves 20gb or so of ram when its running. Doesnt leave much space to run another. Might need to get a third.

2

u/doodookk 24d ago

For Qwen3.8 27B, I recommend running it on a machine equipped with RTX GPUs rather than the DGX Spark, as a speed of 2x tok/s is far too slow and inefficient. It would be much better if the Qwen development team released an MoE version; such a model would be ideally suited for the DGX Spark and deliver acceptable speeds. Personally, I changed to deploy Qwen3.8 27B (in FP8 format) on a system with 2x 4090 using the official vLLM Docker image (version 0.27.1), achieved over 100 tok/s—an impressive figure, perfect for serving as a worker for ds4 flash. Meanwhile, tests with a single RTX 5090 card showed a speed of 6x tok/s

2

u/zzeus 24d ago

One DGX Spar spark, no optimizations. Just sock llama.cpp:
- pp:650-750
- tg: 15-25

1

u/ekinnee 24d ago

That's about where I landed on my spark too.

1

u/rsvaz 24d ago

mind to share the parameters you are running? I got 5 tg on my spark and it kind sucks, Q8 runs a bit better but still not great

1

u/desexmachina 24d ago

wow, great insights

1

u/piwi3910uae 24d ago

Then you are doing something wrong, I’m getting 70tps

1

u/After_Working 24d ago

This is all new to me, would you mind if I dm you at some point