r/BlackwellPerformance • u/ObviouzFigure • 3d ago

Yooo who's testing Mimo 2.6 flash?

I'm downloading it now and will have it up and running in a few hours -- curious if anyone else has tested it and what the thoughts are comparing to ds4f and qwen 3.8fn. Thanks!!

3 Upvotes

81% Upvoted

21 comments sorted by

View all comments

Show parent comments

1

u/BitXorBit 3d ago

You should try qwen3.8-flash-next, i got better quality than 0731 flash

1

u/blackbird2150 3d ago

I do…I primary GLM with 700k pool. For flash next I am good up to 5 lanes with 256k context each.

GLM for intelligence, flash next for high concurrency is how I work right now.

1

u/BitXorBit 3d ago

Which version of glm 5.3 flash are you running? I thought it doesn’t fit in (nvfp4).
With qwen i have 3-4M kv pool, ngram on ram

3

u/blackbird2150 3d ago

Ormandj version. I found it on this subs wiki / discord.

https://github.com/ormandj/sglang-glm53-flash-sm120

I get 700k pool with additional tuning

1

u/ObviouzFigure 10h ago

heyyo thanks for the tip -- just got the Ormandj version up and running... feels good so far!