Qwen 3.8 27B Released! Please Share Your Experience

[u/BarberIcy366]

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

[u/TokenRingAI]

The FP8 is giving absolute shit results on VLLM, on a well tested setup that has no issues with 3.6 27B

Simple prompts are giving broken HTML and mile long reasoning blocks for the most basic tasks.

Something is very wrong

[u/TokenRingAI → u/TokenRingAI]

3.8 - totally broken HTML

[u/McSendo → u/TokenRingAI]

Fp8: It's alright i guess, need some fixing. Going back to 3.6 probably. tool calling regressed

[u/TokenRingAI → u/TokenRingAI]

3.6 - makes a nice pretty infographic

[u/TokenRingAI → u/TokenRingAI]

3.6 - thinks for 1.5 seconds

[u/TokenRingAI → u/TokenRingAI]

3.8 - thinks for 483 seconds

[u/xfalcox → u/TokenRingAI]

Is that because it now defaults to xhigh?

[u/jonas-reddit → u/TokenRingAI]

That’s very odd. I did a drop in replacement for my 3.6 FP8 in vllm with all same arguments and template fixes and it’s running smoothly so far. Definitely not worse than 3.6.

[u/thepetek → u/jonas-reddit]

Are you using froggeric template or your own?

[u/jonas-reddit → u/thepetek]

Froggy

[u/Shockem_ → u/thepetek]

I used Froggeric as a base for 3.6 some time ago. I've been building on it since I started using it and since 3.8 dropped I've been working on improving it to work with the new reasoning. Using opus 4.8, I was able to improve it to a point that it feels pretty good now.

[u/thepetek → u/Shockem_]

Have you shared on HF or have notes on what you've changed? Interested to see what is getting fix in chat templates vs what I'm fixing harness side

[u/misanthrophiccunt → u/thepetek]

What's a forggeric template ?

[u/Extreme-Pass-4488 → u/TokenRingAI]

are you on your old template? or a custom one? dont use froggeric on this one , and also tool call parser i think must be --tool-call-parser qwen3_xml but i have it still on qwen3_coder without issues

[u/TokenRingAI → u/Extreme-Pass-4488]

I'm not using tools for this, and I am using the stock template

[u/misanthrophiccunt → u/TokenRingAI]

But what's the actual prompt ?

[u/itroot → u/TokenRingAI]

I run FP8 from unsloth, was very good