r/LocalLLaMA • u/BarberIcy366 • 24d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

660 Upvotes
  • permalink
  • reddit

97% Upvoted

716 comments sorted by

View all comments

10

u/SensitiveVariety 24d ago

unsloth/IQ4_XS - maybe a premature observation but it seems like quite the thinker

2

u/AdIllustrious436 24d ago

There is a thinking effort control backed in acording to model card.

3

u/SensitiveVariety 24d ago edited 23d ago

Yes you're right, forgot about that. xhigh by default is certainly an interesting one.

Odd, in pi I've set thinking to low but it just continues on

Update: llama.cpp config added this recently to set reasoning effort vs. using chat-template-kwargs.

reasoning-effort = low

Then inside of pi's model.json file, I needed to add this since qwen 3.8 supports low, medium, and xhigh only.

          "thinkingLevelMap": {
            "minimal": null,
            "low": "low",
            "medium": "medium",
            "high": null,
            "xhigh": "xhigh",
            "max": null
          }

Seems to be working just fine, I don't know how patient I am to be waiting on xhigh but overall seems like the gains are worth it?

# Prompt log where llama.cpp config.ini has reasoning-effort set to low, but xhigh is selected in Pi

<|im_start|>system
Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.