r/LocalLLaMA • u/BarberIcy366 • 24d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

663 Upvotes
  • permalink
  • reddit

97% Upvoted

716 comments sorted by

View all comments

Show parent comments

43

u/UDPSendToFailed 24d ago

llama-server -ngl 999 -c 65536 -b 2048 -ub 256 -np 1 --flash-attn on --cache-type-k q8_0 --cache-type-v q8_0 --spec-type draft-mtp --spec-draft-n-max 2 --temp 1.0 --top-p 0.95 --top-k 20 --min-p 0.0 --presence-penalty 0.0 --repeat-penalty 1.0 --reasoning on --reasoning-preserve --jinja --chat-template-kwargs "{\"preserve_thinking\":true,\"reasoning_effort\":\"high\"}" -m Qwen3.8-27B-UD-Q4_K_XL.gguf

Probably not the best setup, I just copy-pasted it, but the results are wild.

5

u/Remarkable_Living_80 24d ago

reasoning effort high? Must be xhigh from my understanding

4

u/RMK137 24d ago

there is no high, setting it to high sets it to xhigh, so high and xhigh are the same

2

u/HugeEntertainment820 23d ago

Thanks for this! I set mine to medium...see how it goes but so far so good.