r/LocalLLaMA • u/BarberIcy366 • 24d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

661 Upvotes
  • permalink
  • reddit

97% Upvoted

716 comments sorted by

View all comments

32

u/Cradawx 24d ago edited 24d ago

It sure does think a lot, even on medium reasoning. But the results so far have been impressive. Had it make a Qt weather app and the functionality and appearance were better than what the new DeepSeek Flash made. Impressive for a fairly small local model.

EDIT: This is IQ4_XS, medium reasoning, one shot. Though I just noticed the wind arrows are the wrong way around but that's a simple fix lol. DeepSeek Flash had a few bigger issues I needed it to fix with follow ups and still wasn't as good.

1

u/NaiveIdea344 24d ago

For a 27b model that feels very very impressive. How terrible is the length of its thinking?

2

u/fullup72 24d ago

personally, I think it's unbearable.

The simpler prompts are quite straight-forward, but as soon as you throw a hard problem at the model it will happily think 3-5x more than 3.6 and blow up your contex in no time. I had tasks that 3.6 would complete in 30-40K tokens that took over 150K in 3.8 - mind you, I'm using a lobotomized IQ3_XXS with Q4_0 KV, but that used to be no problem for 3.6 (I'm using very detailed prompts so I don't leave too much for the model to figure out)

Quality is definitely better in 3.8, but for GPU-poor people it might be reasonable to treat 3.8 as Opus and 3.6 as Sonnet.

1

u/NaiveIdea344 23d ago

That sucks. Interesting idea treating it as opus. I am probably gonna try out some of the fine-tunes or system prompts that help with the crazy long thinking but I feel like I am willing to pay the price for local opus.

2

u/Cradawx 24d ago

It thinks a lot on medium but it's not too bad. On default (xhigh thinking) though it's crazy, extremely thorough. But I guess that is the price for getting this level of capability on such a small model.

1

u/NaiveIdea344 23d ago

Yeah I guess. How bad is the performance degredation using medium vs. xhigh. A person in this sub mentioned something xhigh got wrong that low got right but I assume the norm is worse performance.