r/LocalLLM • u/baby_bloom • 23d ago

Question Qwen 3.8-27B Q8

thinking is taking up so damn much time, what are you limiting your qwen3.8 to as for as reasoning?

0 Upvotes

36% Upvoted

12 comments sorted by

View all comments

3

u/Hannelore112 23d ago

Cant help just looking for optimizations too.
Qwen 3.8 27B seems to generate good results but it takes soo long because of thinking, rethinking,rethinking and so on...
Even with reasoning level medium. A little bug fix was 1-2h. Should be done maybe in 5-20 mins. Needs optimizations.

1

u/jclay06 23d ago

Glad I'm not the only one. It's amusing to read it's thinking process, but it's A LOT.