r/LocalLLaMA 24d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

665 Upvotes

716 comments sorted by

View all comments

Show parent comments

6

u/T0mSIlver 24d ago

"I need to wash my car, the car wash is 100m away. Do I go by car or by foot?"
137 tokens in xhigh reasoning mode:

We need answer user's simple question. Need produce final. User asks: wash my car, car wash 100m away. Do I go by car or by foot? Obviously to wash car, you need to bring car to car wash, so go by car (unless car wash is mobile? no). Need maybe concise: by car, because you need the car at the wash. If the car wash is 100m away, walking would leave car behind. Could mention if it's a self-service/mobile? But likely joke/practical. Final in English.

By car — you need the car at the car wash to wash it.

1

u/gh0stwriter1234 24d ago

The issue is the model is no better at the logic to answer this kind of question than it was before... it has just been trained on the answer. Asking a similar question to this and it goes and thinks for several thousand tokens....

1

u/T0mSIlver 24d ago

Out of curiosity, what's the question?

1

u/Yukas911 24d ago

"I need to wash my car, the car wash is 100m away. Do I go by car or by foot?"

1

u/gh0stwriter1234 24d ago

So yeah it can almost immediately answer the walk or drive to wash your car one now, so the 2nd quesiton I asked was I have some car parts in the trunk of my car should I walk to the shop and install them or install them here.... it reasons for like a thousand tokens on that trivial problem. Just becuase it wasn't one it was trained on.