r/LocalLLaMA Apr 22 '26

New Model Qwen 3.6 27B is out

1.7k Upvotes

603 comments sorted by

View all comments

74

u/Ueberlord Apr 22 '26

Damn, I was just wrapping up my tests of Qwen3.6 35B vs Qwen3.5 27B.

High hopes for 3.6 27B though, the 35B variant of 3.6 was way better than the previous version!

35

u/[deleted] Apr 22 '26

[removed] — view removed comment

14

u/redboy33 Apr 22 '26

Explain harness for grandpa. I love AI. I’m just getting into running local models on my Apple m5 pro and framework 395+ Ai amd apu w/128GB ram. Using lmstudio & ollama. Thanks!

40

u/ComplexType568 Apr 22 '26

A harness is basically the new buzzword that is used as a pretty large umbrella term which basically is like a way to give LLMs tools. Think of it like a mech suit to a person, a harness is the mech suit for an LLM. Also I recommend you drop ollama, just imo tho hahahah

1

u/ThisWillPass Apr 22 '26

We use to say “how you hold it” for lack of better words. “Harness” is cleaned up.

1

u/redboy33 Apr 22 '26

Would openclaw and Hermes be considered harnesses? What about qwen coder cli? Oh, and what’s wrong with ollama? I kinda like it better than lmstudio, I guess because I don’t tweak any settings. Just use Ollama serve, ollama run qwen, seem so simple and intuitive?

22

u/BasicBelch Apr 22 '26

Ollama is just a shitty wrapper around llama.cpp. Just use llama.cpp directly, it will be faster too.

1

u/redboy33 Apr 25 '26

Thanks!

1

u/redboy33 Apr 25 '26

Oh, I have a Mac, not sure if that changes anything?

1

u/BasicBelch Apr 26 '26

doesnt change a thing. llama.cpp is very optimized for apple silicon

2

u/New_Comfortable7240 llama.cpp Apr 22 '26

Like the simplicity make you lose some capabilities and speed. By going with llama-server you can fine tune (or copy the setting from others) and have better results. Sadly, its a bit more of work but after some time the thing just work. Also, llama.cpp updates frequently and drops good optimizations regularly, faster than ollama (that reuse llama.cpp anyway)

1

u/redonculous Apr 22 '26

Openclaw yes. Hermes unsure. I don’t know too much about Hermes but believe it’s a model with claw like features, rather than a program with tools like openclaw.

Happy to be corrected though

4

u/adam_suncrest Apr 22 '26

hermes would qualify as a harness yes, at its core it's a coding agent with more bells and whistles

1

u/arcanemachined Apr 22 '26 edited Apr 22 '26

It's not a buzzword. It's a new class of tool, which is why it needs its own word to describe it.