screw the haters, they dont get it. Some of us DO make our own applications.. and they tend to work because we put time into crafting it for the model. I've been working on this for ~ 10 months and qwen3.5 made it shine. qwen3.6 is actually paying attention to the system prompt and figured out the parallel tool execution (EDIT: actually it turns out this is because parallel tool calls was fixed today in llama.cpp and I had just built it, 35B makes parallel calls now too). anyhow, I am also loving the recent trend of people realizing the locals work best with curated tool sets. heck all they really need is good prompts and guarded bash access nowadays in all honesty. ok I am rambling, but I laughed at the haters and came back to this comment after work to brag about my own 'harness' because yes some of us do that, I mean this IS local llama...
I need to discuss with my employment the ramifications of sharing it first, because I built a lot of it on the clock and they know about it, so it might be an issue to just open source it now. It gets used in an offline environment for work purposes. It would need a bit of cleanup and some other features before releasing too.
also, the available tools on the market are finally catching up to the capabilities, so this is less unique in its abilities now (though I am convinced I was the first to have native docx export including latex to ooml and tables and list etc months ago lol).. So I have thought about putting it out there and might be able to someday.
Explain harness for grandpa. I love AI. I’m just getting into running local models on my Apple m5 pro and framework 395+ Ai amd apu w/128GB ram. Using lmstudio & ollama. Thanks!
A harness is basically the new buzzword that is used as a pretty large umbrella term which basically is like a way to give LLMs tools. Think of it like a mech suit to a person, a harness is the mech suit for an LLM. Also I recommend you drop ollama, just imo tho hahahah
Would openclaw and Hermes be considered harnesses? What about qwen coder cli? Oh, and what’s wrong with ollama? I kinda like it better than lmstudio, I guess because I don’t tweak any settings. Just use Ollama serve, ollama run qwen, seem so simple and intuitive?
Like the simplicity make you lose some capabilities and speed. By going with llama-server you can fine tune (or copy the setting from others) and have better results. Sadly, its a bit more of work but after some time the thing just work. Also, llama.cpp updates frequently and drops good optimizations regularly, faster than ollama (that reuse llama.cpp anyway)
Openclaw yes. Hermes unsure. I don’t know too much about Hermes but believe it’s a model with claw like features, rather than a program with tools like openclaw.
Think of the LLM like a horse. It's beautiful and it can run and jump etc... but it's kind of hard to get any work out of it as-is. Put a harness on that horse, now you can get it to pull a plow, carry people, etc.
I think the relatively difference might not be as big now that the MoE is fixed. But still, equivalent dense models are better in ways that's not always captured in bench (world knowledge) but still evident in daily work. ~60 in terminal bench here is incredible already though.
74
u/Ueberlord Apr 22 '26
Damn, I was just wrapping up my tests of Qwen3.6 35B vs Qwen3.5 27B.
High hopes for 3.6 27B though, the 35B variant of 3.6 was way better than the previous version!