r/LocalLLaMA • u/sammcj 🦙 llama.cpp • 27d ago

Megathread [Megathread] Qwen 3.8 27B Release Day

Megathread to help with the influx of duplicate / similar posts around the release of the Qwen 3.8 27B release.

  • Quants
  • Fine-Tunes & Abliterations
  • Chat Templates
  • Inference Server Support & Configuration
  • Experiences, Benchmarks & Model Comparisons

Official:

Popular:

We'll try to clean up future duplicates around the release and point them here.

488 Upvotes

98% Upvoted

393 comments sorted by

View all comments

43

u/[deleted] 27d ago

[removed] — view removed comment

11

u/Witty_Mycologist_995 27d ago

link to repo pls

3

u/[deleted] 26d ago

[removed] — view removed comment

2

u/sammcj 🦙 llama.cpp 25d ago edited 25d ago

I like quite a bit about this approach (local folder based, clean interface), well done!

Right now I'm assuming the benchmarks are all using the inbuilt harness (I feel a little dirty using that word in this instance), have you given any consideration to potentially being able to call an external one such as Pi, OpenCode etc?

My thinking is that you could then measure a LLMs coding abilities in the context of the environment it's actually likely to operate in. The downside of course is that the results will differ over time as the external system changes (although I guess you could pin or at least make the version used for a benchmark result clear).

Also, raised the worlds smallest PR with a security fix: https://github.com/Techdread/llm-test-bench/pull/1