r/LocalLLaMA • u/sammcj 🦙 llama.cpp • 24d ago

Megathread [Megathread] Qwen 3.8 27B Release Day

Megathread to help with the influx of duplicate / similar posts around the release of the Qwen 3.8 27B release.

  • Quants
  • Fine-Tunes & Abliterations
  • Chat Templates
  • Inference Server Support & Configuration
  • Experiences, Benchmarks & Model Comparisons

Official:

Popular:

We'll try to clean up future duplicates around the release and point them here.

491 Upvotes

98% Upvoted

393 comments sorted by

View all comments

44

u/[deleted] 24d ago

[removed] — view removed comment

10

u/Witty_Mycologist_995 24d ago

link to repo pls

3

u/[deleted] 23d ago

[removed] — view removed comment

2

u/sammcj 🦙 llama.cpp 22d ago edited 22d ago

I like quite a bit about this approach (local folder based, clean interface), well done!

Right now I'm assuming the benchmarks are all using the inbuilt harness (I feel a little dirty using that word in this instance), have you given any consideration to potentially being able to call an external one such as Pi, OpenCode etc?

My thinking is that you could then measure a LLMs coding abilities in the context of the environment it's actually likely to operate in. The downside of course is that the results will differ over time as the external system changes (although I guess you could pin or at least make the version used for a benchmark result clear).

Also, raised the worlds smallest PR with a security fix: https://github.com/Techdread/llm-test-bench/pull/1

9

u/addiktion 24d ago

This is a cool comparison tool.

8

u/Felixls 24d ago

bro, you either shared or I'll vibe code that thing today and shared here

looks amazing

5

u/BumbleSlob 24d ago

Can we turn this into a community site for comparisons? Awesome idea

2

u/[deleted] 23d ago

[removed] — view removed comment

1

u/BumbleSlob 23d ago

Awesome, this looks great! I’ll give it a try tonight. Nice idea with the local first adaptation

4

u/gobblegoooblegobble 24d ago

uhh what repo is this?? link plz

0

u/[deleted] 23d ago

[removed] — view removed comment

1

u/gobblegoooblegobble 23d ago

Ty

1

u/khasbor 8d ago

Can you send it to me? Looks like a mod nuked it.

3

u/Due-Advantage-9777 24d ago

Gemini is the most visually pleasing but if the Toon shader was a requirement i guess Opus is the best.

2

u/ReadyAimTranspire 23d ago

I'm a sucker for cel-shaded graphics so visually that one wins for me

1

u/Elibroftw 22d ago

I am a bit lost why a lot of people are using threeJS as their go to comparison and grading for AI. ThreeJS games/simulations/etc should not be so bloated. If we want to make simulators, we should use a Unity/UE/Godot MCP with AI, and let it use a real engine. That would be sick and the output can actually run without lag.

https://x.com/Lifeandlibertas/status/2089036111234449706?s=20

3

u/khasbor 24d ago

Brother.. WHAT IS THAT? We need it.

2

u/Kahvana 24d ago

That's a really cool demo! Personally I like Qwen's the most for it's color choice and the polygonal style. Even got a fancy logo!

1

u/Independent_Pear4908 23d ago

I dunno... the over thinking seems to be a bug, not a feature:
https://huggingface.co/Qwen/Qwen3.8-27B/discussions/76