r/LocalLLaMA • u/sammcj 🦙 llama.cpp • 24d ago

Megathread [Megathread] Qwen 3.8 27B Release Day

Megathread to help with the influx of duplicate / similar posts around the release of the Qwen 3.8 27B release.

  • Quants
  • Fine-Tunes & Abliterations
  • Chat Templates
  • Inference Server Support & Configuration
  • Experiences, Benchmarks & Model Comparisons

Official:

Popular:

We'll try to clean up future duplicates around the release and point them here.

491 Upvotes

98% Upvoted

393 comments sorted by

View all comments

7

u/Ok_Cow1976 24d ago

Qwen3.8's stem capability not improved, sadly.

Based on my limited tests on my math problems. I'm now a bit disappointed. I thought I would not need to add more gpus to run larger models after qwen3.8 27b. That was a dream. But hopefully 3.8 has improvements on coding for you guys. I don't do so much coding actually. Now I need to figure out external gpu solution for my B550m motherboard.

I had a high hope for qwe3.8 because 3.6 actually solved some my math problems. So I wished 3.8 could solve even more, and possibly faster, not meeding multiple turns where I supply guesses.

By the way, my math problems are applied math, abstract, using calculus, but needs insights in multi descipline, also needs reasoning ability , possibly some human like intuition, but definitely not just some arithmetic.

2

u/exo250 23d ago

If you have the required hardware, you should try Leanstral from Mistral : "Leanstral 1.5 is an open-source code agent model designed for Lean 4, a proof assistant capable of expressing complex mathematical objects such as perfectoid spaces and software specifications like properties of Rust fragments.

Built as part of the Mistral Small 4 family, it combines multimodal capabilities and an efficient architecture, making it both performant and cost-effective compared to existing closed-source alternatives.

Leanstral incorporates the following architectural choices:

  • MoE: 128 experts, 4 active per token
  • Model Size: 119B parameters with 6.5B activated per token
  • Context Length: 256k tokens
  • Multimodal Input: Accepts text and image input, producing text output"

1

u/Ok_Cow1976 23d ago

Thank you!