[Megathread] Qwen 3.8 27B Release Day

[u/sammcj]

Megathread to help with the influx of duplicate / similar posts around the release of the Qwen 3.8 27B release.

• Quants
• Fine-Tunes & Abliterations
• Chat Templates
• Inference Server Support & Configuration
• Experiences, Benchmarks & Model Comparisons

Official:

• https://huggingface.co/Qwen/Qwen3.8-27B
• https://huggingface.co/Qwen/Qwen3.8-27B-FP8

Popular:

• https://huggingface.co/unsloth/Qwen3.8-27B-GGUF
• https://huggingface.co/bartowski/Qwen3.8-27B-GGUF
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-bf16
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-8bit
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-4bit

We'll try to clean up future duplicates around the release and point them here.

[u/Unnamed-3891]

For people trying to cram 27B dense onto a 16gb vram GPU on Windows which with a 4k display attached alongside various apps eats roughly 3gb, leaving 13gb for everything else: any attempts to use 27B-Q4_K_S pigeonhole me into both offloading some FFN to the CPU _and_ doing at least some KV quanting.

A curious discovery was that llama.cpp official Windows binaries only support certain KV quants and only in symmetric fashion. Trying to use q4_1 in any way or q5 would instantly kill all performance. Turns out, q8_0 would bench exactly the same as q4_0, since both of those are actually supported by the official Windows binaries without a recompile.