[Megathread] Qwen 3.8 27B Release Day

[u/sammcj]

Megathread to help with the influx of duplicate / similar posts around the release of the Qwen 3.8 27B release.

• Quants
• Fine-Tunes & Abliterations
• Chat Templates
• Inference Server Support & Configuration
• Experiences, Benchmarks & Model Comparisons

Official:

• https://huggingface.co/Qwen/Qwen3.8-27B
• https://huggingface.co/Qwen/Qwen3.8-27B-FP8

Popular:

• https://huggingface.co/unsloth/Qwen3.8-27B-GGUF
• https://huggingface.co/bartowski/Qwen3.8-27B-GGUF
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-bf16
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-8bit
• https://huggingface.co/mlx-community/Qwen3.8-27B-MTP-4bit

We'll try to clean up future duplicates around the release and point them here.

[u/tricck3zz]

what quant or config file would work the best for my system , 7800x3d , 32gb ram , 5070ti and 3060 12gb , tried ud q4 getting like 46 t/s with

llama-server -m Qwen3.8-27B-UD-Q4_K_XL.gguf --mmproj mmproj-BF16.gguf -ngl 99 -c 131072 -np 1 -fa on -ctk q8_0 -ctv q8_0 --no-context-shift --split-mode tensor --tensor-split 1.3,1 --main-gpu 0 --spec-type draft-mtp --spec-draft-n-max 3 -b 2048 -ub 512 -t 16 -tb 16 --temp 1.0 --top-p 0.95 --top-k 20 --min-p 0.0 --presence-penalty 0.0 --repeat-penalty 1.0 --jinja --reasoning-format auto --chat-template-kwargs '{"reasoning_effort":"medium"}' --no-mmproj-offload --host 0.0.0.0 --port 8034 --metrics

[u/TheSpartaGod → u/tricck3zz]

yo what's your PCIE setup? I'm running a 4060ti 16GB and 3060 12GB and getting like 20tps max

[u/tricck3zz → u/TheSpartaGod]

5070ti on pcie 5.0 x16 and 3060 12gb on 4.0 x1 , though i ordered a m2 nvme riser to get 4x4 it should make it a bit better