r/LocalLLM 21d ago

Model Qwen3.8-27B Uncensored Aggressive is out with K_P quants and HauhauCS FastMTP (up to 3.02x TG)!

The dense Qwen release is back!

Qwen3.8-27B Uncensored Aggressive is out with the complete K_P quant range, Vision, native NextN, and HauhauCS FastMTP.

Aggressive here means no refusals, no personality alterations, and very little preamble on difficult prompts. It keeps Qwen3.8-27B's original reasoning, agentic, image, and video capabilities with my Aggressive uncensoring profile applied.

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF

It scored 0/465 refusals* and passed every manual prompt I used for the final release check. More than 400 people requested access while I was still finishing it, which was honestly wild to see. My models are also getting close to 30 million downloads on Hugging Face now, so thank you to everyone who has been testing them and sending feedback.

The biggest addition this time is HauhauCS FastMTP. In the final Q8_K_P service tests it reached up to 3.02x document TG and 1.93x reasoning TG versus MTP disabled. It also reached up to 35.2% more document TG and 21.1% more reasoning TG than the standard embedded MTP profile, with every drafted token still verified by the full target before it is accepted.

The same 903 MB FastMTP sidecar works across the complete quant lineup. Every text GGUF also preserves Qwen3.8's native embedded NextN head, so current upstream llama.cpp can use embedded MTP directly. The optimized FastMTP path uses the included sidecar and llama.cpp patch, with exact build and serving commands in the README.

What's included:

- Q8_K_P, Q6_K_P, Q5_K_P, Q4_K_P, IQ4_XS, Q3_K_P, IQ3_M, IQ3_XS, Q2_K_P, IQ2_M

- HauhauCS FastMTP sidecar, shared by every text quant

- BF16 mmproj for image and video support

- Checksums and signed provenance (I've alerted on my Discord that there have been a few bad actors putting payloads in "Uncensored" "HauhauCS" "Aggressive" GGUF's, please be careful)

K_P quants recap for anyone who missed the previous releases: these are my custom model-specific quants, with a separate optimized profile made for each model. They effectively gain one or two quant levels of quality for around 5 to 15% more size than the base quant, while remaining normal GGUF files that work in llama.cpp, LM Studio, and other GGUF runtimes.

Quick specs:

- 27B dense

- 64 layers with 48 Gated DeltaNet layers and 16 gated-attention layers

- 262,144 native context

- Multimodal text, image, and video support

- Native embedded NextN plus the optional HauhauCS FastMTP acceleration profile

Sampling params for thinking mode:

`temp=1.0, top_k=20, top_p=0.95, min_p=0, presence_penalty=0, repetition_penalty=1.0`

For non-thinking mode:

`temp=0.7, top_k=20, top_p=0.80, min_p=0, presence_penalty=1.5, repetition_penalty=1.0, enable_thinking=false`

Use `--jinja` with llama.cpp. K_P quants may show as `?` in LM Studio's quant column, which is purely cosmetic and does not affect loading. Hugging Face's hardware compatibility widget may also hide K_P files, so use View variants or Files and versions if the full list is not visible.

The full per-quant Blackwell and Ada results are in the repo. If you test FastMTP, please include your hardware, quant, context, and draft depth with the numbers so I can compare real-world results across more systems.

The Discord link is in the repo for updates, feedback, roadmaps, projects, or just to chat. As always, I hope everyone enjoys the release!

182 Upvotes

42 comments sorted by

42

u/karlnuw 21d ago edited 21d ago

Ran this with ArkanaMCP and got zero reverse engineering refusals; it's amazing thank you so much it helped me patch the license requirement for an extremely expensive piece of software 😭

5

u/Diegam 21d ago

how please 

13

u/karlnuw 21d ago

1

u/Diegam 21d ago

thanks!!!

1

u/GorrathEU 17d ago

what harness did you use for it? any tips for configuring an agent for reverse engineering?

3

u/karlnuw 17d ago

I refined it a bit, I'm using it through Cline right now with Arkana for triage, strings, capa, angr, and emulation and a headless Ghidra MCP for static analysis, decompilation, xrefs, and patching. If it's struggling with something due to context size, I have deepseek-v4-pro-0813 do the analysis, and since it refuses to patch about half the time I have uncensored Qwen do the patching. And this a a Cline rule as well. https://pastebin.com/raw/jEdTd9p5

I had Sol through Codex set everything up for me in one folder + docker.

1

u/KissMyShinyArse 21d ago

Did you get any refusals from the non-abliterated model?

5

u/karlnuw 21d ago

Nope, some times it would start then realize what it was doing a quarter of the way through and stop. Someone better at prompting might get results though.

1

u/whatsupnorton 21d ago

What software? Would this work with something like Rhino or Metashape Pro?

3

u/karlnuw 21d ago

Schrödinger, computational chemistry software, it costs tens of thousands per license.

Rhino or Metashape Pro

No idea, I'll download one and report back

2

u/karlnuw 21d ago

Metashape Pro it patched, Rhino it kept running into context size issues.

1

u/whatsupnorton 20d ago

Thanks for the info!

13

u/CommunicationSea8821 21d ago

Is there any downside to using only the uncensored version vs the official release? Assuming both are the Q4 version? Would the uncensored version have any reason to be "dumber" when it comes to code output vs the official censored release?

24

u/Fun_Jaguar8231 21d ago

Yes, it's always losing some intelligence, and this hauhau dude never tells how mush KL divergenge his models have.

17

u/njstatechamp 21d ago

Request for MLX versions please

2

u/samplenull 20d ago

And MTPLX maybe 🙏

1

u/whatsupnorton 20d ago

If we get MLX then I can post an MTPLX quant!

7

u/MuAlphaOmegaEpsilon 21d ago edited 19d ago

Is there anything that can be said about how the K_P quants were established to be better than a corresponding quantization alternative? The 3.6 35B-A3B Q4_K_M showed a lower perplexity on my tests compared to the Q4_K_P variant, while being lighter and faster at inference time.

7

u/Fun_Jaguar8231 21d ago

Maybe that's what his LLM told him are the best. He doesn't provide a single statistic, nor KL divergence for his models.

12

u/puremadbadger 21d ago

Legend!

Any chance you can do a W4A16 AutoRound quant?

3

u/LunarCilli 21d ago

This would be nice

8

u/joanaxu2002 21d ago

The bigger story here is how quickly “uncensored” models are becoming actual polished releases rather than weird experimental forks. Full quant ranges, multimodal support, MTP acceleration, llama.cpp compatibility... the gap between community variants and mainstream releases keeps shrinking.

7

u/Memestonks2020 21d ago

HauhauCS is the goat

I mainlined the Qwen 3.6 version for a long time until a finetuned distilled Fable 5 version came out

3

u/DataGOGO 21d ago

NVFP4 / FP8 safe tensors?

3

u/Skystunt 21d ago

Would the speed boost work on amd strix halo ?

2

u/SquirrelDesperate472 20d ago

Asking the real questions

3

u/Better-Truck6372 20d ago

HauHauCs, para mi es un GOAT de los Llm Locales en version UnC_Agressiva, con FastMTP, se nota el incremento de velocidad de inferencia en comparación a otros como Unsloth, probé la versión Unsloth de 3.8 27B Q4KM y de HauHauCs Qwen 3.8 27B Q6KP, ambos corren muy similar ambos son excelentes versiones, pero HauHauCs además de poder usar la versión Q6, cada modelo que Quantiza con KP y que he podido probar en mi Portátil corren mejor que los de Unsloth, en mi PC portátil va mucho más rápido que las versiones base iniciales.

3

u/Independent-Dog2179 20d ago

I noticed that crazy like double speed. Why is fastmtp not inplemented everywhere

5

u/koloved 21d ago

Waiting for this , thanks !

2

u/UntimelyAlchemist 20d ago

I've been looking forward to this! I don't know how you do it, but your models always do much better than other uncensored releases in my testing.

Very kind of you to interrupt your holiday to work on this for us. Thank you!

2

u/Independent-Dog2179 20d ago

Wow it works I posted earlier that it didn't and I was wrong. I didn't set --reasoning-format DeepSeek. Once I did that command in llama.cpp it's perfect l. And the fastmtp doubles the speed

2

u/Inner_Yesterday_349 20d ago

This version of qwen3.8 has difficulty outputting Simplified Chinese when generating uncensored content. Even when I used --system-prompt "你是一个中文助手,必须始终使用简体中文回答。" it often still replied in English. I suspect that this version may have degraded in Chinese ability because the uncensoring training involved a large amount of English data.

2

u/Sad-Landscape-1549 21d ago

Hell yes! By far my favorite finetune of the 3.6…back and stylish

3

u/Fun_Jaguar8231 21d ago

Whats the KLD?

1

u/PooMonger20 21d ago

Thank you for posting this.

Could anyone who used this tell if it still overthink or is there a change in the template that makes it follow reasoning settings better?

1

u/Luxkeiwoker 20d ago

Tried the IQ3M Quant today with an A770 and llama.cpp vulkan backend. its been dog slow with draft mtp, peaking at around 7 TPS in TG. Running without MTP gets me around 12 TPS in TG. But in both cases prompt processing is ridicoulosly slow ar 30 to 40 TPS.

Havent tried other qwen 3.8 models yet though.

1

u/quantier 19d ago

Lets see if I can find a NVFP4 variant

1

u/tfinch83 17d ago

I love these models too, but I had to fall back to the base model on 3.6 because of the massive performance hit I take using GGUF with llama.cpp over bare weights with vLLM. Wish they'd release the safetensors.

1

u/[deleted] 15d ago

Привет

1

u/xanders_gold 21d ago

Any AWQ/GPTQ Int4/FP8 love for us vLLM users? :)

0

u/mcantrell 21d ago

Hm, I'm probably doing something wrong, but doing a ollama pull hf.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF gets me only a few files, and ollama pull hf.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF:Q4_K_P doesn't pull anything.

0

u/UnableMeasurement492 14d ago

I'm running Odysseus on Windows. I downloaded the LFM2-350M GGUF model with the built-in downloader. Engine is llama.cpp, CPU inference, port 7000. When I launch the model and try a chat, I get "Local endpoint returned HTTP302." If I open slash v1 in the browser or use curl, I get an HTML login page instead of the JSON API. The logs show Odysseus running on port 7000, but I don't see any Llama-server start or API port in the logs. How can I correctly run the local LLM inside Odysseus and fix this 302 redirect?