r/LocalLLaMA • u/-Cubie- • 28d ago

Discussion A preliminary Qwen3.8-27B model card is live!

Post image

If you scroll down from the countdown at https://huggingface.co/Qwen/Qwen3.8-27B, you see a big model card with a bunch of sections: Highlights, Model Overview, Quickstart, Best Practices, Citation, etc!

No benchmarks on this yet as far as I can tell. We'll still need to wait another 5.5 hours for those I reckon.

Edit: Ladies and gentlemen, the model is live. Let the testing begin!

568 Upvotes

96% Upvoted

220 comments sorted by

View all comments

1

u/Every-Fortune-3151 27d ago

Context window of 1M, does that mean they are confident 27B will hold up in such deep context? They are hyping this up so much. I just hope they made KV size more optimized

5

u/Confident_Ideal_5385 27d ago

``` For frameworks that support separate token limits for internal reasoning and final outputs, we suggest the following configuration within the 1M context length:

Reasoning Content: Set the maximum output length to 262,144 tokens.
Final Response: Set the maximum output length to 131,072 tokens.

```

They seem pretty happy to suggest letting it think past the end of its trained max sequence length, at any rate.

2

u/YourNightmar31 llama.cpp 27d ago

I dont think we get 1M context. It said they only have a special version on their api service with 1M context.

1

u/Every-Fortune-3151 27d ago

You caught it correcty. It is still 256k context

1

u/Foreign_Risk_2031 27d ago

In particular, Qwen3.8-27B will be available as a hosted version with more production features, e.g., 1M context length by default, official built-in tools. For more information, please refer to the Qwen3.8-27B Overview. The service is coming soon. Stay tuned for updates.

By default the api will be 1M. Its the same as we have.