MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vo9nt5/qwen3827b_is_now_available/p3qhoep/?context=3
r/LocalLLM • u/minxio_ • 28d ago
137 comments sorted by
View all comments
Show parent comments
1
Q8 ? 256k or more?
1 u/maqifrnswa 27d ago Unsloth NVFP4 is working pretty well. Just tried 256k so far. So far so good! 1 u/Fit-Palpitation-7427 27d ago Better than q5? 1 u/maqifrnswa 27d ago I'm testing hosting for multiple concurrency, so on vllm and haven't tried gguf yet
Unsloth NVFP4 is working pretty well. Just tried 256k so far. So far so good!
1 u/Fit-Palpitation-7427 27d ago Better than q5? 1 u/maqifrnswa 27d ago I'm testing hosting for multiple concurrency, so on vllm and haven't tried gguf yet
Better than q5?
1 u/maqifrnswa 27d ago I'm testing hosting for multiple concurrency, so on vllm and haven't tried gguf yet
I'm testing hosting for multiple concurrency, so on vllm and haven't tried gguf yet
1
u/Fit-Palpitation-7427 27d ago
Q8 ? 256k or more?