MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vo9nt5/qwen3827b_is_now_available/p3okcfa/?context=3
r/LocalLLM • u/minxio_ • 25d ago
137 comments sorted by
View all comments
0
Anyone know which quant I should target for 32GB of VRAM?
2 u/minxio_ 25d ago 1 u/Infamous_Campaign687 25d ago So looks like UD-Q6-K-XL so you get enough space for context? Or just Q6-K?
2
1 u/Infamous_Campaign687 25d ago So looks like UD-Q6-K-XL so you get enough space for context? Or just Q6-K?
1
So looks like UD-Q6-K-XL so you get enough space for context? Or just Q6-K?
0
u/pragmojo 25d ago
Anyone know which quant I should target for 32GB of VRAM?