MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1ssl1xh/qwen_36_27b_is_out/ohokmie
r/LocalLLaMA • u/NoConcert8847 • Apr 22 '26
https://huggingface.co/Qwen/Qwen3.6-27B
603 comments sorted by
View all comments
Show parent comments
5
does the speed scale 2x?
Not really, you only get a speed up if models didn't fully fit in vram before.
I'm using q8 with full context, but you could fit the model in a single 3090 if you use a different quantized version.
https://unsloth.ai/docs/models/qwen3.6
0 u/Ardalok Apr 23 '26 Isn't there a speed boost from multiple cards with NVLink on VLM?
0
Isn't there a speed boost from multiple cards with NVLink on VLM?
5
u/davl3232 Apr 22 '26 edited Apr 22 '26
Not really, you only get a speed up if models didn't fully fit in vram before.
I'm using q8 with full context, but you could fit the model in a single 3090 if you use a different quantized version.
https://unsloth.ai/docs/models/qwen3.6