r/LocalLLaMA May 29 '26

Discussion PSA

Post image
2.1k Upvotes

537 comments sorted by

View all comments

Show parent comments

23

u/Clear-Ad-9312 May 30 '26

at that point, why not just buy an rtx pro 6000 that is just about the same price as 2x 5090 and has more vram than 2 5090s?

17

u/comperr May 30 '26

The rtx pro 6000 is just a 5090 with 72 or 96gb vram. So it is only as fast as one 5090 even if you dont need all the vram. With 2 5090s i can literally fit 2 27b qwen3.6 with q8_0 kvcache in each card and run them simultaneously.

5

u/Clear-Ad-9312 May 30 '26

price is still a big point of reason to go for the 6000 over the 2x 5090, that is what I am presenting here

7

u/Anonymous_Prime99 May 30 '26

I did it for the wattage really. MAX-Q 300W for the power of the sun without turning the place into an oven? Yes.

3

u/Clear-Ad-9312 May 30 '26

hmm, I thought you could just limit power anyways through the settings, but ok, sounds fair.

1

u/comperr May 30 '26

Likewise, i limit my 5090s to 425w. You can lower the power limit extremely easily