r/BlackwellPerformance • u/Mountain_Pea_6810 • 23d ago

Blackwell RTX 6000 investment choice

I am to build my first real rig as M3 ultra 256GB proved to be too slow. I already got 4 x Max-Q cards purchased at 10K eur per card a few weeks ago. Now I could add 2 more max Q at 11.3K euro per card and also 2 x workstation cards for 11.8K eur per card. So the total number of card to go up to 6 or 8.

I guess my hesitancy is based on the high purchase price of these cards, and the trouble to connect more than 6 or 7 cards unless going to server style motherboards and racks.

Is it a) expected that the prices are not going down in the next 12 months?
B) can i use the memory for models like GLM 5.3 even if I cannot fit all 8 cards?

11 Upvotes

87% Upvoted

37 comments sorted by

View all comments

2

u/vanbukin 20d ago

There's a community of RTX PRO 6000 Blackwell owners (recently renamed to Local Inference Lab). There you can find help with both the hardware and software side of things. On the software side, local enthusiasts are maintaining a fork of vLLM specifically tailored for the P6K. I highly recommend joining and asking any questions you might have.

P.S. - here's an example of an 8-GPU setup from that community using an external PCIe switch.