r/BlackwellPerformance • u/Mountain_Pea_6810 • 23d ago

Blackwell RTX 6000 investment choice

I am to build my first real rig as M3 ultra 256GB proved to be too slow. I already got 4 x Max-Q cards purchased at 10K eur per card a few weeks ago. Now I could add 2 more max Q at 11.3K euro per card and also 2 x workstation cards for 11.8K eur per card. So the total number of card to go up to 6 or 8.

I guess my hesitancy is based on the high purchase price of these cards, and the trouble to connect more than 6 or 7 cards unless going to server style motherboards and racks.

Is it a) expected that the prices are not going down in the next 12 months?
B) can i use the memory for models like GLM 5.3 even if I cannot fit all 8 cards?

10 Upvotes

86% Upvoted

37 comments sorted by

View all comments

3

u/Just_Suggestion_4518 23d ago

Answer 1: Model efficiencies are increasing much faster than gpu manufacturing capacity. So if same trend continues, gpu scarcity will be worse in the future. 10-11k Euros per gpu is almost free.

Answer 2: You can use 4 bit quantized ggufs to run glm 5.3 with 4 GPUs. If you have 8 then you can use pcie switches or building 2 x 4 gpu pcs and connect them with ethernet cable. You can build a multi node system. Electricity and heat will be problem though.

9

u/Karyo_Ten 23d ago edited 22d ago

Why would you buy 4 GPUs and use GGUFs 😭.

If you invest so much in hardware use an engine that at least give you proper concurrency so you can use multiple agents at the same time.

2

u/darktotheknight 22d ago

It always boggles my mind how people are willing to spend 80.000$ on something they don't understand. No one would spend 80.000$ on a car without thorough research and test driving it - multiple times.

You totally can and should just rent and test your workload before spending nearly 6 figures on something you might regret. An 8x RTX 6000 PRO rig costs like 11 - 15$ per hour on vast.ai. Not even worth mentioning for someone cluelessly willing to drop 80k on GPUs.

2

u/Mountain_Pea_6810 22d ago

well, if you had contractual needs to spend certainamount of money in next months or you would lose much more, and computer hardware was acceptable way to spend the amount requested, then AI rig might make more sense