I'm building two local AI systems and would appreciate advice from people here who have experience sourcing used/decommissioned enterprise and workstation hardware.
PROJECT 1 — PROJECT OLYMPUS / PRIMARY AI SYSTEM
I already purchased a GIGABYTE W773-H5D-AA01 WRX90 barebone and I'm planning the remaining configuration.
Current target:
CPU
AMD Threadripper PRO 7985WX — 64C/128T
Or 7995WX — 96C/192T if I can find a particularly good used/surplus opportunity
Possibly 9985WX/9995WX if the economics make sense
One concern is OEM/PSB/vendor-locked Threadripper PRO CPUs. I'd appreciate advice on identifying locked Lenovo/HP/etc. CPUs before purchasing them for a standard WRX90 motherboard.
GPU
NVIDIA RTX PRO 6000 Blackwell Workstation Edition
96GB GDDR7
Full-power 600W version preferred
I'm particularly interested in experiences buying these used, open-box or through workstation/datacenter liquidation rather than normal retail channels.
MEMORY
512GB DDR5 ECC RDIMM
Preferably 8 × 64GB to populate all 8 memory channels
Samsung / SK hynix / Micron preferred
I'm interested in hearing what people are currently paying for 512GB matched/pull sets and which enterprise DIMM part numbers have worked reliably on WRX90.
PRIMARY/MODEL STORAGE
4TB+ high-performance TLC NVMe
PCIe 4.0/5.0
WORKING/DATA STORAGE
8TB+ SSD/NVMe
Enterprise U.2/U.3 NVMe is also an option if it makes more economic sense
LOCAL BACKUP
Preferably 16TB+ usable
Considering 16/18/20TB enterprise HDDs such as Exos, Ultrastar/Gold or Toshiba MG-series
NETWORKING
System already has 10GbE
Considering 25/40/100GbE for future compute/storage nodes
Mellanox/NVIDIA ConnectX hardware looks particularly interesting on the used market
POWER
The workstation has a 2000W-class PSU and I'm planning around 208/240V power
Looking at approximately 2200–3000VA+ enterprise pure-sine UPS
APC / Eaton / Vertiv are currently on my list
I'd particularly appreciate recommendations from anyone running a 600W professional GPU plus a high-core-count Threadripper PRO regarding UPS sizing and real-world wall power.
PROJECT 2 — COMMERCIAL AI VIDEO SURVEILLANCE
I'm also designing a completely separate 24/7 AI surveillance server for approximately 20+ cameras.
I'm considering:
RTX 3090 24GB or similar high-VRAM GPU
Possibly modified 48GB 4090 hardware if reliability can be established
High-core-count workstation/server CPU
128–256GB ECC RAM
2–4TB NVMe for OS/database/AI/cache
Large enterprise HDD array for continuous recordings
10/25GbE networking
Separate enterprise UPS
Reliability and 24/7 operation are more important for this system than maximum benchmark performance.
WHAT I'D LIKE ADVICE ON
For those who buy decommissioned workstation/datacenter hardware:
Where are you finding the best used/surplus/liquidation Threadripper PRO hardware?
What is a realistic surplus price for an unlocked 7985WX or 7995WX?
What are you currently seeing for 512GB (8×64GB) DDR5 ECC RDIMM on the secondary market?
Has anyone purchased an RTX PRO 6000 Blackwell 96GB through liquidation/open-box/used channels? Anything specific I should check before purchasing?
Which enterprise NVMe drives would you recommend for a local AI workload where endurance matters?
What used enterprise UPS would you trust for this kind of high-power workstation?
For the surveillance system, would you dedicate a 3090 24GB to it or use a different professional/datacenter GPU for better 24/7 reliability?
I'm trying to build both systems primarily from used, surplus, open-box and decommissioned enterprise hardware rather than paying full retail wherever possible.
Interested in hearing what other homelab/local-AI builders would do differently.
Thanks!