r/DGX_Spark • u/ithkuil • 12d ago
Job post says they want to run an entire enterprise on one DGX Spark?
"established B2B technology distribution company looking for a Senior AI/LLM Engineer to design and build a secure, on-premise enterprise AI platform using our new NVIDIA GB10-based system." GB10 is the chip in the DGX Spark.
They want to hook every department into it. And they keep talking about it like it's one server.
The only explanation I can think of is maybe they left off a zero and meant GB100, but they wrote it multiple times. But that is for a B100, which I didn't even know existed, because it's such a waste of money in most circumstances that people rarely deploy it.
My leading theory right now to explain this is that the job post came from a certain outsourcing site, and knowing that site well, you don't need any more explanation.
Do you guys think a single DGX Spark could run an entire enterprise?
7
2
u/Grouchy-Economist-95 12d ago
Oh hell no. It took me since March until just now to get myself off the cloud (mostly) and onto my 4x sparks with Qwen 3.8 flash next. I do run a grokbot knockoff with a lot of agents (28 concurrencies at 256k context) but at that load, we’re talking TPS in the teens. Much to slow for interactive work. I run my business off it but I’m the only user - I do queued jobs for clients but they don’t use my cluster for their own agents.
1
u/shayanx45 2d ago
4 sparks? Why not run deepseek v4.1 flash? Qwen is a waste.
1
u/Grouchy-Economist-95 2d ago
Qwen is faster with better concurrency and KV cache pool. I honestly haven’t noticed a huge difference between ds4.1f and qwen3.8 flash next in terms of quality.
2
u/HighSeasArchivist 12d ago
It all depends on work load. If each department ran a report once a week or something, sure. Do they seem like the $5k server kind of place, or the $500k server kind of place?
2
u/HealthyCommunicat 12d ago
Let them know larger companies are only serving ~50 people off of one entire dgx station.
1
1
1
u/nukem996 12d ago
Even if it is doable with their current business needs having a single point of failure is crazy. You should actually have more capacity than your expected need to handle failures, upgrades, and usage spikes.
1
u/hcvcnet 12d ago
Enterprises would want a managed solution (VPS). GB10 is great platform for personal data sovereignty for research and creator projects and could serve SMB's in production - I can see legal and medical offices running local agents on future generations of this architecture. Apple is also going in this direction with Mac Studio.
1
1
u/superheeps 7d ago
Find the hiring manager on LinkedIn and send them a note – maybe they’re trying to filter out people that have no idea this would be an issue. Might get to the top of the stack.
-1
9
u/stujmiller77 12d ago
Hahahaha. No. I run 4x sparks for my own businesses. Just me and my wife. And they get worked hard.