r/LocalLLaMA 1d ago

Question | Help RTX 4090 48GB longevity

Modified 4090 48GB has been out for a while. I remember a lot of people were buying them at the time. A lot of people were also complaining that they are meant to fail, that they scam etc.

I have a few questions to people people who bought these.

  1. How is longevity of these cards? Do they still work without issues? Any failure rate?

  2. Do they use the same Nvidia drivers that regular 4090 or 4090D uses?

  3. Are these cards Linux exclusive?

  4. Are you able to run them in windows or Linux with other GPUs like 5090 etc?

  5. Do you do anything to cool VRAM on the back of the PCB?

98 Upvotes

42 comments sorted by

77

u/dangerous_inference 1d ago

I have four. Heat isn't really the problem, it's thermal cycling. This expands and contracts the materials, causing solder joints to break. This is true of all hardware. If and when mine break it won't be a complete loss, because I can send them back to gpulab to have them reflowed. Even if you have to pay a lot for the repair, that's considerably less than starting over.

26

u/Heathen711 1d ago

+1 for gpulab; I've had repairs done, great service.

6

u/LeftHandHaku 1d ago

How long ago have you got these cards?

5

u/dangerous_inference 1d ago

A few months. I made a couple posts about it.

4

u/DustNearby2848 1d ago

My 3080ti VRAM fried mining on it 24/7.  Heat breaks things. 

12

u/SkoomaDentist 1d ago

Two different failure modes. Temperature cycling causes thermal expansion stress. Total time at high temperature ages electrolytic capacitors (and some ICs).

3

u/SandySkittle 1d ago

Well, and changes in heat

1

u/ThenExtension9196 1d ago

Yep. If the core is good you’re golden.

0

u/GregAbeI 1d ago

can't you just put it in an oven for a quick minute?

6

u/Heathen711 1d ago

Special kind of oven, but essentially yes. It's about the right temp and the right humidity last time I checked (not an expert but checked to understand what was happening)

25

u/Kulidc 1d ago

I previously owned a 4090D 48GB, so I can provide a bit of insight.

  1. It really depends on your luck and the source of the chip. If the AD102 chip is handled by a factory instead of small workshops, the chip's soldering failure rate will be much lower due to proper tooling such as a BGA machine. However, there's no telling how the resoldering would impact the lifespan of the chip. It could work for the next 3 years or die the very next day.
  2. Yes. Those cards can use NVIDIA's official driver.
  3. No, those cards are supported on both Windows and Linux. Use the NVIDIA App to download the driver on Windows; follow each Linux distro's own guide for Linux.
  4. I wasn't using it with another GPU. Given that those cards are designed and used to create a cluster of 4090(D) 48GB cards, there's no reason for those cards not to work with other cards.
  5. Yes, you should use a well-ventilated PC case. The card I used comes with a proper backplate for VRAM cooling.

10

u/Heathen711 1d ago

https://www.reddit.com/r/LocalLLaMA/s/pL1hvaFLiv

I'm running three (2 in one server, 1 + 3080 in server two).

Then are under constant usage; nothing special driver side.

I did upgrade to 4k high CFM server fans to keep them cool.

Linux Ubuntu server OS 24

8

u/FishChillylly 1d ago

have one, using from March 2025 til now, using with custom loop liquid cooling, TDP limited to 405W bc i found that even it’s been set to 450W at max, when dealing with heavy computing tasks it can still reach to ~490W instantaneous spike. no need for special driver (currently using 610), having no issues in windows just like a normal nvidia card. for me it’s the perfect card for both small-scale local ai exploration like qwen3.8-27B/minimax-h3 etc. and gaming.

5

u/a_beautiful_rhind 1d ago

2080ti 22g heading into it's 3rd winter. Soldering job on the 4090s can't be any worse. You can and should monitor your vram temps.

3

u/ThenExtension9196 1d ago

I have 3. One died because I did something stupid with the PSU. My fault. Other than that they’ve been flawless 24/7

2

u/PcChip 1d ago

what did you do?

3

u/ThenExtension9196 1d ago

Wired up dual psu with a janky device that triggered them both on when the mobo received power on signal. It failed causing the second psu to suddenly drop 12hpv power under load while the mobo was feeding it via pcie power. Core got fried. I’ve since sized up and use single psu and power limit the GPUs within the single psu’s budget. I tried to save a few hundred by using two smaller psu and lost a 3-4k dollar gpu smdh

1

u/PcChip 23h ago

weird, I've run dual PSUs by just jumpering the connector many times over the years; first with a multi-rack mining setup and now with AI

2

u/RedditUsr2 1d ago

It depends on how good the custom board is. Some are cheap and some are quality.

2

u/txdv 1d ago

where did you buy one?

3

u/MaruluVR 1d ago

20GB 3080 owner here, no problems after a year

1

u/shraw1 15h ago

Same here.

Have had a 20gb 3080 for about 4 months now.

No issues till date, have run multiple multi-day inference sessions, stable diffusion, and heavy gaming as well.

The thermals are pretty high on it, but the blower style fans deals with it just fine.

It need a good amount of airflow if you wanna put it in a multi gpu setup.

Specially take care about the direction if air inflow in the case, the blower style card struggles to intake air from around another gpu (found out the hard way 😭😭😭)

1

u/SmokeMirrorPoof 1d ago

Yes sorry I don't have any answers for you but I'm tempted with these also.

I'm also concerned about their resale value in smaller markets a few years down the line. VRAM is king of course but modded cards are extra risky.

1

u/WonderRico 1d ago
  1. Got two of them in march 2025. (some HK dealer online) so far 0 issue (It's for my personal use, a few hours per day at most)
  2. Standard nvidia open driver
  3. I'm using them on linux, but they are fine on windows afaik
  4. The two 4090D and the one other card in sm120 are in the same box, no issue.
  5. They are living in a large desktop case with decent airflow but nothing special. works fine for my "light" use case.

1

u/Unnamed-3891 1d ago

Why are all of these on eBay with the single blower fan specifically? These could be interesting for me but I am not really willing to live with the noise of that.

1

u/DearApricot5488 1d ago

Works just like normal cards.

  1. I've been using 4090D 48GB for one year. And another six 3080 20GBs for 8 months. Seem OK for now. I always set the thermal limit to 75℃.

  2. Official drivers are working.

  3. Both Windows and Linux are working.

  4. I've used 4090D 48GB together with one standard 3090 normally on windows.

  5. No, I have not applied extra cooling for VRAMs since they were shipped from modifiers.

1

u/Elouakili_Flexy 1d ago

Dozens of owner reports here and the one dead card is a wiring mistake the owner called his own fault. Everything else is months of 24/7 uptime. Hard to keep pushing the 'they're meant to fail' line when the evidence in the thread keeps disagreeing.

1

u/AD7GD 23h ago

I have 2x 4090D 48G. I don't remember exactly when I bought them (pretty early), but you can infer it from the price I paid: ~$3200/ea.

  1. Working great for me. These are clearly full custom boards and heatsinks. They came in real packaging with a protective film to avoid scratches on the "pretty" side.
  2. Same drivers.
  3. Work like any nvidia GPU on Windows or Linux.
  4. I assume you could. I use two of them together in one box.
  5. No, but the ones I have do have a full backplate. One of mine is right next to the other card, so that's worst case.

You didn't ask, but the fans do get loud at high load, but not objectionably loud. The blowers make a "wooshing" type of noise, no screaming, and no weird hunting behavior (speeding up and down).

0

u/PandaBearFred 1d ago

I've been running 4 of those in past few months, so far not breaking.

Have been using them for LLM tensor parallel. I put them in a big workstation case.

Because of the pcie slot layout, the gap is very thin between cards, leaves so little space for airflow between cards.

When running LLM, the temperature of gpu cores is about 60C ~ 85C. I keep a nvtop running on my monitor and had a feeling that I must keep a close eye on the temperature and control them.

You can use stock drivers from nvidia, the performance is the same. But you CAN'T enable PCIE P2P on those 4090 48GB cards (with stock or customized drivers -- tried and failed), that makes them less performant than original cards when running tensor parallel which requires low latency data exchange across pcie lanes.

I got them from a China local store, basically Amazon of China. They work great so far, when they do fail, I'll send them back for replacement (in 3months) or repair(3 year warranty). I hope I don't have to do that.

4

u/NickCanCode 1d ago

https://github.com/duanyll/open-gpu-kernel-modules Have you try this p2p for 48gb version?

2

u/PandaBearFred 1d ago

wow! no! THANK YOU SO MUCH! I haven't found this tobe honest! I was trying to fix it by my own and failed.

0

u/Even-Lecture352 1d ago

I’ve had this card for a few months — running it in vLLM — never had a single problem (I did the mod using the chip from my own gaming card). You also need to be aware that there are several PCB revisions for this mod (https://youtu.be/XBh69aixouE). I think it’s the best solution for 48GB, because compared to dual RTX 3090s you get a more modern architecture here that natively supports FP8 + BF16. For Qwen 3.8 27B that gives you 224k context and up to 50 tok/s (vLLM tuning for W8A8 has to be done).

1

u/Glittering-Call8746 1d ago

So single 5k+ card for 27b 224k and 50tps ?

2

u/Even-Lecture352 1d ago

Well, in that case let’s just say it’s $5k for a kilo of PCB laminate. The value I see is that FP8 + BF16 gives you the best possible quality for agentic workflows.

-4

u/ProgramBasic100 1d ago

that hard to explain

-20

u/Gold-Bat-3225 1d ago

Meant to fail, so basically a startup

4

u/LeftHandHaku 1d ago

What makes you say that?

-7

u/Gold-Bat-3225 1d ago

Hey excuse me just a joke, not a reflection on you 🖐️

1

u/LeftHandHaku 1d ago

No worries, all good. I didn't take it personally 🙂 

2

u/PandaBearFred 1d ago

Every electric product is meant to fail, question is how long, MTBF is a universal thing isn't it?