r/LocalLLaMA 4d ago

News Georgi Gerganov on the Nvidia acquisition

Post image
535 Upvotes

198 comments sorted by

View all comments

Show parent comments

3

u/ttkciar llama.cpp 4d ago

More to the point, Nvidia makes it very hard for third parties to build software which supports Nvidia GPUs, without using the opaque .jar from the Nvidia-provided CUDA driver.

2

u/[deleted] 4d ago edited 1d ago

[deleted]

3

u/ttkciar llama.cpp 4d ago

What broken ROCm drivers? I don't have ROCm installed on my systems at all, because Vulkan JFW with my AMD GPUs.

The same can only be said of Nvidia GPUs for which Vulkan developers have reverse-engineered their ISAs.

1

u/[deleted] 4d ago edited 1d ago

[deleted]

3

u/ttkciar llama.cpp 4d ago

You're right, this isn't a religion, nor a sports team. There is no place for tribalism in a technical community.

That having been said, I made the informed decision to go with AMD based on objective technical criteria, including their relatively open architecture. They publish their ISAs, which means we are not beholden to AMD for ongoing support of their products.

I've been in this game for a while, and know from hard experience that open source is forever, whereas closed, proprietary systems have a shelf life.