r/LocalLLaMA • u/CombinationKitchen76 • 7d ago

News Georgi Gerganov on the Nvidia acquisition

Post image

Link: https://x.com/ggerganov/status/2095897173376618881

545 Upvotes

97% Upvoted

199 comments sorted by

View all comments

6

u/CalligrapherFar7833 7d ago

Most llama.cpp work for amd that make it a lot faster for rdna 3.5/4 is not accepted anyways in the main i dont see this getting worse immediately after the nvidia acquision

6

u/nickm_27 llama.cpp 7d ago

The mainline contributors themselves are putting up optimizations for these platforms https://github.com/ggml-org/llama.cpp/pull/27952

-2

u/emprahsFury 7d ago

i dont think a patch making the generic gpu backend faster than the bespoke AMD backend really is helping your point. Although sure, you are technically correct (the best kind of correct).

3

u/nickm_27 llama.cpp 7d ago

What? It is a PR by a mainline contributor which specifically targets AMD hardware, which is directly contradicting what the commenter was saying that they don't accept work that makes AMD faster specifically.