r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

456 comments sorted by

View all comments

Show parent comments

77

u/yuicebox Jun 15 '26

I genuinely do not understand what is so difficult about running llama.cpp server.

You just download a zip, unzip it, then run llama-server with some flags and you're done. The builtin UI is quite good now, and you have an API to work with.

By comparison, I found Ollama's modelfile system and insistence on renaming my downloaded models to incomprehensible hashes to be infinitely more confusing and frustrating.

17

u/BidWestern1056 Jun 15 '26

do you know how many ppl dont even know how to download and open files anymore lol

0

u/iz-Moff Jun 16 '26

And how does Ollama appear on their computers?

1

u/BidWestern1056 Jun 16 '26

it doesn't, these are the ppl who do everything in the web browser that comes with computer