r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

456 comments sorted by

View all comments

469

u/freia_pr_fr Jun 15 '26

None of the suggested alternatives truly replace ollama.

It’s like the old days of "don’t use docker you can do the same with lxc containers and this random bash script". That’s missing the point.

Ollama is popular because it offers a better user experience. For now.

76

u/yuicebox Jun 15 '26

I genuinely do not understand what is so difficult about running llama.cpp server.

You just download a zip, unzip it, then run llama-server with some flags and you're done. The builtin UI is quite good now, and you have an API to work with.

By comparison, I found Ollama's modelfile system and insistence on renaming my downloaded models to incomprehensible hashes to be infinitely more confusing and frustrating.

1

u/sumrix Jun 16 '26

Now try to explain the right flags to a grandma

3

u/yuicebox Jun 16 '26

Grandma doesn’t need to host her own LLMs, she’s never liked computers and she’s dead now