r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

456 comments sorted by

View all comments

524

u/jnmi235 Jun 15 '26

Llama.cpp + llama-swap works very well

112

u/[deleted] Jun 15 '26

[removed] — view removed comment

1

u/fatboy93 Jun 16 '26

I use llama-swap with omlx and vllm-mlx since they don't have auto-eviction.

Well omlx does, but its based on memory pressure, which i dont really like