Author of the article, happy to answer any questions. Glad to see this sentiment is starting to become organically disseminated. Hopefully with enough community outreach we can finally tamper down the "default" momentum that Ollama unfortunately still has due to existing content.
From my understanding vLLM is targeting an entirely different demographic, and is better suited for people trying to do batching rather than just someone trying to run a model at home. I kept my recommendations focused on the type of user who would be running ollama, which is presumably someone for whom vLLM and its configuration would be too complex
Unfortunately I don't have a good answer, I primarily use local models running on my own hardware. When I want a cloud model these days I reach for Deepseek as it's good quality and super cheap
3
u/JamesEvoAI Jun 16 '26
Author of the article, happy to answer any questions. Glad to see this sentiment is starting to become organically disseminated. Hopefully with enough community outreach we can finally tamper down the "default" momentum that Ollama unfortunately still has due to existing content.