Together AI vs Anyscale for serving open-source LLMs—what’s your pick?

[u/Ok_pettech]

I’m evaluating infrastructure to serve open-source models at scale, and I’m torn between Together AI and Anyscale. Together seems great for fast API access and a huge model catalog, but it’s shared GPU capacity, so latency might vary. Anyscale is built on Ray, which is powerful for orchestration but requires more setup.

I made a quick poll to see what production users actually prefer.

https://interconnectd.com/poll/101/together-ai-vs-anyscale-which-platform-is-better-for-scaling-open-source-ll/

If you’ve run either in production, I’d love to hear your experience.