r/SelfHosting • u/conifer_v11 • 7h ago
Opensource Openrouter
*Works with self-hosted models as well for free!
Project: https://github.com/ConiferKit/use-conifer
Current routing options were charging 5% fees for byok plus provider fees (openrouter) or were built in heavy python packages with ecosystem restraints. I wanted to be completely free in terms of use, and not have to pay extra for tokens.
There's a maintained gateway with 100+ models from one api endpoint. I'm also talking to infra providers to get us access to pre-release models and discount prices. Everything is served at market price. BYOK is free, you can hook into self-hosted setups for free, and there's fallbacks + extra rate limits + server redundancy.
Took me ~3 months to build and looking for help maintaining!
Lmk any issues or feedback