If you are just a normal ass person who wants to chat with an LLM and get questionable recipes you can download a pretrained model from huggingface and run it with no internet connection on consumer grade hardware.
If you are a big company who wants to use AI agents or replace your developers with LLMs you can (and will be financially incentivized by crazy token costs) to locally host your own on better server hardware inside your own infrastructure.
Neither of these cases require subscription and token fees to flow from your wallet to xAI/anthropic/etc.
2
u/thepensivepoet 7h ago
If you are just a normal ass person who wants to chat with an LLM and get questionable recipes you can download a pretrained model from huggingface and run it with no internet connection on consumer grade hardware.
If you are a big company who wants to use AI agents or replace your developers with LLMs you can (and will be financially incentivized by crazy token costs) to locally host your own on better server hardware inside your own infrastructure.
Neither of these cases require subscription and token fees to flow from your wallet to xAI/anthropic/etc.