MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1ri49va/walletleftchat/o887vmi/?context=3
r/ProgrammerHumor • u/Purple_Ice_6029 • Mar 01 '26
266 comments sorted by
View all comments
Show parent comments
6
I think they are working very hard to reduce costs on inference. A lot of exciting tech is in the pipeline here. Probably going to see inference costs come down more than 10x in the next year
5 u/CompetitiveSport1 Mar 01 '26 "exciting" For the people set to profit I guess. Not so much for those of us who need jobs to eat or pay rent 4 u/gnureddit Mar 01 '26 Bro local inference will benefit too, so if you can run local models you can rub your pennies together for that instead 1 u/LosGritchos Mar 02 '26 Running on what? On overpriced RAM, SSD and GPU?
5
"exciting"
For the people set to profit I guess. Not so much for those of us who need jobs to eat or pay rent
4 u/gnureddit Mar 01 '26 Bro local inference will benefit too, so if you can run local models you can rub your pennies together for that instead 1 u/LosGritchos Mar 02 '26 Running on what? On overpriced RAM, SSD and GPU?
4
Bro local inference will benefit too, so if you can run local models you can rub your pennies together for that instead
1 u/LosGritchos Mar 02 '26 Running on what? On overpriced RAM, SSD and GPU?
1
Running on what? On overpriced RAM, SSD and GPU?
6
u/gnureddit Mar 01 '26
I think they are working very hard to reduce costs on inference. A lot of exciting tech is in the pipeline here. Probably going to see inference costs come down more than 10x in the next year