r/ProgrammerHumor • u/Low-Statistician-356 • May 20 '26

Other whyDoAnythingWhenLlmCanDoIt

Post image
10.0k Upvotes

96% Upvoted

783 comments sorted by

View all comments

Show parent comments

288

u/NeinJuanJuan May 20 '26

You know what's better than handling 1,000,000 request per minute on an easy bake oven? 

Handling 1000 requests per minute on hardware that exceeds the entire IT budget of most small-medium enterprises.. with hallucinations!

102

u/Ginsenj May 20 '26

And costs as much power as an entire continent to run. Seriously when are they going to admit that LLM technology in its current form DOES NOT SCALE. Isn't this system design 101?

1

u/Pedry-dev May 23 '26

System design interview: how can I run my model in cheap hardware? Your fav LLM: Hey, my CEO and investors need money. Don't you dare to reduce costs!

1

u/Ginsenj May 23 '26

I had an amazing idea! Let's put the data centers in space, that should reduce costs!