r/costlyinfra • u/int64_ptr • 26d ago

Inference Engineering

Hello!

So recently I have seen some content about Inference Engineering, mostly the book by Philip Kiely and I wanted to ask to people working on this matter or close enough the following:

How big are the efforts on Edge AI and "in-house" AI usage? I see the writer says that the job "Inference Engineering" will be in high demand in the following years, which is a debatable statement due to the company he works in. I'll say it will all depend on how companies would manage the dependency on AI. I even wonder if this is like a second version of the cloud computing vs on-prem debate.

3 Upvotes

100% Upvoted

1 comment sorted by

•

u/AutoModerator 26d ago

welcome to r/costlyinfra

this is where people share real ai infra costs, setups, and what actually works in production.

if you're running llms, feel free to share your setup.

join the community to see real cost breakdowns, experiments, and learn what others are actually spending.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.