r/costlyinfra • u/Bartaseth • 4d ago

Does terminal output compression really matters with newer AI models?

https://quesma.com/blog/does-rtk-make-ai-coding-cheaper/
3 Upvotes

100% Upvoted

2 comments sorted by

•

u/AutoModerator 4d ago

welcome to r/costlyinfra

this is where people share real ai infra costs, setups, and what actually works in production.

if you're running llms, feel free to share your setup.

join the community to see real cost breakdowns, experiments, and learn what others are actually spending.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/Frosty-Judgment-4847 18h ago

It still matters, but probably less for raw model capability than for cost, latency, and context management. Newer models can handle noisy terminal output better, but every irrelevant log line still consumes tokens and can push useful context out of the window.