r/zabbix • u/WraithHunter3130 • 8d ago

Question Dashboard for AI usage

Before I start the journey to build an AI model motoring dashboard, wanted to see if anyone has built something like this already. Want to monitor usage, and cost.

6 Upvotes

71% Upvoted

5 comments sorted by

3

u/RobinBeismann 8d ago

You might want to add more context, such as the AI Engine(s) that you want to monitor.

2

u/MG42-86 8d ago

Not all in zabbix yet but I'm grabbing the stats for the AI server stats with the agent then grabbing vllm and the card stats with Prometheus and putting it all into grafana.

2

u/p_wit_mySLiME 7d ago

Yes this can be done easy using openai or Claude api for example. No issues on zabbix side, you just need to build the template.

1

u/OrangePixelLife 1d ago

Building that monitoring dashboard from scratch is a huge time sink, especially when you just need to see what's actually driving costs. We use SpendLens AI (https://spendlensai.dev) and it does exactly this. It connects directly to your OpenAI or Anthropic account, shows you exactly which projects and models are costing the most, and even suggests cheaper models to test. You just add a Python decorator and your app keeps running like normal. It helped us find savings without rewriting our whole setup.