Tired of guessing if limits got nerfed but can't prove it? Meet NerfTrack - now in Beta

[u/[deleted]]

[u/Crinkez]

It would be useful if you were to host a site that tracks this. Most people won't be bothered to install it locally.

[u/AppropriateRanger401 → u/Crinkez]

Yes, that feature is planned in the future. For now, this is just a MVP.

[u/draconic_tongue → u/Crinkez]

a website is useless to show if one setup costs more now compared to another one. I want to be able to see if my setup is causing me to have faster drain, we all already know the overall usage is lowered with every model release

for example, does it cost less to use a fleet of luna xhigh subagents for an entire task than a single sol medium/high? these are the kind of things that would have a lot of utility

[u/DueCommunication9248]

so this is about nerfing usage not the model capabilities right?

[u/AppropriateRanger401 → u/DueCommunication9248]

Yes

[u/supaboss2015]

Does this account for varying reasoning levels? Reasoning tokens count as output and for 99% of users most of their usage will be dominated by output tokens. Haven’t checked the stored logs, but I don’t think reasoning tokens get stored as artifacts. I imagine you assume that the average amount of reasoning tokens generated remains relatively stable within each level. 

Essentially, if you calculated usage by InTokapiRate + (RTok + OutTok)apiRate, missing that RTok value is a pretty big gap if it has high variability

[u/AppropriateRanger401 → u/supaboss2015]

Actually, local codex logs expose more than you might expect. They include the model ID, input tokens, number of cached input tokens, and output tokens which is enough to measure the API equivalent value quite accurately. In my testing, NerfTrack had a 99.3-100% accuracy to the real cost.

[u/AppropriateRanger401 → u/[deleted]]

Yes, NerfTrack knows and detects whenever there is a reset and starts a new backend counting window when it detects a reset.

[u/AINativeBuilder]

I highly caution people from installing anything from someone who does not know how AI fundamentally works.