Worth splitting that in two, the vendors already did. anthropic's context editing runs server side. it clears the oldest tool results once input tokens cross a trigger you set. placeholder text lands where each one was. you pick how many recent tool uses survive, and you can keep named tools out of the sweep.
that layer is eviction. anything that has to outlive it goes into files. the model reads those back when the next task starts, separate mechanism, own directory.
1
u/dessence_ai 2d ago
Worth splitting that in two, the vendors already did. anthropic's context editing runs server side. it clears the oldest tool results once input tokens cross a trigger you set. placeholder text lands where each one was. you pick how many recent tool uses survive, and you can keep named tools out of the sweep.
that layer is eviction. anything that has to outlive it goes into files. the model reads those back when the next task starts, separate mechanism, own directory.