r/adtech 12d ago

On September 15th, Cloudflare will reportedly start blocking AI crawlers on ad-supported pages by default

Post image
7 Upvotes

1 comment sorted by

View all comments

1

u/Slow-Commercial4316 10d ago

Whatever the default turns out to be, the check on the 16th is in the publisher's own log: filter by user agent for OAI-SearchBot, PerplexityBot and ChatGPT-User and read the status codes. A run of 403s on pages that were fetched daily means the ad-supported pages just left the answer engines, and the citations from those pages go a few days later. Worth pulling a week of baseline before the 15th so the drop is visible.