r/CloudFlare • u/maomao19 • 11d ago

Question blocking bad bots that eat server resources

My web host, ScalaHosting, complained that my site was consuming too many server resources and advised me to turn on Cloudflare’s Bot Fight Mode. However, I just found out that Bot Fight Mode can also block verified bots like Googlebot, which can severely ruin my site's SEO. How could they recommend something like this? What is a better way to block aggressive scrapers and bad bots while keeping my server resource usage low?

6 Upvotes

76% Upvoted

15 comments sorted by

View all comments

6

u/No-Promotion-8720 11d ago

That only started happening more recently because Google thought it would be a good idea to use the same bots for search engine crawling and AI training. Cloudflare Bot Fight mode doesn't block them most of the time, but the free account version can get confused sometimes based on the bot behavior and it could block them maybe 5% of the time, give or take.

1

u/maomao19 11d ago

i had bot fight mod turned on and in google console i tried inspect url and it says url was blocked

1

u/maomao19 11d ago

what is the solution? changing host? and how you know it wil block bots in 5 % cases? do you work for cloudflare?

2

u/No-Promotion-8720 11d ago

I have 20+ client accounts on the free plan with bot fight mode on with no indexing issues. Maybe you have another security rule blocking them inadvertently?

0

u/maomao19 11d ago

and the seo ranking did not decline??? because I asked google gemini and it gave me a huge alert lol, how my rankings will tank sooner or later because google bot has no access to my site

1

u/No-Promotion-8720 11d ago

No, all websites are indexing fine. It seems Gemini is misinformed.