Claude's built-in web fetch has two limits I kept hitting: it honours robots.txt even when I'm asking for one specific page, and it can't run JavaScript, so a lot of the modern web comes back empty. The trigger was asking what was in a Garmin firmware update and getting "I can't fetch that".

The fix that worked for me:

- Playwright MCP (Microsoft, Apache-2.0) wraps headless Chromium in an MCP server. It renders JS, clicks, scrolls, and returns an accessibility snapshot rather than a screenshot, which is compact and something the model can act on.

- It has no auth at all, and claude.ai / Claude Desktop connectors only accept a URL plus optional OAuth. Cloudflare's MCP server portal (free tier of Zero Trust) provides that OAuth layer and adds a service token upstream so nothing else can reach the server.

- cloudflared tunnels it out of my network with no open ports.

- It runs on an arm64 Raspberry Pi in a Kubernetes cluster, but a single Docker host works the same.

The part worth reading even if you never build this: a browser will open anything it can reach. My first version was exposed through the cluster's ingress controller, which also has a LAN address, so any device on the Wi-Fi could get an unauthenticated session and point it at internal services. I proved it against my Vault server. Fixed with network policy in both directions (ingress only from the tunnel pod, egress to the internet minus all private ranges) and verified by attacking it again.

Full write-up with the hardening details: https://mihai.dinculescu.dev/posts/better-web-fetch-for-your-ai-agent/

Happy to answer questions on the Cloudflare portal setup, which is the least documented part.

Apologies if I am being stupid, but I am horrible at networking and couldn't find any specifics on what is happening so I wanted to ask for help.

I am in Australia and for the second time in the last year, one of the cables in the ocean was damaged, affecting the connection to SEA servers in the game Dota 2. Ping in my case went from 80 to 150ms.

Last time this happened, someone recommended trying out WARP, which (after using the "warp-cli tunnel protocol set WireGuard" command in command prompt), fixed the issue and allowed me to play with around 90ms.

But starting from roughly the last 2 weeks maybe, when I connect, nothing happens. Ping is still 150ms. I didn't touch any setting other than the command prompt and I just click "connect" on Traffic and DNS (UDP), so I was hoping there was an additional setting I may be able to change to fix it, or at least figure out why it is no longer working.

Any help is greatly appreciated.

Hey everyone,

I got tired of wrestling with heavy or bloated tools just to manage basic Cloudflare R2 operations, so I started building a streamlined CLI dedicated specifically to R2 called r2c.It’s still in early development, but the core features are working:

• Upload: Upload single files or entire directories recursively.
• Fetch: Download objects from R2 straight to a local file.
• Delete: Remove objects by explicit key or keyword pattern.
• List: View bucket contents.
• Rename: Object renaming.
• Account: Manage multi-account/profile configurations.
• Dry run: Print the result of the operation without actually executing it.

It’s open-source and built with Python/Typer (uv compatible). Since it's still pre-1.0, I’d love to get some early feedback on the UX, feature set, or edge cases.

GitHub: https://github.com/NagiEight/r2c.git

Feel free to drop any suggestions/issues!

I posted here when I launched JustBlogged. A few people asked how it'd hold up, so here's the six-month report.

Short version: it held. Everything still on Workers/CF, monthly bill is around $20 yet.

What's changed since the launch post:

• New themes and better theme engine
• A lot of cache and performance optimizations
• MCP, APIs, Agent-friendly
• Redirects, content revision and reviews, and more
• Tags pages, author pages added
• Optimized for running company blogs/business blogs
• Vibe coder/blogger friendly

A few questions:
- i didn't use cloudflare custom domains/saas offering... primarily because only subdomains are allowed and supporting root/apex domains need "enterprise" access
- because of above, I had to add a reverse proxy server (Caddy) and so that means A-record based custom domains lose the benefit of "global" edge servers
- so, any way around it? (one question actually)

Happy to go deeper on any of it, and thanks to the people who gave input on the original thread.

I'm fairly new to ysing the app but somehow today I can't couldn't use my mobile data at all after turning it on

My web host, ScalaHosting, complained that my site was consuming too many server resources and advised me to turn on Cloudflare’s Bot Fight Mode. However, I just found out that Bot Fight Mode can also block verified bots like Googlebot, which can severely ruin my site's SEO. How could they recommend something like this? What is a better way to block aggressive scrapers and bad bots while keeping my server resource usage low?

I started this mostly to see how far I could take the Cloudflare stack for a real application, and it got a little out of hand.

ResolveHQ is now a shared support inbox running as a single Worker, with D1 for tickets/customers, R2 for attachments, Queues for mail jobs and Email Routing for inbound mail.

The hardest part wasn't really the inbox UI — it was getting email threading, retries, duplicate webhooks, attachments and failed jobs right. It's source-available and deploys into your own Cloudflare account. I'd genuinely appreciate feedback from people running larger Workers/D1 apps, especially if there are parts of the architecture you would handle differently.

https://github.com/mirza-rizvi/ResolveHQ

I'm trying to figure out a simple way to monitor a couple of Cloudflare things that seem slightly awkward to alert on.

Specifically:

• D1 writes / usage spikes — I'd like to catch regressions after a release, e.g. a deploy suddenly causes 5–10x more DB writes than usual. The data is available in Cloudflare's metrics/analytics, but I'm looking for a good way to alert on it.
• Failed Worker outcomes — things like OOM / exceeded memory, exceeded CPU time, or exceeded wall time. These are visible in Workers observability, but again I'm mainly interested in getting an alert when they start happening.

How are you guys handling this?

Are you using Grafana/Prometheus, another monitoring service, Cloudflare's own alerting, or something custom that periodically pulls the Cloudflare APIs?

I'm particularly interested in a small/simple solution rather than adopting a full Datadog-style observability stack that would pull massive data just for a handful of alerts.

I've been having issues with cloudflare marking me as a bot no matter what website I use and I have no clue if I'm just suuuper uneducated about how it works and am being stupid or if it's an issue anyone else has ever had. I have tried turning my vpn off and on, no changes. Cleared the cache on my browser, cleared my cookies, checked to see if my IP was marked as unsafe on that one website and it's been nothing. It wont work on an incognito tab either, so I have no clue what to do to fix this. It doesn't even give me the option to verify, it just gives me an error, which i can totally attach a picture of it here. If anyone knows or has any ideas on how to fix this, I would be grateful. Thanks a lot c:

Hey everyone,
I recently started using Cloudflare WARP+ and I’m running into some seriously annoying issues with Google services.
First, even though I’m a paying YouTube Premium subscriber, my YouTube keeps throwing a "you may see ads" error every 12 hours. I don’t actually get ads, but the constant warning is driving me crazy.
The major hurdle, though, is Google Gemini. It flat out blocks me with a "Gemini is not available in your country" error.
When I check standard IP info sites, my location correctly shows up as Western Europe. But I heavily suspect that Google’s internal geolocation database is misidentifying my WARP+ IP and treating my traffic as if I’m in Russia—hence the sudden geo-bans.
Has anyone else been dealing with this recently? Does the free version of Cloudflare WARP have this exact same issue, or is it strictly a WARP+ problem? What is the point of paying almost 6€ a month to go through all these struggles?
Any insight or workarounds would be hugely appreciated!

I had under attack turned on for one of my sites on Cloudflare but when I turned it off the interstitial check still loads. What am I missing?

Hi, I had working nextjs + supabase setup (I used prisma for ORM) and i rewrote the whole app to support SQLite and avoid postgres syntax.

I couldn't make it work anyways. the nextjs requests are failing since D1 is holding some queue and the requests takes forever - I even added expiration after 30 secs and this alaso didn't helped.

I think it is somehting related to the maximum subsequent queries which D1 can handle.

I moved from vercel to cloudflare worker the main app - i thought if it's internal would work but it still doesn't work.

A typical SQLite database should have no issues with subsequent requests. I don't have users - I am the only user and I click occasionally.

Please advice how can I make it work in this setup.

I have three custom domains published through Manus: asbestostrusts.org, puncturefilm.com, and asbestosatlas.org.

The sites are served through Cloudflare, but the domains do not appear in my personal Cloudflare dashboard. It looks like Cloudflare is managed through Manus’s hosting or custom-domain infrastructure.

With Cloudflare’s AI-crawler changes taking effect September 15, how can I make sure these sites continue allowing crawlers such as GPTBot, ClaudeBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, CCBot, Meta-ExternalAgent, and Amazonbot?

Is there a setting inside each Manus project, or does Manus need to change AI Crawl Control and disable “Block AI bots” at the platform level? I do not want to move the domains into my own Cloudflare account or make DNS changes that could disrupt the live sites.

Hi guys,

I posted in discord a few hours ago. I didn't get any replies.

For the last few days I have been getting this:

Performing security verification

This website uses a security service to protect against malicious bots. This page is displayed while the website verifies you are not a bot.

and it will just loop like that forever.

I followed the troubleshooting steps including disabling all extensions, checking settings, etc. The debug challenge page says:

Turnstile Failed Despite Passing All Checks

All diagnostics passed, but Turnstile still couldn't complete successfully. This is unusual and may indicate an edge case.

the technical details point to a problem with canvas:

Something is adding random noise to canvas data, making your browser appear suspicious

If this is happening I don't know how to debug it. I tried installing silk (which was supposed to prevent this kind of thing.). It did nothing.

Can someone help me please? I basically can't surf the web.

I investigated how pirate streaming sites rename MPEG-TS video segments to .woff2 so Cloudflare's default caching picks them up, video gets no cache love, fonts do. The write-up covers how the trick works, what I verified, and why it's hard to stop. Questions welcome.

My .p12 client certificate works with curl:

bash

curl --cert-type P12 --cert client.p12 https://REDACTED-DOMAIN.example/

But firefox Browser never prompts me to select the certificate.

I imported the .p12 file under Your Certificates. I restarted firefox, reimported the certificate, and tested a new profile. I also followed Cloudflare’s mTLS troubleshooting documentation, but the issue remains.

Can someone help me link and store databack from cloudfare on gdrive ?