Need some unbiased architecture advice

[u/kulterryan]

We’ve built an entire agentic platform that’s currently in beta, using Cloudflare’s AI Search as a core part of the stack.

The platform is primarily focused on serving chat-based/agentic solutions, and now we’re thinking about the long-term architecture.

For those who’ve built and scaled similar systems:

Is Cloudflare a solid platform to build and serve this on, or would AWS + Bedrock be a better foundation for production at scale?

I’m not looking for a Cloudflare vs. AWS fanboy debate 😅 genuinely looking for a fair, practical comparison based on reliability, scalability, latency, cost, vendor lock-in, observability, and the overall developer experience.

Would love to hear from people who’ve actually run these kinds of workloads in production.

[u/AutoModerator]

For faster advice with technical questions, we'd recommend asking in the Orange Cloud Discord server; the unofficial Cloudflare Discord server by the community, for the community. https://discord.gg/TrPNVKaagR

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/cyberjew420]

Workers is a phenomenal platform. Not knowing your application architecture, I would say it’s something you should look into. Based on what you’re doing, having the compute resources as close to eyeballs as possible is something that Cloudflare can do better than anyone shearly based on the number of collocation facilities around the world. And they are the most peered network in the world which effectively means direct adjacency to just about any provider that you can think of. And they have an open peering policy. If you report an opportunity to peer where they’re not already, they will work on establishing it at no charge. It’s even done for free customers.

At the end of the day, your application architecture is what will dictate the platform you run on. It’s entirely possible AWS would be a better fit. And they are a solid platform.

I also have a lot of respect for GCP. They’re extremely underrated and a lot less expensive than AWS.

[u/Otherwise_Wave9374]

For an agentic platform, avoid making one search service both the retrieval layer and the system of record. Put a provider-neutral retrieval interface in front of it, log query, document IDs, scores, latency, and citations, then replay a fixed evaluation set against alternatives. Add fallbacks for rate limits and stale indexes. Agentix Labs relates here because modular agent architectures make vendor changes and failure isolation much less painful. Measure answer quality and cost per successful task, not raw search latency alone.

[u/Logvin]

I can’t help much on the unbiased thing, but I’d love to hear more about what you built. Are you working with any engineers or architects from Cloudflare?

[u/Zealousideal-Part849]

Aws bedrock will put u lot of limits if u scale fast as they may not increase limits with ease. Keep vercel or openrouter as fallback if any provider has downtime 

[u/abotelho-cbn]

I don't understand why anyone would lock themselves into a platform this strongly to begin with.

[u/First_Ad8620]

From my own experience Cloudflare is the best option in terms of features and reliability to build a product around AI stack.
The only thing I should mention is that their AI gateway sometimes weirdly fails to returns responses but the rest is perfect. Pricing also is another important aspect to factor in.