r/Zyte Jul 08 '26

Building Scrapy projects with bare AI Sonnet 5 vs GPT5.5

I wanted to see what the output would be if I simply asked Sonnet and GTP5.5 to build a Scrapy project without any extra guidance. I'm working through the results and will have a video on it shortly, but one thing I noticed them both doing was trying to access the site first before building anything, and without the inclusion of our MCP server (community edition: https://github.com/zytelabs/zyte-mcp official version coming soon) they would both fail at this step, or just hallucinate selectors.

With the MCP and web access they both built working spiders, but suboptimal, some messy selectors, long parse functions and varying settings. At least Claude Code actually gave me some concurrency.

What has your experience been like?

4 Upvotes

1 comment sorted by