Cockroach Crawler
Built to be the best AI crawler for governed agents.
What is Cockroach Crawler?
Give AI agents the web without handing them unrestricted network access. Cockroach Crawler is an open-source Node.js toolkit for static and rendered crawling, adaptive traversal, screenshots, PDFs, structured extraction, public GitHub and YouTube reads, MCP, Docker, and Cloudflare Workers. It returns Markdown, JSON, and evidence records through explicit origins, budgets, and runtime controls.
Screenshots
?
No comments yet. Be the first!
Real conversations about Cockroach Crawler on X
Post on X