Does Ollagraph store my scraped data like Crawlbase's storage option?

No, and that's deliberate. We return your results and keep only URL-level metadata for your usage and observability — the scraped content itself is never persisted. If you need the vendor to hold a copy of crawled pages, Crawlbase's storage is the better fit; if you'd rather it never be retained, that's our default.

Can Ollagraph crawl whole sites like Crawlbase?

Yes. The crawl endpoint walks a site within depth and budget limits, obeys robots.txt, and delivers results to a webhook — comparable to a managed crawler, returned to you rather than stored on our side.

How does pricing compare?

Ollagraph prices in credits — 1 per call, refunds on failure — with pay-as-you-go from $5 and 1,000 free credits. Compare against Crawlbase's current plans on their pricing page.

Ollagraph vs Crawlbase — honest comparison

Crawlbase (formerly ProxyCrawl) pairs a scraping API with crawling and optional result storage. Ollagraph overlaps on scraping and crawling, adds intelligence and agent tooling — and deliberately does not retain your scraped content.

What Crawlbase does well

Crawlbase offers a mature scraping and crawling API with a large proxy pool, plus optional cloud storage and a screenshots API. For teams that want crawling plus managed storage of results in one vendor with a long track record, it's a capable option.

Where Ollagraph goes further

No content retention, by design. Ollagraph returns your data and keeps URL-level metadata only — we don't store the scraped content itself. That's a deliberate privacy posture, not a missing feature.
Structured output for LLMs. Clean markdown plus JSON-LD / OpenGraph extraction in the same call.
Domain intelligence. DNS/WHOIS/SSL/enrichment alongside the crawl.
Agent-native. Browser automation with natural-language actions and a Model Context Protocol server.

Side by side

Feature	Crawlbase	Ollagraph
Scraping API with proxies	Yes	Yes
Full-site crawler	Yes	Yes
Managed storage of scraped results	Yes (optional)	By design, not stored
Clean markdown output for LLMs	Not native	Native
Domain intelligence (DNS/WHOIS/SSL)	Not offered	Included
MCP server for AI agents	Not offered	Included
Free to start	Trial	1,000 credits

Who each is best for

Choose Crawlbase if: Teams that specifically want managed cloud storage of crawled results inside the same vendor, plus a long-established proxy pool.

Choose Ollagraph if: Teams who want scraping plus intelligence plus actors plus automation — and who prefer that their scraped content is never retained by the vendor.

Sources & further reading

The standards behind every tool in this comparison, for readers who want the primary sources rather than our summary of them:

Web scraping (Wikipedia) — the category these tools operate in, with its technical and legal background.
RFC 9309 — Robots Exclusion Protocol (IETF, 2022) — the robots.txt standard a responsible crawler honors.
JSON-LD 1.1 (W3C Recommendation) — the structured-data format these tools extract.
Retrieval-Augmented Generation (Lewis et al., 2020) — the AI pattern most of this web data ultimately feeds.

Ollagraph vs Crawlbase