WebGlean converts any URL to Markdown, JSON, or plain text — with full JavaScript rendering, AI-powered extraction, and dead-simple credit-based pricing.
6
APIs available
< 3s
avg. response time
5
output formats
500
free credits to start
Trusted by developers building with AI
6 endpoints
One API key. One credit system. Pay only for what you use.
Scrape
Convert any URL to Markdown, HTML, JSON, or plain text. Full JS rendering via Playwright.
Crawl
BFS-crawl an entire site. Set max depth and page limits. Returns all pages as Markdown.
Extract
Scrape a URL then use Claude to pull structured JSON matching any schema you define.
Map
Discover all discoverable URLs on a site. Tries sitemap.xml first, falls back to BFS.
Monitor
Register a URL for change detection. Get webhook notifications when content changes.
Search
Search the web and get scraped Markdown for each result — ready for your LLM.
Built different
Designed around developer experience and AI pipeline needs from day one.
Persistent browser pool
No cold Chromium starts. Playwright runs in an always-on worker so your requests return in 1–3 seconds, not 5–8. Every scrape gets a warm, authenticated browser.
AI-native from day one
The Extract API uses Claude to pull any structured schema from any URL — no XPath, no CSS selectors, no custom parsers. Describe what you want in JSON and get it back.
Pricing that makes sense
One credit per page, across all endpoints. Credits never expire and never reset. Top up without upgrading. No per-endpoint pricing, no seat fees, no surprises.
Content Cleaning
Mozilla Readability strips nav, ads, footers, and cookie banners. Your LLM gets signal, not noise.
5 Output Formats
Markdown, HTML, plain text, JSON metadata, and screenshots — one call, any combination.
Simple API Key Auth
One key covers all 6 endpoints. SHA-256 hashed, shown once on creation, revokable instantly.
Rate Limiting Built In
60 req/min per key by default. No extra config. Higher limits on Pro and Scale.
Webhooks
Monitor registers a URL and POSTs a diff to your endpoint when content changes.
Site Mapping
Map tries sitemap.xml first — falls back to recursive link extraction. Returns every discoverable URL.
Live demo
Paste any URL and see clean output in seconds.
Pricing
Credits never expire. Top up anytime without upgrading.
Need more? Top-up packs: $10 = 1,000 credits — available on any plan, no upgrade required.
Everything you need to know before you start.