Overview - Outcrawl

Search finds pages. Use it to discover URLs, not to read one you already have (that is scrape). Every hit can optionally be rendered through the scrape pipeline in the same call, so you get clean content back instead of a link list to fetch separately. The rate is 5 credits per 10 results, pro rata on the number of results actually returned.

import { Outcrawl } from '@outcrawl/sdk';

const oc = new Outcrawl();
const results = await oc.search('outcrawl web infrastructure', { limit: 10 });
console.log(results.usage);

import asyncio
from outcrawl import Outcrawl

async def main() -> None:
    async with Outcrawl() as oc:
        results = await oc.search("outcrawl web infrastructure", limit=10)
        print(results.usage)

asyncio.run(main())

curl https://api.outcrawl.ai/v1/search \
  -H "Authorization: Bearer ock_YOUR_KEY_ID.YOUR_SECRET" \
  -H "Content-Type: application/json" \
  -d '{
    "query": "outcrawl web infrastructure",
    "limit": 10
  }'

Scrape

Already have a URL? Read it directly.

Crawl

Know the site, not the exact page? Walk it from a seed.