Skip to content
Siteoseo
Start free
Menu

Docs

Getting started

How to run your first crawl and exactly how money moves through your wallet. Every setting is in the crawl settings reference.

Your first crawl

  1. Create an account

    Sign up with an email and password at /signup. Your wallet starts with $1.00 of credit, enough to try a small site.

  2. Top up your wallet

    Open Wallet and choose an amount from $5. Payment is by card through Stripe and the credit appears as soon as the payment completes. While card payments are unavailable, the wallet asks our team for credit instead, and it appears once it's added.

  3. Start a crawl

    Choose New crawl, paste the start URL and set a URL cap. The form shows the most the crawl can cost before you start. Every other setting has a sensible default, listed below.

  4. Connect integrations (optional)

    In Settings, add API keys for AI prompts, link metrics or PageSpeed, save logins for sites behind a form, and connect Google for Analytics, Search Console and Sheets. Then switch those options on per crawl. See Integrations.

  5. Read the reports

    Progress updates while the crawl runs. When it finishes, the overview groups issues by category; open any issue to see the affected URLs, then any URL to see its inlinks and outlinks. The issue reference explains each one.

  6. Export to CSV

    Each report table has a CSV export of exactly the rows you are looking at, for spreadsheets or handing to developers.

  7. Download an XML sitemap

    From a finished crawl, download a sitemap built from its indexable pages. Large sites are split into files of up to 50,000 URLs with an index file.

  8. Schedule repeat crawls

    In Schedules, pick how often a crawl runs (hourly, daily, weekly on chosen days, or monthly) and the time zone; a custom cron expression such as 0 6 * * 1 works too. Each run is a normal crawl, paid from your wallet when it starts.

How billing works

Your wallet has a balance (money you have added, minus charges) and a held amount (reserved by crawls that are running). You can spend balance − held. The wallet's history shows each crawl as one line with what it was charged and the balance after, alongside every top-up.

  1. 1. Hold

    When a crawl starts we reserve the most it could cost: the URL cap at $0.25 per 1,000, plus each add-on you switched on at its full allowance (every URL for per-page add-ons, or the add-on's own page limit). If you cannot cover it, the URL cap is lowered to what you can afford.

    2,000 URLs, no add-ons = $0.50

    + rendering (2,000) + Lighthouse (25) = $2.60

  2. 2. Charge

    When the crawl finishes, fails or is cancelled, we charge for URLs actually fetched plus the add-on work actually done: pages rendered, pages audited, prompts run.

    1,500 × $0.25/1k + 1,200 × $1.00/1k + 20 × $4.00/1k = $1.66

  3. 3. Release

    In the same step, whatever was held but not charged is released and becomes spendable again.

    $2.60 held − $1.66 = $0.95 back

Example: a 2,000-URL crawl with JavaScript rendering and Lighthouse (page limit 25) switched on. It stopped after 1,500 URLs, 1,200 of them rendered and 20 audited.

What is and is not charged

  • Charged at $0.25 per 1,000: every URL that receives an HTTP request, internal or external, including each hop of a redirect. Images, scripts and stylesheets are not fetched or charged.
  • Charged per add-on, only when you switch it on for the crawl and only for work actually done: for example $1.00 per 1,000 pages rendered in Chromium. Every add-on rate is on the pricing page.
  • Add-ons that use your own API key (AI prompts, link metrics, PageSpeed) are also billed by that provider, directly to you. See Integrations.
  • Never charged: robots.txt requests, URLs blocked by robots.txt, exports, sitemaps, visualisations, crawl comparison and Google Sheets exports.
  • Interrupted crawls are settled too. If a crawl stops for any reason, you pay for what it did and the rest of the hold is released.

Prices and top-up amounts are on the pricing page.