Skip to content
Siteoseo
Start free
Menu

Everything a crawl finds, and where you'll see it

32 checks and tools, all in the product today. Most are included in the crawl rate of $0.25 per 1,000 URLs; heavier work is an add-on you switch on per crawl and pay for only on the pages it runs on.

Start free with $1.00See the price list

Find what's broken

Every crawl checks status codes, links, titles and meta data, directives, canonicals and hreflang, then ranks what it finds by how much it matters.

Example crawl overview: the top issues, most serious first, with the number of URLs affected.

  • Page titles and meta data

    Missing, duplicate, too long or too short titles, meta descriptions and H1s.

    Included

  • Meta robots and directives

    Noindex, nofollow and X-Robots-Tag, plus canonicals and why each page is or is not indexable.

    Included

  • Hreflang audit

    Return links, invalid codes, non-200 targets, missing self-references and x-default.

    Included

  • Exact duplicate pages

    Pages whose visible text is identical, each pointing to the page it duplicates.

    Included

  • Near duplicate content

    Pages whose text is mostly the same, found with MinHash similarity.

    Included

See the site's shape

How the site is put together: which sections hold which pages, how they link, and where the problems cluster.

Example site structure: internal URLs by status, and folders with their page and problem counts.

  • Site visualisations

    Directory tree and internal link graph of the crawled site.

    No charge

  • Segmentation

    Group URLs into segments by pattern and see issues per segment.

    No charge

  • Large crawls

    Up to 100,000 URLs per crawl. You set the cap; you pay only for URLs fetched.

    Included

  • Crawl configuration

    Depth, speed, user agent, subdomains, include and exclude patterns, query-string handling.

    No charge

  • Custom robots.txt

    Test a draft robots.txt against your site before you publish it.

    No charge

  • Forms-based authentication

    Log in to a site through its own form, then crawl the members area.

    No charge

Track it over time

Re-crawl on a schedule and compare any two crawls of a site, so a regression shows up the week it ships.

Example schedule with its recent runs, and a comparison of two crawls showing what changed.

  • Scheduled crawls

    Re-run any crawl hourly, daily, weekly or monthly, in your time zone. Each run is paid from your wallet.

    Included

  • Crawl comparison

    See what changed between two crawls of the same site.

    No charge

  • Saved crawls

    Every crawl is stored in your account to reopen, filter and export as CSV.

    No charge

Go deeper on each page

Add-ons you switch on per crawl when you need them, each charged only for the pages it runs on.

Example URL details with add-on results: Lighthouse scores, accessibility violations, structured data and spelling.

  • JavaScript rendering

    Render pages in headless Chromium before analysis, for sites built with client-side frameworks.

    +$1.00 per 1,000 rendered pages

  • Mobile usability

    Lighthouse mobile checks: viewport, tap targets, responsive images, content width.

    +$4.00 per 1,000 pages

  • Accessibility auditing

    WCAG checks on rendered pages with axe-core.

    +$1.50 per 1,000 pages

  • PageSpeed Insights integration

    Core Web Vitals and Lighthouse scores for crawled pages.

    +$1.00 per 1,000 pagesUses your own API key, saved in Settings. The provider bills you for its API separately.

  • Structured data validation

    JSON-LD, Microdata and RDFa Lite checked against schema.org and the required fields of common Google rich results.

    +$0.50 per 1,000 pages

  • AMP crawling and validation

    Discover AMP versions and validate them against the AMP spec.

    +$0.50 per 1,000 AMP pages

  • Spelling and grammar

    Spelling and grammar checks on page copy in 30+ languages, with a self-hosted LanguageTool server.

    +$1.00 per 1,000 pages

  • AI prompts on every page

    Run OpenAI, Gemini or Anthropic prompts on every page with your own API key.

    +$0.25 per 1,000 prompt runsUses your own API key, saved in Settings. The provider bills you for its API separately.

  • Custom JavaScript

    Run your own snippets on every rendered page and collect the results.

    +$0.50 per 1,000 pages

Get your data out

Pull your own fields from every page, join analytics data in, and take any report with you.

Example custom extraction: price and stock pulled from each product page, ready to export as CSV or to Google Sheets.

  • Custom extraction

    Pull any data from pages with CSS selectors, XPath or regex.

    Included

  • Google Analytics integration

    GA4 sessions and conversions for each crawled URL.

    No chargeUses your connected Google account (Settings → Google).

  • Search Console integration

    Clicks and impressions per URL (free), plus optional URL Inspection index status (per URL inspected).

    +$0.25 per 1,000 URLs inspectedUses your connected Google account (Settings → Google).

  • XML sitemap generation

    Download sitemaps built from the indexable pages of any crawl, split at 50,000 URLs.

    No charge

  • Looker Studio report

    Send crawl results and add-on data to a Google Sheet per site, updated with each crawl, for a Looker Studio dashboard.

    No chargeUses your connected Google account (Settings → Google).

And people to ask

Questions about a crawl or a charge go to real people at [email protected], whatever you spend.

Try any of it on your own site: new accounts start with $1.00 of credit, no card needed. Every setting is in the docs.

Start free