Website Crawlers
Screaming Frog SEO Spider: what it does, what it costs
The desktop crawler that finds more technical faults than tools ten times the price.
Screaming Frog SEO Spider at a glance
Every row is a verified field or an honest absence. A row is dropped rather than filled with an em dash, so the length of this table says how complete the record is.
| What it is | The desktop crawler that finds more technical faults than tools ten times the price. |
|---|---|
| Category | Website Crawlers |
| Best suited for | You do technical SEO and need a complete, unfiltered crawl |
| Starting price | Free up to 500 URLs; licence $279 per user/year |
| Free plan | Yes |
| Free trial | None offered |
| Main strength | Exceptional value at $279 per user per year, with no crawl limits, row caps or credit metering |
| Main limitation | Desktop only, so a crawl depends on your own machine, bandwidth and uptime |
| Evidence | Primary-source researched |
| Closest alternatives | Sitebulb, Semrush, Google Search Console |
| Pricing checked | 18 August 2026 |
| Record checked | 18 August 2026 |
What Screaming Frog SEO Spider is
Screaming Frog SEO Spider crawls a site from your own machine and reports what a search engine would encounter: status codes, redirect chains, canonical conflicts, duplicate content, missing or truncated metadata, broken links, orphaned pages and hreflang faults. It does one job, which is why it costs a fraction of a platform subscription and does that job better than any of them.
The economics are unusual for SEO software. There are no crawl limits, no row caps, no credits and no per-project pricing — a licence is $279 per user per year and the constraint on how much you crawl is your own RAM. On a large site that means switching to database storage mode rather than upgrading a plan.
What it does not do is worth stating plainly: no keyword data, no backlink index, no rank tracking, no scheduled reporting a client would read without help. Its output is raw, which is the point — it is an instrument, and it expects someone who can interpret a reading.
What you can use it for
- Crawl a site and export every URL with its status code, canonical and indexability
- Find broken links, redirect chains and redirect loops before a migration goes live
- Audit titles, meta descriptions and heading structure at scale
- Validate structured data and generate or check an XML sitemap
The features that matter for SEO
Each one says what it does and the SEO job it serves. A vendor feature list without that second half tells you nothing you could not read on their own site.
Full-site crawl with complete export
Requests every discoverable URL and exports status codes, canonicals, indexability, metadata and response times.
The base dataset for any technical audit. Everything else in a technical SEO engagement is a pivot on this export.
Redirect and broken-link reporting
Maps redirect chains and loops, and lists every 4xx and 5xx with the pages linking to it.
The pre-launch check on a migration. A redirect chain that survives a launch quietly costs a hop on every affected URL.
JavaScript rendering
Executes JavaScript with an embedded browser and compares the rendered DOM against the raw source.
On a modern stack this is the only way to see what a crawler actually receives rather than what the framework intended.
Duplicate and near-duplicate detection
Flags exact duplicates and configurable near-duplicate content across the crawl.
Finds the templated pages that compete with each other, which is where programmatic page sets usually go wrong.
Structured data validation
Extracts and validates schema.org markup against the specification during the crawl.
Site-wide markup validation in one pass, rather than testing single URLs in a browser tool.
Scheduled crawls with automated export
Runs crawls on a schedule and writes exports to a folder or Google Drive.
Turns a manual audit into a monitoring job, which is how you catch a regression the week it happens.
The schedule runs on your machine, so it needs a machine that is on.
Search Console and analytics integration
Joins crawl data to Search Console and Google Analytics for the same URLs.
Separates the technical issues that affect pages with impressions from those that affect pages nobody was ever going to find.
Pricing and limits
Starting price: Free up to 500 URLs; licence $279 per user/year Checked 18 August 2026 Vendor’s own pricing page
| Plan | Price | What it includes |
|---|---|---|
| Free | $0 /year |
|
| Licence | $279 /year |
|
| 5 or more licences Add-on | From $265 | Bulk bands, per user per year: $265 each from 5 to 9 licences, $249 from 10 to 19, $235 at 20 or more. |
Add-on rows are only ever charged on top of a plan, so they are excluded from the entry price used in the directory’s price filter.
Strengths and limitations
Strengths
- Exceptional value at $279 per user per year, with no crawl limits, row caps or credit metering
- Finds technical faults that cloud crawlers truncate or miss entirely
- The free tier at 500 URLs is genuinely useful on a small site rather than a demo
- Fifteen years of continuous development on a single job, and it shows in the configuration depth
Limitations
- Desktop only, so a crawl depends on your own machine, bandwidth and uptime
- Large sites need substantial RAM or a switch to database storage mode
- No keyword, backlink or rank-tracking data of any kind
- Output is raw and needs interpretation — it is not a client-ready audit
- Nothing is shareable — a colleague cannot open your crawl without an export
Who it is for, and who should skip it
Worth it if
- You do technical SEO and need a complete, unfiltered crawl
- You are auditing a migration or a large template-driven site
- You want unlimited crawling for a fixed annual cost
Skip it if
- You need a report a client can read without a specialist explaining it
- You want scheduled crawls without leaving a machine running
- You expected keyword or link data in the same tool
Alternatives to Screaming Frog SEO Spider
Each one answers when it is the better choice, which is the only thing a list of competitors is useful for.
- Sitebulb Choose it when the audit has to be handed to a client, because it explains why each issue matters instead of only listing it.
- Semrush Choose it when you want scheduled cloud crawling alongside keyword and competitor data in one subscription.
- Google Search Console Choose it when the question is what Google actually indexed rather than what is crawlable — and it is free.
Sources and verification
Last verified 18 August 2026 2 days ago
Pricing 18 August 2026 Plans 18 August 2026 Features 18 August 2026
- Screaming Frog SEO Spider licence pricing Pricing page verifies pricing, plans, limits checked 18 August 2026
- SEO Spider user guide Documentation verifies features, platforms checked 18 August 2026
Questions
Is the free version of Screaming Frog useful?
On a site under 500 URLs, yes — it will find your broken links, redirect chains and metadata problems. What it will not do is save the crawl, export it or let you configure it, so it works as a check rather than as a workflow.
How much does Screaming Frog cost?
$279 per user per year as of 18 August 2026, with bulk bands from five licences: $265 each from 5 to 9, $249 from 10 to 19, and $235 at 20 or more.
Can Screaming Frog crawl JavaScript sites?
Yes. It renders JavaScript with an embedded browser and can compare the rendered DOM against the raw HTML, which is how you tell whether a crawler sees the content a framework generates.