Screaming Frog SEO Spider

Industry-leading website crawler for comprehensive technical SEO audits on Windows, macOS, and Linux.

Own Screaming Frog SEO Spider?Claim this listing

#Data Analysis #E-commerce SEO #Index Coverage Monitoring #Internal Linking #On-Page SEO #SEO Audit #SEO Reporting #Website Migration+4

Visit

Overview

Screaming Frog SEO Spider is a powerful website crawler that audits over 300 SEO issues to improve onsite SEO, website health, and user experience. It helps find broken links, analyze metadata, discover duplicate content, generate XML sitemaps, and integrate with Google Analytics and Search Console.

Last updated: Mar 13, 2026

Key Features

Find Broken Links, Errors & Redirects

Instantly crawl websites to identify broken links (404s), server errors, redirect chains, and loops for quick fixes.

Analyze Page Titles & Meta Data

Audit page titles and meta descriptions to find those that are missing, duplicated, too long or too short.

Discover Duplicate Content

Detect exact duplicate URLs and partially duplicated elements like titles, descriptions, and headings using an md5 algorithmic check.

Extract Data with XPath and Regex

Collect any data from HTML using CSS Path, XPath, or regex for custom data extraction including social tags, prices, SKUs, and more.

Generate XML Sitemaps

Create configurable XML and Image XML sitemaps with options for URLs, last modified dates, priority, and change frequency.

Integrate with Google Analytics, Search Console & PageSpeed Insights

Fetch user and performance data for URLs in a crawl to gain deeper SEO insights and performance metrics.

Crawl JavaScript Websites

Render and crawl dynamic JavaScript-rich sites built with frameworks like Angular, React, and Vue.js using integrated Chromium rendering.

Visualize Site Architecture

Use interactive crawl diagrams and tree graphs to evaluate internal linking, URL structure, and site architecture visually.

Pros

Comprehensive SEO audit covering over 300 issues and opportunities.
Supports crawling of JavaScript-heavy websites with rendering capabilities.
Integrates with Google Analytics, Search Console, and PageSpeed Insights for enriched data.
Offers both free version (up to 500 URLs) and affordable paid license with unlimited crawling.
Powerful data extraction and custom search features using XPath, regex, and JavaScript.

Cons

Free version limited to 500 URLs per crawl which may not suffice for large sites.
Requires desktop installation on Windows, macOS, or Linux; no cloud-based SaaS version.
Advanced features and integrations require paid license.
Interface and features may have a learning curve for beginners.
Crawl size limited by system memory and storage capacity.

Pricing

Plan	Price	Highlights
Free Version	£0	Crawl up to 500 URLs Find broken links, errors, and redirects Analyze page titles and meta data Review meta robots and directives Generate XML sitemaps Site visualisations Basic crawl configuration and scheduling
Paid Version	£199	Unlimited URL crawling (limited by system memory) All free version features plus advanced capabilities JavaScript rendering and crawling Google Analytics, Search Console, and PageSpeed Insights integration Custom extraction and JavaScript crawling Accessibility auditing and link metrics integration Scheduling and crawl comparison Free technical support

Pricing is collected from the official Screaming Frog SEO Spider website and may change. Always confirm with the vendor.

Frequently Asked Questions

Ratings & reviews

No reviews yet. Be the first to share your experience.

Share your experience

Help others decide, your insights matter

Community reviews (0)

Most recent

No reviews yet. Be the first to share your experience.

Ratings & reviews

No reviews yet. Be the first to share your experience.

Share your experience

Help others decide, your insights matter

Community reviews (0)

Most recent

No reviews yet. Be the first to share your experience.

Key Features

Find Broken Links, Errors & Redirects

Instantly crawl websites to identify broken links (404s), server errors, redirect chains, and loops for quick fixes.

Analyze Page Titles & Meta Data

Audit page titles and meta descriptions to find those that are missing, duplicated, too long or too short.

Discover Duplicate Content

Detect exact duplicate URLs and partially duplicated elements like titles, descriptions, and headings using an md5 algorithmic check.

Extract Data with XPath and Regex

Collect any data from HTML using CSS Path, XPath, or regex for custom data extraction including social tags, prices, SKUs, and more.

Generate XML Sitemaps

Create configurable XML and Image XML sitemaps with options for URLs, last modified dates, priority, and change frequency.

Integrate with Google Analytics, Search Console & PageSpeed Insights

Fetch user and performance data for URLs in a crawl to gain deeper SEO insights and performance metrics.

Crawl JavaScript Websites

Render and crawl dynamic JavaScript-rich sites built with frameworks like Angular, React, and Vue.js using integrated Chromium rendering.

Visualize Site Architecture

Use interactive crawl diagrams and tree graphs to evaluate internal linking, URL structure, and site architecture visually.

Pros

Comprehensive SEO audit covering over 300 issues and opportunities.
Supports crawling of JavaScript-heavy websites with rendering capabilities.
Integrates with Google Analytics, Search Console, and PageSpeed Insights for enriched data.
Offers both free version (up to 500 URLs) and affordable paid license with unlimited crawling.
Powerful data extraction and custom search features using XPath, regex, and JavaScript.

Cons

Free version limited to 500 URLs per crawl which may not suffice for large sites.
Requires desktop installation on Windows, macOS, or Linux; no cloud-based SaaS version.
Advanced features and integrations require paid license.
Interface and features may have a learning curve for beginners.
Crawl size limited by system memory and storage capacity.

Pricing

Plan	Price	Highlights
Free Version	£0	Crawl up to 500 URLs Find broken links, errors, and redirects Analyze page titles and meta data Review meta robots and directives Generate XML sitemaps Site visualisations Basic crawl configuration and scheduling
Paid Version	£199	Unlimited URL crawling (limited by system memory) All free version features plus advanced capabilities JavaScript rendering and crawling Google Analytics, Search Console, and PageSpeed Insights integration Custom extraction and JavaScript crawling Accessibility auditing and link metrics integration Scheduling and crawl comparison Free technical support

Pricing is collected from the official Screaming Frog SEO Spider website and may change. Always confirm with the vendor.

Screaming Frog SEO Spider

Overview

Key Features

Find Broken Links, Errors & Redirects

Analyze Page Titles & Meta Data

Discover Duplicate Content

Extract Data with XPath and Regex

Generate XML Sitemaps

Integrate with Google Analytics, Search Console & PageSpeed Insights

Crawl JavaScript Websites

Visualize Site Architecture

Pros

Cons

Pricing

Featured Video

Frequently Asked Questions

Ratings & reviews

Ratings & reviews

Community reviews (0)

Ratings & reviews

Community reviews (0)

Key Features

Find Broken Links, Errors & Redirects

Analyze Page Titles & Meta Data

Discover Duplicate Content

Extract Data with XPath and Regex

Generate XML Sitemaps

Integrate with Google Analytics, Search Console & PageSpeed Insights

Crawl JavaScript Websites

Visualize Site Architecture

Pros

Cons

Pricing

Featured Video

Frequently Asked Questions

More in SEO

Ahrefs

Google Search Console

Serpstat

Frase

Ubersuggest

Moz

Ratings & reviews

Community reviews (0)

More in SEO

Ahrefs

Google Search Console

Serpstat

Frase

Ubersuggest

Moz