Screaming Frog SEO Spider

Industry-leading website crawler for comprehensive technical SEO audits on Windows, macOS, and Linux.

Freemium

#Seo Audit #Internal Linking #Technical SEO Auditing #SEO Reporting #Website Migration #SEO Data Integration #API Data Integration #Mobile AI Integration #Data Analysis #On-Page SEO+6

Overview

Screaming Frog SEO Spider is a powerful website crawler that audits over 300 SEO issues to improve onsite SEO, website health, and user experience.

Screaming Frog SEO Spider is a powerful website crawler that audits over 300 SEO issues to improve onsite SEO, website health, and user experience. It helps find broken links, analyze metadata, discover duplicate content, generate XML sitemaps, and integrate with Google Analytics and Search Console.

Key Features

Find Broken Links, Errors & Redirects

Instantly crawl websites to identify broken links (404s), server errors, redirect chains, and loops for quick fixes.

Analyze Page Titles & Meta Data

Audit page titles and meta descriptions to find those that are missing, duplicated, too long or too short.

Discover Duplicate Content

Detect exact duplicate URLs and partially duplicated elements like titles, descriptions, and headings using an md5 algorithmic check.

Extract Data with XPath and Regex

Collect any data from HTML using CSS Path, XPath, or regex for custom data extraction including social tags, prices, SKUs, and more.

Generate XML Sitemaps

Create configurable XML and Image XML sitemaps with options for URLs, last modified dates, priority, and change frequency.

Integrate with Google Analytics, Search Console & PageSpeed Insights

Fetch user and performance data for URLs in a crawl to gain deeper SEO insights and performance metrics.

Crawl JavaScript Websites

Render and crawl dynamic JavaScript-rich sites built with frameworks like Angular, React, and Vue.js using integrated Chromium rendering.

Visualize Site Architecture

Use interactive crawl diagrams and tree graphs to evaluate internal linking, URL structure, and site architecture visually.

Who It's For

How to Use

Download and Install

Download the Screaming Frog SEO Spider for your operating system (Windows, macOS, Linux) and install it.

Start a Crawl

Enter the website URL you want to audit and start the crawl to analyze site structure and SEO issues.

Review Crawl Data

Explore the crawl results including broken links, redirects, metadata, duplicate content, and directives.

Use Filters and Visualisations

Utilize filters, site visualisations, and reports to understand site architecture and prioritize fixes.

Export and Share Reports

Export crawl data and reports for further analysis or to share with developers and stakeholders.

Pricing

Pricing details are gathered from the official Screaming Frog SEO Spider website and are provided for reference only. Always confirm the latest information directly with the vendor.

Plan	Price	Highlights
Free Version	£0	Crawl up to 500 URLs Find broken links, errors, and redirects Analyze page titles and meta data Review meta robots and directives Generate XML sitemaps Site visualisations Basic crawl configuration and scheduling
Paid Version	£199	Unlimited URL crawling (limited by system memory) All free version features plus advanced capabilities JavaScript rendering and crawling Google Analytics, Search Console, and PageSpeed Insights integration Custom extraction and JavaScript crawling Accessibility auditing and link metrics integration Scheduling and crawl comparison Free technical support

Found a change in pricing? We welcome corrections. Reach out so we can keep this listing accurate.

Pros & Cons

Pros

Comprehensive SEO audit covering over 300 issues and opportunities.
Supports crawling of JavaScript-heavy websites with rendering capabilities.
Integrates with Google Analytics, Search Console, and PageSpeed Insights for enriched data.
Offers both free version (up to 500 URLs) and affordable paid license with unlimited crawling.
Powerful data extraction and custom search features using XPath, regex, and JavaScript.

Cons

Free version limited to 500 URLs per crawl which may not suffice for large sites.
Requires desktop installation on Windows, macOS, or Linux; no cloud-based SaaS version.
Advanced features and integrations require paid license.
Interface and features may have a learning curve for beginners.
Crawl size limited by system memory and storage capacity.

Use Cases

Explore tools grouped by use case so you can keep researching without losing momentum.

Frequently Asked Questions

Alternatives

Compare other vetted products our editors see buyers evaluate alongside Screaming Frog SEO Spider.

Ratings & reviews

Key Features

Find Broken Links, Errors & Redirects

Instantly crawl websites to identify broken links (404s), server errors, redirect chains, and loops for quick fixes.

Analyze Page Titles & Meta Data

Audit page titles and meta descriptions to find those that are missing, duplicated, too long or too short.

Discover Duplicate Content

Detect exact duplicate URLs and partially duplicated elements like titles, descriptions, and headings using an md5 algorithmic check.

Extract Data with XPath and Regex

Collect any data from HTML using CSS Path, XPath, or regex for custom data extraction including social tags, prices, SKUs, and more.

Generate XML Sitemaps

Create configurable XML and Image XML sitemaps with options for URLs, last modified dates, priority, and change frequency.

Integrate with Google Analytics, Search Console & PageSpeed Insights

Fetch user and performance data for URLs in a crawl to gain deeper SEO insights and performance metrics.

Crawl JavaScript Websites

Render and crawl dynamic JavaScript-rich sites built with frameworks like Angular, React, and Vue.js using integrated Chromium rendering.

Visualize Site Architecture

Use interactive crawl diagrams and tree graphs to evaluate internal linking, URL structure, and site architecture visually.

Who It's For

How to Use

Download and Install

Download the Screaming Frog SEO Spider for your operating system (Windows, macOS, Linux) and install it.

Start a Crawl

Enter the website URL you want to audit and start the crawl to analyze site structure and SEO issues.

Review Crawl Data

Explore the crawl results including broken links, redirects, metadata, duplicate content, and directives.

Use Filters and Visualisations

Utilize filters, site visualisations, and reports to understand site architecture and prioritize fixes.

Export and Share Reports

Export crawl data and reports for further analysis or to share with developers and stakeholders.

Pricing

Pricing details are gathered from the official Screaming Frog SEO Spider website and are provided for reference only. Always confirm the latest information directly with the vendor.

Plan	Price	Highlights
Free Version	£0	Crawl up to 500 URLs Find broken links, errors, and redirects Analyze page titles and meta data Review meta robots and directives Generate XML sitemaps Site visualisations Basic crawl configuration and scheduling
Paid Version	£199	Unlimited URL crawling (limited by system memory) All free version features plus advanced capabilities JavaScript rendering and crawling Google Analytics, Search Console, and PageSpeed Insights integration Custom extraction and JavaScript crawling Accessibility auditing and link metrics integration Scheduling and crawl comparison Free technical support

Found a change in pricing? We welcome corrections. Reach out so we can keep this listing accurate.

Pros & Cons

Pros

Comprehensive SEO audit covering over 300 issues and opportunities.
Supports crawling of JavaScript-heavy websites with rendering capabilities.
Integrates with Google Analytics, Search Console, and PageSpeed Insights for enriched data.
Offers both free version (up to 500 URLs) and affordable paid license with unlimited crawling.
Powerful data extraction and custom search features using XPath, regex, and JavaScript.

Cons

Free version limited to 500 URLs per crawl which may not suffice for large sites.
Requires desktop installation on Windows, macOS, or Linux; no cloud-based SaaS version.
Advanced features and integrations require paid license.
Interface and features may have a learning curve for beginners.
Crawl size limited by system memory and storage capacity.

Use Cases

Explore tools grouped by use case so you can keep researching without losing momentum.

Frequently Asked Questions

Alternatives

Compare other vetted products our editors see buyers evaluate alongside Screaming Frog SEO Spider.

Screaming Frog SEO Spider

Overview

Featured Video

Key Features

Find Broken Links, Errors & Redirects

Analyze Page Titles & Meta Data

Discover Duplicate Content

Extract Data with XPath and Regex

Generate XML Sitemaps

Integrate with Google Analytics, Search Console & PageSpeed Insights

Crawl JavaScript Websites

Visualize Site Architecture

Who It's For

How to Use

Download and Install

Start a Crawl

Review Crawl Data

Use Filters and Visualisations

Export and Share Reports

Pricing

Pros & Cons

Pros

Cons

Use Cases

Frequently Asked Questions

Alternatives

Ratings & reviews

Featured Video

Key Features

Find Broken Links, Errors & Redirects

Analyze Page Titles & Meta Data

Discover Duplicate Content

Extract Data with XPath and Regex

Generate XML Sitemaps

Integrate with Google Analytics, Search Console & PageSpeed Insights

Crawl JavaScript Websites

Visualize Site Architecture

Who It's For

How to Use

Download and Install

Start a Crawl

Review Crawl Data

Use Filters and Visualisations

Export and Share Reports

Pricing

Pros & Cons

Pros

Cons

Use Cases

Frequently Asked Questions

Alternatives

Ratings & reviews