SEO

Screaming Frog SEO Spider

Industry-leading website crawler for comprehensive technical SEO audits on Windows, macOS, and Linux.

Saved by 1 person

Visit website

Own Screaming Frog SEO Spider?Claim this listing

Overview

Screaming Frog SEO Spider is a powerful website crawler that audits over 300 SEO issues to improve onsite SEO, website health, and user experience. It helps find broken links, analyze metadata, discover duplicate content, generate XML sitemaps, and integrate with Google Analytics and Search Console.

Updated Oct 15, 2026

5 things

What Screaming Frog SEO Spider has

Apps

Windows
macOS
Linux

For developers

A command-line interface that lets you run the tool from a terminal or scripts.

Support

Get help from the support team by writing to them via email.

9 features

Key Features

Website crawling
The Screaming Frog SEO Spider is a website crawler that audits your site for over 300 SEO issues to help improve both SEO, and UX.
Broken link finding
Crawl a website instantly and find broken links (404s) and server errors. Bulk export the errors and source URLs to fix, or send to a developer.
Redirect auditing
Find temporary and permanent redirects, identify redirect chains and loops, or upload a list of URLs to audit in a site migration.
Metadata analysis
Analyse page titles and meta descriptions during a crawl and identify those that are too long, short, missing, or duplicated across your site.
Duplicate content detection
Discover exact duplicate URLs with an md5 algorithmic check, partially duplicated elements such as page titles, descriptions or headings and find low content pages.
XML sitemap creation
Quickly create XML Sitemaps and Image XML Sitemaps, with advanced configuration over URLs to include, last modified, priority and change frequency.
JavaScript crawling
Render web pages using the integrated Chromium WRS to crawl dynamic, JavaScript rich websites and frameworks, such as Angular, React and Vue.js.
Site visualizations
Evaluate internal linking and URL structure using interactive crawl and directory force-directed diagrams and tree graph site visualisations.
Crawl comparison
Track progress of SEO issues and opportunities and see what's changed between crawls. Compare staging against production environments using advanced URL Mapping.

Pros and cons

Pros

Comprehensive SEO audit covering over 300 issues and opportunities.
Supports crawling of JavaScript-heavy websites with rendering capabilities.
Integrates with Google Analytics, Search Console, and PageSpeed Insights for enriched data.
Offers both free version (up to 500 URLs) and affordable paid license with unlimited crawling.
Powerful data extraction and custom search features using XPath, regex, and JavaScript.

Cons

Free version limited to 500 URLs per crawl which may not suffice for large sites.
Requires desktop installation on Windows, macOS, or Linux; no cloud-based SaaS version.
Advanced features and integrations require paid license.
Interface and features may have a learning curve for beginners.
Crawl size limited by system memory and storage capacity.

Developer features

Data analytics
Connect to the Google Analytics, Search Console and PageSpeed Insights APIs and fetch user and performance data for all URLs in a crawl for greater insight.
Scheduled crawls
Schedule crawls to run at chosen intervals and auto export crawl data to any location, including Google Sheets. Or automate entirely via command line.

You?

Be the first to rate Screaming Frog SEO Spider

Your review helps others make better decisions. No account needed. Takes about 10 seconds.

Featured Video

See Screaming Frog SEO Spider at work before you try it.

Watch on YouTube

0 questions

Frequently Asked Questions

Community reviews

Write a review

No written reviews yet. Be the first to share your experience.

Community reviews

Write a review

No written reviews yet. Be the first to share your experience.

5 things

What Screaming Frog SEO Spider has

Apps

Windows
macOS
Linux

For developers

A command-line interface that lets you run the tool from a terminal or scripts.

Support

Get help from the support team by writing to them via email.

9 features

Key Features

Website crawling
The Screaming Frog SEO Spider is a website crawler that audits your site for over 300 SEO issues to help improve both SEO, and UX.
Broken link finding
Crawl a website instantly and find broken links (404s) and server errors. Bulk export the errors and source URLs to fix, or send to a developer.
Redirect auditing
Find temporary and permanent redirects, identify redirect chains and loops, or upload a list of URLs to audit in a site migration.
Metadata analysis
Analyse page titles and meta descriptions during a crawl and identify those that are too long, short, missing, or duplicated across your site.
Duplicate content detection
Discover exact duplicate URLs with an md5 algorithmic check, partially duplicated elements such as page titles, descriptions or headings and find low content pages.
XML sitemap creation
Quickly create XML Sitemaps and Image XML Sitemaps, with advanced configuration over URLs to include, last modified, priority and change frequency.
JavaScript crawling
Render web pages using the integrated Chromium WRS to crawl dynamic, JavaScript rich websites and frameworks, such as Angular, React and Vue.js.
Site visualizations
Evaluate internal linking and URL structure using interactive crawl and directory force-directed diagrams and tree graph site visualisations.
Crawl comparison
Track progress of SEO issues and opportunities and see what's changed between crawls. Compare staging against production environments using advanced URL Mapping.

Pros and cons

Pros

Comprehensive SEO audit covering over 300 issues and opportunities.
Supports crawling of JavaScript-heavy websites with rendering capabilities.
Integrates with Google Analytics, Search Console, and PageSpeed Insights for enriched data.
Offers both free version (up to 500 URLs) and affordable paid license with unlimited crawling.
Powerful data extraction and custom search features using XPath, regex, and JavaScript.

Cons

Free version limited to 500 URLs per crawl which may not suffice for large sites.
Requires desktop installation on Windows, macOS, or Linux; no cloud-based SaaS version.
Advanced features and integrations require paid license.
Interface and features may have a learning curve for beginners.
Crawl size limited by system memory and storage capacity.

Developer features

Data analytics
Connect to the Google Analytics, Search Console and PageSpeed Insights APIs and fetch user and performance data for all URLs in a crawl for greater insight.
Scheduled crawls
Schedule crawls to run at chosen intervals and auto export crawl data to any location, including Google Sheets. Or automate entirely via command line.

You?

Be the first to rate Screaming Frog SEO Spider

Your review helps others make better decisions. No account needed. Takes about 10 seconds.

Featured Video

See Screaming Frog SEO Spider at work before you try it.

Watch on YouTube

0 questions

Screaming Frog SEO Spider

Overview

What Screaming Frog SEO Spider has

Apps

For developers

Support

Key Features

Website crawling

Broken link finding

Redirect auditing

Metadata analysis

Duplicate content detection

XML sitemap creation

JavaScript crawling

Site visualizations

Crawl comparison

Pros and cons

Pros

Cons

Developer features

Data analytics

Scheduled crawls

Be the first to rate Screaming Frog SEO Spider

Featured Video

Frequently Asked Questions

What Screaming Frog SEO Spider has

Apps

For developers

Support

Key Features

Website crawling

Broken link finding

Redirect auditing

Metadata analysis

Duplicate content detection

XML sitemap creation

JavaScript crawling

Site visualizations

Crawl comparison

Pros and cons

Pros

Cons

Developer features

Data analytics

Scheduled crawls

Be the first to rate Screaming Frog SEO Spider

Featured Video

Frequently Asked Questions

More in SEO

More in SEO