Hi! In this post I wanted to introduce you to a great new tool for SEO specialists and web content managers. My fellow Smart Insights commentator Dan Barker introduced me to this and recommends it. It's a tool that has really built on the features available in the Xenu Link Sleuth and taken them to a new level for people involved with Search Engine Optimisation.
Those familiar with Xenu will know how difficult it is to find similar software, especially if like me you use a Macbook. If you don't know Xenu, there's an excellent review by Tom Critchlow of how to use Xenu for SEO. So, onto my review...
Introducing - Screaming Frog SEO Spider
Key differences to Xenu
Mac friendly 🙂
The tool really makes use of the crawl data to give you relevant on-site optimisation advice & alerts - problems you need to look into
The software overlays SEO insights to provide users with "site errors", for example Page titles that are too long
The interface allows easy flicking between different SEO factors relating to the site crawl
Alerts you to pages with problems with missing headings or which are potential duplicate content (Google Webmaster Tools only does this via titles and meta descriptions).
The best way to understand this product is to checkout their product overview video below or visit their website.
Outline of Screaming Frog SEO Spider
Here's a quick summary of some of the data collected -
Errors – Client & server errors (4XX, 5XX)
Redirects – (3XX, permanent or temporary)
Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content
Page Title – Missing, duplicate, over 70 characters, same as h1, multiple
Meta Description – Missing, duplicate, over 156 characters, multiple
Meta Keyword – Mainly for reference as it’s only (barely) used by Yahoo the last time I checked. Missing, duplicate, multiple
H1 – Missing, duplicate, over 70 characters, multiple
H2 – Missing, duplicate, over 70 characters, multiple