We love crawlscore! Posted by Dan Frost on Thu, 17/05/2007 - 14:36
When we dreamt up crawlscore it sounded like a good idea and now it's here and we've used it, it's a brilliant idea. Google Webmaster Tools is useful and webmasters should certainly use it but we feel that it only tells a part of the story. We've used crawlscore on some of our sites own and found hundreds of errors that aren't shown in Google Webmaster Tools. This isn't meant to be a "let's all laugh at Google" post but GWT will always have limitions due to the sheer number of sites and the limitations on information they can give.
There will be a comparison matrix on the site soon so you can see the differences between crawlscore and Google Webmaster Tools. In short, crawlscore will show page sizes, http status codes 200, 301, 302, 404, 500 (and all other http errors), duplicate pages titles, missing page titles, missing meta keywords/descriptions, highlight individual pages that are excluded by robots.txt, show number of pages found by our crawler (this is very important - if our crawler finds 4000 pages and Google sees 1000 you've gotta ask yourself why..), your internal linking structure (also very important), maximum page size (HTML only) and other bits of useful info.
We find the reporting of all this information to be very clear and concise in crawlscore - we hope you do too. Finally, you can request your site to be re-crawled in full at your request. Google tends to build a picture of your site over a period of time - our crawler will do the site in one run therefore giving you an accurate picture of what's what at that point in time. And finally (really this time) you'll get a Crawl Score. This score is based on a number of factors and the highest scorers will be shown on the homepage of this site (if they wish). To qualify they must have over 200 pages though :) |