HTTP status

Crawl Score will report on the HTTP status of every page of your website ensuring that correct status codes are being used

Behind every web page there is a HTTP status that tells a browser or a search engine if the page exists, if it's being forwarded and other factors.

It is important for both users and search engine crawlers that these status codes are correct.

For example, Crawl Score will identify ever page that has a HTTP status of 404. This means the page is not found and suggests a broken link. You can identify all broken links on your website and take corrective action to improve the user experience and ensure search engines can find your content.

Report and filter HTTP status of every page :

Benefits :

A page status of 301 is used to indicated a “permanent redirect”. This means that page no longer exists and usually “forwards” the crawler to the new URL (EG www.website.com/oldpage forwards to www.website.com/newpage).

This is useful when users have a particular page bookmarked or if a “friendly” URL is publicized. However, these pages should not generally be linked to internally (IE from pages of the website) or externally.

Search engines should generally disregard the original page (EG www.website.com/oldpage) and remove it from its index.

A page status of 302 is used to indicate a “temporary redirect”. This is generally when a page is currently not available or you would like search engines to re-visit this page in the future. If a 302 exists for a long period of time it is possible that the search engines will ignore this page as, by definition, it should be a temporary redirect.

A page status of 404 is used to indicate “page not found”. This is a broken link and is undesirable for users and search engine crawlers. If a user finds this page then generally they are at a dead-end and may leave the site.

If a search engine crawler finds an excessive number of broken links this can have an effect on your search engine ranking as the crawler will be spending time following links that add no value.

Crawl Score will even identify which pages link to a 404 page.

A page status of 500 is used to indicate an “internal server error”. This usually means that the site has an error in the code or database. To a user this is similar to a broken link in that their user journey is disturbed by an unexpected page.