Over on our Search Engine Optimization Journal blog, I discussed crawl rates and the importance of collecting the data. This has lead to many Identifying Crawl Rates As Part Of SEO.
If you have WordPress then you can add a plugin that will record every visit from the search engines and which pages they are crawling.
The plugin, Crawl Rate Tracker, is easy to install and easy to use. By identifying which pages are not getting re-indexed on a regular basis, you can start to optimize the frequent sites with links back to the less frequent sites.
The plugin can:
* Access crawl data for 3 main search engines
* See the exact times a spider accessed any page on your site
* Monitor your crawl rate over time
* Discover how crawl rate is related to PageRank
While it is not an essential plugin, it does provide plenty of useful information that many may find useful.
