Archived; click post to view.
Excerpt: Normally, as SEO’s we try to concentrate on getting the search engines crawl and index as much of the site as possible. However, occasionally there might be reasons why you would want to remove content from search engines. For example, if spammers have infiltrated your site and put links to their sites. There are a number of ways in which you can tell the search engine what to do. .htaccess – password protect the content you really don’t want search engines to index. (you have to do this before they index the content.) This is a strong method of protecting the content…

Archived; click post to view.
Excerpt: An interesting interview between Eric Enge and Matt Cutts sheds light on the distinction between the NoIndex, NoFollow and Robots.txt. These are the staples when trying to sculpt PageRank,  so that it accrues only to your most important pages or avoiding excessive duplicate content. The interview transcript reveals lots of useful information but it is helpful to summarise that information which I have done below: Passes PR? Links Crawled? Page Indexed? NoIndex Y Y N NoFollow N N Y Robots.txt Y N URL returned only The noindex and nofollow attributes can be combined. To complicate matters further, the attributes can be used in different ways. Either: a) as part of the link, for example: <a rel=”nofollow, noindex”…