Contributions by Darius Erdt:
One of the topics that has received a lot of attention in SEO in recent months is the question of how to deal with the Noindex directive in the robots.txt. Many SEOs use noindex for crawling and indexing control, but this will soon be a thing of the past.