Fabricatorz/worldlabel — Issue #107: make sure robots.txt working well
Author: rejon
Created: 2012-03-07 16:23:34+00:00
State: open
Labels: Fix Committed, High

I dont know where it is, but there are robot .txt to stop Google from indexing:

Pages/HighQty
Templates/

and maybe some other pages blocked.

We need to make sure these robots stay in place during the transition.

Later on we 2.1 we can visit these "template/" pages and SEO some of them. I implemented these robots because these pages where creating lots of duplicate content issues, same meta descriptions and all...

Once the new sites up, we can do Google webmaster tools and see where all the errors are: 404....