open most urls in robots.txt; add google webmaster tools verification; meta description for flappy page