removed first interlocks and giving pages from robots.txt