Discovery (robots.txt) bug fix

It fixes the bug with some search engines becuase they will read the first line and not search anymore. This new fix will allow the index page but block everything else from being indexed.