check robots file