enviornment detection
robot.txt
robot.txt