updated some qc tests
updated robots
updated robots file
updated robots.txt