Notes on deployment. Improted robots.txt