Added robots.txt and PUBLIC option