Remove auth.
Properly add robots.txt.