updating production url (long overdue), adding robots.txt