Implement robots.txt to keep web crawlers out. -- Borrowed from SABnzbd :)