jezdez/django-robots — pull request #6 by amaliagherasim (2012-10-10 14:30:04+00:00)
Title: Removed the 404 status code and added Disallow: /  if the rules are not ...

...defined for a site(why is the robots.txt file returned WITH 404 status code if there are no rules defined?).

The scope is to have the default robots.txt disallow everything if no rules are set for a site.