Adds disallow none
Merge pull request #9 from standout/mu_adds_disallow_none_to_robotstxt

Adds disallow none