Only check if the domain is not set

This was only working for the first request.  Subsequent requests to other domains were causing an undefined index error because `empty(self::$robotstxt)` was `false`
Test multiple domain support for RobotsTxt
Merge pull request #28 from mfairchild365/user-agent

Only check if the domain is not set