[gh-14] Fix RobotsTxt test by using file_get_contents

trying to get http://wwww.basepage.com/robots.txt in the test doesn't work