franzenzenhofer/robotstxt — Issue #6: ignore blank newlines in a group
Author: franzenzenhofer
Created: 2012-01-24 16:58:06+00:00
State: open

i.e.: http://www.love.at/robots.txt

between user agent definition groups are important, because the determine if usage agent definition get grouped together, in a group they should get ignored