stianjensen/wikipendium.no — pull request #197 by stianjensen (2014-01-06 22:30:24+00:00)
Title: Disallow subpages for bots

This syntax is not valid according to the official robots.txt spec, but should be interpreted correctly by most current bots.