Support hidden articles in robots.txt