Utilising new robots.txt module