Modified robots.txt to add wildcard of adref links