added biblio related urls to robots.txt