improve filtering of bad links to folow during crawling by includeing the anhor text for checking