Test on  the crawler - without validating

validate is true always, the crawler reads url and scans links in it