Made crawler make use of multithreading

Now supplies an array of urls to crawler class