Add user agent header to reqeust method of web crawler