Remove need to set baseUrl manually, extract it from the target url being crawled