Stop sending requests to a domain if max requests exceeded.
Removed duplicated code in main() by joining threads before finishing the loop.
Don't request javascript resources or images.