Added delay between crawler threads.
Added in RTT for Request.
Updated README with optimizations.