simply implement crawling rate limits
add test for rate limits and update readme
Merge branch 'dev' of github.com:ConnorWeng/node-crawler into ConnorWeng-dev
Merge branch 'master' into ConnorWeng-dev

Conflicts:
	lib/crawler.js
merge
Merge branch 'master' of github.com:paulvalla/node-crawler