[CRAW-55] Make crawler susceptible to "slow" mark to separate fast and slow crawlers.
Merge pull request #19 from integralads/fb/craw_55_fast_slow_crawlers

[CRAW-55] Make crawler susceptible to "slow" mark to separate fast and slow crawlers.