a nodejs crawler which tries to use all the processors