process 20 urls at a time. fix an off-by-one bug