Add crawler revisit process (closes #19)