Finish crawler main logic.