Update crawler logic