Fixed crawler url handling