Modified the crawler to report the final URL rather than the provided URL.