Fixing URL check in crawler controls.
Adding new crawler status section to html template.
Reworking crawler status logic.