Fixed the bug - crawler now ignores non http(s) links