test http/https urls only
Merge pull request #71 from vaidik/irc_crawler_failure

test http/https urls only