lilasquared/Crawler — pull request #1 by lilasquared (2014-01-21 13:51:51+00:00)
Title: Added checkURL Method

Method asks for headers only and returns true on status code OK, false
otherwise.