not all HTTP servers support HEAD

I'm not sure what the best way is to get around this, but using an environment variable to check which HTTP method to use for link checking helps me get around this problem when using the datastore to update individual datasets.