updated logic to allow forcing 'GET' request in curl, and using this method if first check (HEAD) fails.
updated function documentation