Only check for authorization hader if auth was specified in the options