Fix ignore_headers when ignore_headers config is not set