404 for invalid formats

404s are cached in Varnish, 406s aren't. Also arguably an invalid
format is a 404 anyway if it's using a file extension to set the format.