Don't send authorization when unnecessary.

This improves cacheability as requests with authorization can't be
cached.