Don't try to cache the keystore (breaks some tests).
Sign the authorization http header, too.