Make sure private key (from JSON) is bytes
Fix pypy tox environments