Allow the session to not have the asked keys

Fixes https://github.com/fedora-infra/python-fedora/issues/53