Make sure we fetched the keys before encrypting