Only restore consent state explicitly from storage.

This ensures that the remote user cannot control the consent
state (issue #383).