Revert "HACK: Skip provisioning every time mailbox is opened"

This reverts commit c61f63c5c40fa3e964b281c1ad66635b92b8802f.