Overlord needs to hang on to the key - we're setting it before instance create, and erasing after instance delete.