Switches to configuration and ditches the temporary key