Add a 'keep' button on the delete server page