Add alert for restarting servers when removing users