Remove the server metadata if it is None