Handle removal of metrics from the registry