Actually cancel pending delete finalizers when the deletion is canceled.