Delete the subscription if it exists too early