Mark the builds getting cancel so we don't try to start them while stopping the chain