Make build_sledgehammer die properly if prereqs are not met.
Make sure resetting a pull request also saves the current state tracking.