Fail at first run that finds an error

@maxfliri