Do not delete the current build image if there's no build one.

* We hope this will prevent the image from being rebuilt if the first
few jobs fail.