Make sure to actually exit with non-zero in case of problems.