Fix bug in job configuration

9f54639 introduced a bug that could only be reproduced with integration
test 3308775.