Fix failure to fully test job policy backwards compatibility. #4164

Looks like someone used copy/paste here to duplicate code and
did not make all the neccesary edits.