Fix run-app job distribution

Signed-off-by: Jonathan Rudenberg <jonathan@titanous.com>