runner: be more pedantic about the executables