I realize that what I am describing is a slightly bigger change, so I've created a new ticket for it and am working on it now. https://trello.com/c/KDaqGNPT/15-don-t-run-anything-when-unable-to-determine-runner. PR soon. This PR is fine as is.