Factor out some of the runner installation