Split the runner admin stuff away from the base runner class