Provide generic method to get runner tarballs