Move compat server runner to a more apt package