Make sure /run/fleet has the correct perms