Don't spectator-track people on enemy team