Fix ConcurrentModificationException when remove a player from a recipient