Fix up some ban logic for PlanetaryColonies