remove points that are once assigned to any window