Filter out places where no pedestrians were ever seen