Delete boxes without points in them once we start the evaluation phase.