only remove gone boxes that have definitely gone