How hard would it be to move the logic that determines what filters can be pushed down here, into the planner, so that we can avoid the double evaluation?