If dealing with the filters here, we have to do it every time when there is a access path. If finishing it in ParsedSelectStmt, then we only need to process it once.