Prune the table scan assignments just before plan finalization

This will cut down on the size of the assignments map when logging