Respect factor level ordering of PooledDataArrays in some places.