Add speedup for extract when permuted is False