Only permute the entities that should be run in parallel