Treat sorting through permutations (so we can try and reduce size of zero/one caching structures)