Minor performance improve

Remove unneeded sorting, since sorting can be a big performance hit.