We already make a split in choice of collector impl for the case where the number of buckets is 1 or >1 so maybe there could be another break-point where we choose between hash table and sorted array?