unique the array a bit more to try and cut down on mem usage