Speedup and clean up operation optimization.

Paired on this with @matttproud. I removed the IsSorted() panic check we had previously to remove any unnecessary slowdowns. It has been running with this check enabled on a heavy-duty Prometheus for a while.