Ah, Dan points out that this is a lazy merge sort, so this is not an issue.  Awesome!