Remove unneeded collect queue.

I added it on speculation that Swift arrays were not threadsafe for
independent element access. But it turned out that the crashes I
was seeing were caused by recursion overflowing thread stacks.