Revert crawling method back to the older spawn based approach.

Although the yield-method was interesting, it seemed to have problems
that I wasn't smart enough to resolve.