Make parallel compile not call exit.

Closes PR 13373.