Offer an execvp like interface for running tasks.

Review: https://reviews.apache.org/r/15542
Updates for Ben Mahler's review.