Don't start a single MatchRunner multiple times.

Closes #957.