Remove old runners.