Cleanup runner when ended/killed