Add KillWithFire to runner

- clean up session and guard against multiple starts

Signed-off-by: Eric Malm <emalm@pivotallabs.com>