runner: Add a bit of paranoia