Kill the keep-alive script when we don't need it