Add kill option to CLI
Implement sending stop signal to long running requests