Don't delete the client and key on deploy

Tagging @Drewzar for review