Add an option to remove a client specific conf file