If you would like to cancel your Kemper auto insurance policy you can either call 1-800-216-6347 or speak to an agent at a local office. If you have paid for your policy premiums in advance and have unused coverage time, you should expect a prorated refund.