Delete previous keystores if they exist