Remove all old keychains before creating a new one