Ok, only if id_rsa.pub is there which is only introduced by new API.  Maybe, we should add the one that succeeds in overwritting.