Add your id_rsa.pub(read it from a file) to ~/.ssh/authorized_keys when the file authorized_keys is modified.