Yes, you can use a single SSH key pair to authenticate against multiple remote servers by copying the public key to each one in authorized_keys.