Limit sshkey collection to workers