Add party to set dict