Makes UserMatch#set_with and UserMatch#one_way_score more effecient