Would be nice to have a specialized version of that for DiffSets that stores both the key and the information (added|removed) in a single long