Allow IntIntMultiMap to be given a DirectBytes in constructor.