Get our version of reduce_by_key's output to match the reference.