amplab/graphx — pull request #26 by ankurdave (2013-10-17 02:27:52+00:00)
Title: Split vTableReplicated into two RDDs

Previously, `(vTableReplicated: IndexedRDD[Pid, VertexHashMap[VD]])` stored one hashmap per partition, taking Vid directly to VD.

To take advantage of @rxin's new hashmaps (see rxin/incubator-spark@32a79d6d13be8a03071296d251a3e532bf964cc0), this commit splits that data structure into two RDDs:

`(vTableReplicationMap: IndexedRDD[Pid, VertexIdToIndexMap])` stores a map per partition from vertex ID to the index where that vertex's attribute is stored. This index refers to an array in the same partition in `vTableReplicatedValues`.

`(vTableReplicatedValues: IndexedRDD[Pid, Array[VD]])` stores the vertex data and is arranged as described above.

As a sanity check, this change passes GraphSuite, but I haven't performed any further testing.