lots of changes to get d3 visualization working and to integrate
with real perf tests. also added random test for end-to-end verification.